Commit Graph

294 Commits

Author SHA1 Message Date
practicalswift
659b415462 [gardening] Fix typo. 2017-05-11 16:04:36 +02:00
practicalswift
49ed8579c4 [gardening] Use American English. 2017-05-09 20:44:30 +02:00
Mishal Shah
a05b35c332 Merge pull request #9026 from palimondo/SR-4598
[benchmark] Support multiple regular expression filters in Benchmark_Driver
2017-05-05 09:46:02 -07:00
Pavol Vaskovic
2f8f11801a Filters are now regullar expression patterns 2017-05-05 08:48:41 +02:00
practicalswift
cc6a160d91 [gardening] Remove unused Python property cv 2017-05-04 15:21:45 +02:00
Pavol Vaskovic
68fde69535 Applied DRYer. Made python lint happy. 2017-05-02 21:49:59 +02:00
Pavol Vaskovic
bdffb35d17 SR-4572 Remove jinja2 dependency from benchmark test harness generation 2017-05-02 16:20:30 +02:00
swift-ci
ba67a51c54 Merge pull request #8978 from palimondo/SR-4659 2017-04-27 14:53:26 -07:00
Pavol Vaskovic
d77324782a Fix SR-4659 Benchmark logs should be tied to tested tree version 2017-04-27 23:09:14 +02:00
Pavol Vaskovic
6d9de4ca70 Multiple filters are specified by repeated -f
Updated usage documentation to reflect this.
2017-04-26 21:12:59 +02:00
Pavol Vaskovic
c719818024 Fix SR-4601 Report Added and Removed Benchmarks in Performance Comparison (#8991)
* Refactor compare_perf_tests.py

* Fix SR-4601 Report Added and Removed Benchmarks in Performance Comparison

Improved HTML styling.

* Added back support for reading concatenated Benchmark_Driver output

PerformanceTestResults can be merged, computing new MIN, MAX, and running MEAN and SD.

* Handle output from Benchmark_O again

Treat MAX_RSS as optional column
2017-04-26 12:09:18 -07:00
Michael Ilseman
111d6200eb Merge pull request #8979 from milseman/parse_my_tweets_faster
[stdlib] Parse my tweets faster! 2x forwards, 3x reverse
2017-04-26 07:36:18 -07:00
Pavol Vaskovic
481f542100 Support multiple prefix filters 2017-04-26 16:14:59 +02:00
swift-ci
9b0fe1a47a Merge pull request #8975 from palimondo/SR-4598 2017-04-25 14:07:19 -07:00
Pavol Vaskovic
cecfe439c6 Display OPT choices in usage help
Fixed pyton-lint warnings
2017-04-25 03:50:40 +02:00
Pavol Vaskovic
5c29fa65b1 Renamed args.benchmarks - plural 2017-04-25 03:25:29 +02:00
swift-ci
a67c6d00f5 Merge pull request #8923 from moiseev/reverse-improvements 2017-04-24 17:06:07 -07:00
Michael Ilseman
517ac2a66f [benchmark] Add in some (default off) mixed-string micro benchmarks
Adds in a benchmark to see how quickly we can traverse mixed latin and
emoji strings. Default disabled and part of the stringTests suite.
2017-04-24 14:57:42 -07:00
Pavol Vaskovic
094094a04c Addressed python style issue raised during review 2017-04-24 23:53:40 +02:00
Pavol Vaskovic
3a5051e392 Fix SR-4598 Add option to run subset of benchmarks matching a prefix 2017-04-24 23:40:38 +02:00
Max Moiseev
9aa1e61851 Sorting performance by delta instead of ratio
...to avoid problems with rounding.
2017-04-24 14:34:38 -07:00
Andrew Trick
f5410be16b compare_perf_tests.py: fix column header formatting.
Column names must not contain spaces for tools that auto-format the table.
The extra "(%)" was completely redundant since every value in the column
reads as a percentage.
2017-04-22 10:16:17 -07:00
Max Moiseev
c4dc74b9b6 Fixing the crash in compare_perf_tests
Comparisons should only be performed on the intersection of test lists,
otherwise it would crash should the new benchmark be introduced.
2017-04-21 14:40:38 -07:00
Max Moiseev
d878b45e29 Reverse the order of improvements in the output of compare_perf_tests
Both regressions and improvements are sorted by the delta, which in case
of improvements produces the reversed order due to negative values of
delta.
This change makes the improvements ordered 'naturally':
most-improved-first.
2017-04-21 13:59:02 -07:00
Arnold Schwaighofer
a4c1bc9e5e Make python lint happy 2017-04-20 20:16:16 -07:00
Arnold Schwaighofer
c9aa05c3c6 [benchmark] Move existential tests out of precommit. They are not very stable. 2017-04-20 13:11:20 -07:00
Michael Ilseman
f6bf784ef1 [benchmark] Appease python lint 2017-04-19 15:55:16 -07:00
Michael Ilseman
edf8e6e5e6 [benchmark] Move work into the harness generator
Move the improvements to main.swift into the harness generator and
template itself. Run the generator.
2017-04-19 14:59:35 -07:00
swift-ci
bf08d01610 Merge pull request #8641 from palimondo/sequence-benchmarks 2017-04-14 00:35:02 -07:00
Pavol Vaskovic
857745fbf1 Added usage comment to test driver. Renamed validation-test/[benchmarks -> benchmark]. 2017-04-13 21:38:21 +02:00
Pavol Vaskovic
6a54bc22ff Fixed Python style issues reported by python-lint 2017-04-13 13:00:54 +02:00
practicalswift
77ab316d60 [gardening] Avoid blind exception 2017-04-12 15:13:11 +02:00
Michael Gottesman
92b70212bb [leaksrunner] Handle subprocesses segfaulting nicely rather than throwing an IndexError. 2017-04-10 16:33:26 -07:00
Michael Gottesman
503b6b883f [leaksrunner] Use pool.map_async.get(999999) instead of pool.map so that we support C-c. 2017-04-10 16:00:04 -07:00
Pavol Vaskovic
7c103d80c6 Validate that benchmark commits contain freshly generated test harness 2017-04-11 00:47:34 +02:00
Pavol Vaskovic
4f3753a749 Add support for GYB in benchmarks 2017-04-08 09:13:18 +02:00
Hugh Bellamy
8671854674 Properly python lint remaining files 2017-03-23 14:06:46 +07:00
Doug Coleman
e7390d1770 Revert "utils: Add swiftenvs, which allow the overriding of compiler tools."
This reverts commit 2b923f3846.
2017-03-22 20:09:34 -07:00
Doug Coleman
2b923f3846 utils: Add swiftenvs, which allow the overriding of compiler tools. 2017-03-21 14:59:12 -07:00
Nate Cook
252af7d9c9 Merge pull request #7617 from natecook1000/nc-hash-quadtest
Add benchmark for quadratic hash performance
2017-03-01 08:11:03 +09:00
Hugh Bellamy
4f23d61da0 Import print_function wherever we use print() in python code 2017-02-20 11:11:27 +07:00
Nate Cook
b100181fe0 Update CMakeList template for benchmarks 2017-02-18 22:21:12 -06:00
Hugh Bellamy
fa3543d3c5 Fix some pylint errors for double whitespace after class/function 2017-02-17 15:37:19 +07:00
practicalswift
fccad8d1a0 Use proper spacing. 2017-02-15 21:48:25 +01:00
practicalswift
78c3770d27 Use the py2+py3 compatible way to reduce using functools.reduce(...) 2017-02-15 21:41:53 +01:00
practicalswift
6d1ae2a39c [gardening] 2016 → 2017 2017-01-06 16:41:22 +01:00
Nate Cook
e56bf42acb Update generate_harness.py templates
These templates had gotten slightly out of date through
manual edits. These changes make it so that running
generate_harness.py actually generates the desired files.

Changes to the non-template files are a result of the script's
alphabetization.
2017-01-04 22:26:02 -06:00
practicalswift
797b80765f [gardening] Use the correct base URL (https://swift.org) in references to the Swift website
Remove all references to the old non-TLS enabled base URL (http://swift.org)
2016-11-20 17:36:03 +01:00
Michael Gottesman
dc64594580 [benchmark][generate-harness] When generating the CMakeLists.txt file for the harness, sort the single-source files to give a deterministic ordering. 2016-09-23 19:16:22 -07:00
Michael Gottesman
ff634f6319 [benchmarks] Make generate_harness.py executable. 2016-09-23 19:10:08 -07:00