swift-ci
ba67a51c54
Merge pull request #8978 from palimondo/SR-4659
2017-04-27 14:53:26 -07:00
Pavol Vaskovic
d77324782a
Fix SR-4659 Benchmark logs should be tied to tested tree version
2017-04-27 23:09:14 +02:00
Pavol Vaskovic
c719818024
Fix SR-4601 Report Added and Removed Benchmarks in Performance Comparison ( #8991 )
...
* Refactor compare_perf_tests.py
* Fix SR-4601 Report Added and Removed Benchmarks in Performance Comparison
Improved HTML styling.
* Added back support for reading concatenated Benchmark_Driver output
PerformanceTestResults can be merged, computing new MIN, MAX, and running MEAN and SD.
* Handle output from Benchmark_O again
Treat MAX_RSS as optional column
2017-04-26 12:09:18 -07:00
Michael Ilseman
111d6200eb
Merge pull request #8979 from milseman/parse_my_tweets_faster
...
[stdlib] Parse my tweets faster! 2x forwards, 3x reverse
2017-04-26 07:36:18 -07:00
swift-ci
9b0fe1a47a
Merge pull request #8975 from palimondo/SR-4598
2017-04-25 14:07:19 -07:00
Pavol Vaskovic
cecfe439c6
Display OPT choices in usage help
...
Fixed pyton-lint warnings
2017-04-25 03:50:40 +02:00
Pavol Vaskovic
5c29fa65b1
Renamed args.benchmarks - plural
2017-04-25 03:25:29 +02:00
swift-ci
a67c6d00f5
Merge pull request #8923 from moiseev/reverse-improvements
2017-04-24 17:06:07 -07:00
Michael Ilseman
517ac2a66f
[benchmark] Add in some (default off) mixed-string micro benchmarks
...
Adds in a benchmark to see how quickly we can traverse mixed latin and
emoji strings. Default disabled and part of the stringTests suite.
2017-04-24 14:57:42 -07:00
Pavol Vaskovic
094094a04c
Addressed python style issue raised during review
2017-04-24 23:53:40 +02:00
Pavol Vaskovic
3a5051e392
Fix SR-4598 Add option to run subset of benchmarks matching a prefix
2017-04-24 23:40:38 +02:00
Max Moiseev
9aa1e61851
Sorting performance by delta instead of ratio
...
...to avoid problems with rounding.
2017-04-24 14:34:38 -07:00
Andrew Trick
f5410be16b
compare_perf_tests.py: fix column header formatting.
...
Column names must not contain spaces for tools that auto-format the table.
The extra "(%)" was completely redundant since every value in the column
reads as a percentage.
2017-04-22 10:16:17 -07:00
Max Moiseev
c4dc74b9b6
Fixing the crash in compare_perf_tests
...
Comparisons should only be performed on the intersection of test lists,
otherwise it would crash should the new benchmark be introduced.
2017-04-21 14:40:38 -07:00
Max Moiseev
d878b45e29
Reverse the order of improvements in the output of compare_perf_tests
...
Both regressions and improvements are sorted by the delta, which in case
of improvements produces the reversed order due to negative values of
delta.
This change makes the improvements ordered 'naturally':
most-improved-first.
2017-04-21 13:59:02 -07:00
Arnold Schwaighofer
a4c1bc9e5e
Make python lint happy
2017-04-20 20:16:16 -07:00
Arnold Schwaighofer
c9aa05c3c6
[benchmark] Move existential tests out of precommit. They are not very stable.
2017-04-20 13:11:20 -07:00
Michael Ilseman
f6bf784ef1
[benchmark] Appease python lint
2017-04-19 15:55:16 -07:00
Michael Ilseman
edf8e6e5e6
[benchmark] Move work into the harness generator
...
Move the improvements to main.swift into the harness generator and
template itself. Run the generator.
2017-04-19 14:59:35 -07:00
swift-ci
bf08d01610
Merge pull request #8641 from palimondo/sequence-benchmarks
2017-04-14 00:35:02 -07:00
Pavol Vaskovic
857745fbf1
Added usage comment to test driver. Renamed validation-test/[benchmarks -> benchmark].
2017-04-13 21:38:21 +02:00
Pavol Vaskovic
6a54bc22ff
Fixed Python style issues reported by python-lint
2017-04-13 13:00:54 +02:00
practicalswift
77ab316d60
[gardening] Avoid blind exception
2017-04-12 15:13:11 +02:00
Michael Gottesman
92b70212bb
[leaksrunner] Handle subprocesses segfaulting nicely rather than throwing an IndexError.
2017-04-10 16:33:26 -07:00
Michael Gottesman
503b6b883f
[leaksrunner] Use pool.map_async.get(999999) instead of pool.map so that we support C-c.
2017-04-10 16:00:04 -07:00
Pavol Vaskovic
7c103d80c6
Validate that benchmark commits contain freshly generated test harness
2017-04-11 00:47:34 +02:00
Pavol Vaskovic
4f3753a749
Add support for GYB in benchmarks
2017-04-08 09:13:18 +02:00
Hugh Bellamy
8671854674
Properly python lint remaining files
2017-03-23 14:06:46 +07:00
Doug Coleman
e7390d1770
Revert "utils: Add swiftenvs, which allow the overriding of compiler tools."
...
This reverts commit 2b923f3846 .
2017-03-22 20:09:34 -07:00
Doug Coleman
2b923f3846
utils: Add swiftenvs, which allow the overriding of compiler tools.
2017-03-21 14:59:12 -07:00
Nate Cook
252af7d9c9
Merge pull request #7617 from natecook1000/nc-hash-quadtest
...
Add benchmark for quadratic hash performance
2017-03-01 08:11:03 +09:00
Hugh Bellamy
4f23d61da0
Import print_function wherever we use print() in python code
2017-02-20 11:11:27 +07:00
Nate Cook
b100181fe0
Update CMakeList template for benchmarks
2017-02-18 22:21:12 -06:00
Hugh Bellamy
fa3543d3c5
Fix some pylint errors for double whitespace after class/function
2017-02-17 15:37:19 +07:00
practicalswift
fccad8d1a0
Use proper spacing.
2017-02-15 21:48:25 +01:00
practicalswift
78c3770d27
Use the py2+py3 compatible way to reduce using functools.reduce(...)
2017-02-15 21:41:53 +01:00
practicalswift
6d1ae2a39c
[gardening] 2016 → 2017
2017-01-06 16:41:22 +01:00
Nate Cook
e56bf42acb
Update generate_harness.py templates
...
These templates had gotten slightly out of date through
manual edits. These changes make it so that running
generate_harness.py actually generates the desired files.
Changes to the non-template files are a result of the script's
alphabetization.
2017-01-04 22:26:02 -06:00
practicalswift
797b80765f
[gardening] Use the correct base URL ( https://swift.org ) in references to the Swift website
...
Remove all references to the old non-TLS enabled base URL (http://swift.org )
2016-11-20 17:36:03 +01:00
Michael Gottesman
dc64594580
[benchmark][generate-harness] When generating the CMakeLists.txt file for the harness, sort the single-source files to give a deterministic ordering.
2016-09-23 19:16:22 -07:00
Michael Gottesman
ff634f6319
[benchmarks] Make generate_harness.py executable.
2016-09-23 19:10:08 -07:00
practicalswift
ee871c7938
[python] Bring code base in line with PEP-8 again
2016-09-16 19:33:04 +02:00
practicalswift
4485f76794
[gardening] Use consistent capitalization for "Objective-C".
2016-06-14 22:24:43 +02:00
practicalswift
e8c4e1dd24
[gardening] Fix PEP 8 regression.
2016-04-02 11:31:07 +02:00
Erik Eckstein
12f38252d9
compare_perf_tests script: Fix two minor bugs
...
1) --changes-only didn't have an effect on formats other than html
2) a wrong-format error was printed even if the format name was correct
2016-04-01 14:18:29 -07:00
Erik Eckstein
d628cced3d
compare_perf_tests script: Fix bug when calculating the minimum/maximum of multiple samples
...
Instead of the minimum always the last sample was taken.
2016-04-01 14:18:29 -07:00
practicalswift
11a8b6c2ba
[gardening] Daily cleanup: typos, header formatting.
2016-03-28 09:29:38 +02:00
practicalswift
d00a5ef814
[gardening] Weekly gardening: typos, duplicate includes, header formatting, etc.
2016-03-24 22:41:10 +01:00
practicalswift
1f90412532
[Python] Remove unused function nthroot. Use sys.exit(…) instead of exit(…)
2016-03-22 21:34:41 +01:00
Mishal Shah
cb23837bb9
[Compare Perf] Add support for markdown and html
2016-03-21 18:08:08 -07:00