Commit Graph

372 Commits

Author SHA1 Message Date
Ted Kremenek
749e05ba13 Merge pull request #8861 from tkremenek/ver-4-bump
Bump Swift version to 4.0
2017-04-28 14:03:55 -07:00
swift-ci
96516f851d Merge pull request #9088 from eeckstein/fix-typo 2017-04-28 07:28:59 -07:00
Ted Kremenek
ef98f2bd2a Merge branch 'master' into ver-4-bump 2017-04-27 23:19:14 -07:00
Erik Eckstein
62be182cac benchmarks: add a comment and use more meaningful numbers 2017-04-27 16:59:42 -07:00
swift-ci
ba67a51c54 Merge pull request #8978 from palimondo/SR-4659 2017-04-27 14:53:26 -07:00
Pavol Vaskovic
d77324782a Fix SR-4659 Benchmark logs should be tied to tested tree version 2017-04-27 23:09:14 +02:00
Maxim Moiseev
41b00c57ab Merge pull request #9044 from moiseev/substring-in
[stdlib] Substring
2017-04-26 19:25:59 -07:00
Max Moiseev
3b607436be Making benchmarks compile 2017-04-26 16:49:34 -07:00
Erik Eckstein
994c04f943 benchmarks: add another benchmark for appending multiple array elements.
In contrast to the other similar benchmarks, this benchmark starts with a new array each iteration.
2017-04-26 15:06:05 -07:00
Erik Eckstein
7914e09aa8 benchmarks: Add a benchmark for COW existentials 2017-04-26 14:54:16 -07:00
swift-ci
0ce898be79 Merge pull request #9036 from aschwaighofer/benchmark_more_autoreleasepools 2017-04-26 13:52:22 -07:00
Arnold Schwaighofer
ca40134c03 [benchmark] Sprinkle more autoreleasepools
SR-4666
2017-04-26 13:21:43 -07:00
Pavol Vaskovic
c719818024 Fix SR-4601 Report Added and Removed Benchmarks in Performance Comparison (#8991)
* Refactor compare_perf_tests.py

* Fix SR-4601 Report Added and Removed Benchmarks in Performance Comparison

Improved HTML styling.

* Added back support for reading concatenated Benchmark_Driver output

PerformanceTestResults can be merged, computing new MIN, MAX, and running MEAN and SD.

* Handle output from Benchmark_O again

Treat MAX_RSS as optional column
2017-04-26 12:09:18 -07:00
swift-ci
1be1f07263 Merge pull request #9031 from aschwaighofer/benchmark_objectivec_bridge_autoreleasepool 2017-04-26 10:53:06 -07:00
Arnold Schwaighofer
a8e3fc9af3 [benchmark] Lower the max memory size of ObejctiveC bridging tests by moving the
autoreleasepool down such that we have less allocations in the pool until it is
empty

rdar://31788785
SR-4666
2017-04-26 10:01:55 -07:00
Arnold Schwaighofer
4338e525bf Merge pull request #9027 from aschwaighofer/benchmark_dictionarybridge_autoreleasepool
[benchmark] Add autorelease pool to fix memory hogging
2017-04-26 09:56:25 -07:00
Arnold Schwaighofer
7ed2122947 [benchmark] Add autorelease pool to fix memory hogging
rdar://31788785
2017-04-26 07:37:07 -07:00
Michael Ilseman
111d6200eb Merge pull request #8979 from milseman/parse_my_tweets_faster
[stdlib] Parse my tweets faster! 2x forwards, 3x reverse
2017-04-26 07:36:18 -07:00
Ted Kremenek
758d5d465a Resolve merge conflict. 2017-04-25 16:21:56 -07:00
swift-ci
9b0fe1a47a Merge pull request #8975 from palimondo/SR-4598 2017-04-25 14:07:19 -07:00
Pavol Vaskovic
cecfe439c6 Display OPT choices in usage help
Fixed pyton-lint warnings
2017-04-25 03:50:40 +02:00
Pavol Vaskovic
5c29fa65b1 Renamed args.benchmarks - plural 2017-04-25 03:25:29 +02:00
swift-ci
a67c6d00f5 Merge pull request #8923 from moiseev/reverse-improvements 2017-04-24 17:06:07 -07:00
Michael Ilseman
517ac2a66f [benchmark] Add in some (default off) mixed-string micro benchmarks
Adds in a benchmark to see how quickly we can traverse mixed latin and
emoji strings. Default disabled and part of the stringTests suite.
2017-04-24 14:57:42 -07:00
Pavol Vaskovic
094094a04c Addressed python style issue raised during review 2017-04-24 23:53:40 +02:00
Pavol Vaskovic
3a5051e392 Fix SR-4598 Add option to run subset of benchmarks matching a prefix 2017-04-24 23:40:38 +02:00
Max Moiseev
9aa1e61851 Sorting performance by delta instead of ratio
...to avoid problems with rounding.
2017-04-24 14:34:38 -07:00
Maxim Moiseev
1c1b2b966d [stdlib] String : RangeReplaceableCollection & BidirectionalCollection (#8921)
* [stdlib] String : RangeReplaceableCollection & BidirectionalCollection

* Add source compatibility hack for Swift.max

* Add source compatibility hack for Swift.min

* Remove redundant conformance in benchmarks

* Fix stupid typo I thought I'd already pushed

* XFAIL testing now-redundant conformance

* XFAIL an IDE test for now
2017-04-23 20:04:54 -07:00
Andrew Trick
f5410be16b compare_perf_tests.py: fix column header formatting.
Column names must not contain spaces for tools that auto-format the table.
The extra "(%)" was completely redundant since every value in the column
reads as a percentage.
2017-04-22 10:16:17 -07:00
Ted Kremenek
3fb6e71411 Force the benchmark suite to build with -swift-version 3.
Some of the benchmarks use Swift 3 APIs.  Let’s keep them building that
way to not perturb benchmark numbers.

We should consider adding benchmarks that specifically enable -swift-version 4.
2017-04-21 17:25:45 -07:00
Max Moiseev
c4dc74b9b6 Fixing the crash in compare_perf_tests
Comparisons should only be performed on the intersection of test lists,
otherwise it would crash should the new benchmark be introduced.
2017-04-21 14:40:38 -07:00
Max Moiseev
d878b45e29 Reverse the order of improvements in the output of compare_perf_tests
Both regressions and improvements are sorted by the delta, which in case
of improvements produces the reversed order due to negative values of
delta.
This change makes the improvements ordered 'naturally':
most-improved-first.
2017-04-21 13:59:02 -07:00
Arnold Schwaighofer
a4c1bc9e5e Make python lint happy 2017-04-20 20:16:16 -07:00
Arnold Schwaighofer
c9aa05c3c6 [benchmark] Move existential tests out of precommit. They are not very stable. 2017-04-20 13:11:20 -07:00
Michael Ilseman
f6bf784ef1 [benchmark] Appease python lint 2017-04-19 15:55:16 -07:00
Michael Ilseman
edf8e6e5e6 [benchmark] Move work into the harness generator
Move the improvements to main.swift into the harness generator and
template itself. Run the generator.
2017-04-19 14:59:35 -07:00
Michael Ilseman
9ffc2f073a [benchmark] Add String test suite (off by default)
Starts a String perf test suite called stringTests which is
off-by-default, but allows us to place some lower-level targeted
benchmarking.
2017-04-19 13:31:34 -07:00
Michael Ilseman
c1ba0bcd6a [benchmark] Speed up compilation time of suite
This speeds up the compilation time of main.swift in the benchmark
suite from taking a minute or two to about a second. NFC.
2017-04-19 13:30:35 -07:00
practicalswift
a029589093 [gardening] Use consistent headers 2017-04-18 19:51:08 +02:00
Max Moiseev
9b53efd72c Merge branch 'master' into new-integer-protocols 2017-04-17 09:53:44 -07:00
swift-ci
bf08d01610 Merge pull request #8641 from palimondo/sequence-benchmarks 2017-04-14 00:35:02 -07:00
Pavol Vaskovic
857745fbf1 Added usage comment to test driver. Renamed validation-test/[benchmarks -> benchmark]. 2017-04-13 21:38:21 +02:00
Pavol Vaskovic
6a54bc22ff Fixed Python style issues reported by python-lint 2017-04-13 13:00:54 +02:00
Pavol Vaskovic
54cfe0a7c4 Nit: Fixed formatting of dashes in file header 2017-04-13 12:41:54 +02:00
practicalswift
77ab316d60 [gardening] Avoid blind exception 2017-04-12 15:13:11 +02:00
practicalswift
b704f1448b [gardening] Improve header consistency 2017-04-12 15:13:11 +02:00
Max Moiseev
fe4553eb80 Merge branch 'master' into new-integer-protocols 2017-04-11 17:07:11 -07:00
Pavol Vaskovic
1c9cc3815a Performance tests for Sequence methods: DropFirst, DropWhile, PrefixWhile 2017-04-12 01:15:02 +02:00
Michael Gottesman
92b70212bb [leaksrunner] Handle subprocesses segfaulting nicely rather than throwing an IndexError. 2017-04-10 16:33:26 -07:00
Pavol Vaskovic
739c3b70a8 Add same test variants for DropLast and Prefix as exist on Suffix 2017-04-11 01:22:43 +02:00