Commit Graph

1662 Commits

Author SHA1 Message Date
Micah Benn
e69b71f4ec Update per style guildelines 2020-11-01 15:07:24 -06:00
Micah Benn
3d40513acb Fix formatting 2020-11-01 09:07:27 -06:00
Micah Benn
71784065cb Add IndexPath benchmarks
Add benchmarks for subscripts, max, min
2020-11-01 08:39:51 -06:00
zoecarver
01b12cfe6e [cxx-interop] Add support for benchmarks with C++ interop.
* Adds support for benchmarks that use C++ modules.
* Adds "CreateObjects" benchmark that creates C++ objects.
2020-10-06 19:33:22 -07:00
Andrew Trick
d43c1cc059 Merge pull request #34042 from atrick/verify-chacha
Add result checking to the ChaCha benchmark.
2020-09-24 00:01:45 -07:00
Mishal Shah
956b7a931c Merge pull request #34041 from apple/shahmishal/update-branch-doc
Update doc and links to support new main branch
2020-09-23 22:48:03 -07:00
Andrew Trick
eef1cf6688 Add result checking to the ChaCha benchmark.
This benchmark was being miscompiled for some time and
we did not catch it. I only noticed because a correcteness
fix caused a regression.
2020-09-23 21:12:02 -07:00
Xiaodi Wu
bb954f9b65 Merge pull request #33975 from xwu/benchmark-floating-point-conversion-exactly
[benchmark] Add another test to floating point conversion benchmark
2020-09-23 23:00:23 -04:00
Mishal Shah
40024718ac Update doc and links to support new main branch 2020-09-22 23:53:29 -07:00
Michael Gottesman
0591fa0d6b [leaks-checker] Add verbose flag to dump out raw output from runtime to help debug failures on bots.
Just a quick hack to ease debugging on the bots.
2020-09-21 09:59:32 -05:00
Xiaodi Wu
cb96bfbfdf [benchmark] Tweak naming and workload for two new tests 2020-09-16 21:38:19 -04:00
Xiaodi Wu
26f3c81e44 [benchmark] Add another floating point conversion benchmark 2020-09-16 19:32:13 -04:00
Xiaodi Wu
94887747a4 [benchmark] Add another test to floating point conversion benchmark 2020-09-16 19:05:09 -04:00
Xiaodi Wu
41d0e2937b [benchmark] Add benchmark for generic floating-point to integer conversion (#33895)
* [benchmark] Add a benchmark for generic floating-point to integer conversion

* [benchmark] Increase workload on new benchmark before merging
2020-09-15 17:15:24 -04:00
Xiaodi Wu
6a85fa7509 [benchmark] Delete two benchmarks and add generic floating-point conversion lit tests 2020-09-08 13:10:24 -04:00
Suyash Srijan
3692751690 [Benchmark] Fix build failure on armv7 by guarding Float80 availability 2020-09-07 01:23:00 +01:00
Xiaodi Wu
44a7038f9e [benchmark] Address review comments on FP conversion benchmarks 2020-09-05 11:27:54 -04:00
Xiaodi Wu
60b7c578c4 [benchmark] Add mock floating-point types for conversion benchmarks 2020-09-04 23:47:10 -04:00
Xiaodi Wu
514dce144f Update copyright year on benchmark and its template 2020-09-04 15:02:38 -04:00
Xiaodi Wu
65a547c4e6 [benchmark] Add new benchmark for floating-point conversion 2020-09-04 13:42:47 -04:00
Mike Ash
60e12f109d Add a benchmark for protocol conformance testing. 2020-08-14 15:32:51 -04:00
tbkka
ab861d5890 Pass architecture into Benchmark_Driver to fix build-script -B (#33100)
* Pass architecture into Benchmark_Driver to fix `build-script -B`

* "Benchmark_Driver compare" does not need the architecture
2020-07-25 11:15:49 -07:00
tbkka
2c8ae98e5e Python3 compatibility for Benchmarks (#33039)
Three issues addressed here:

1. Dependency on dictionary iteration order

 CharacterProperties.swift.gyb iterated a dictionary to produce its output.
 Changed this to a list of tuples to ensure the order is predictable.

2. Python3 `map` returns an iterator, not a list

 Changed a bunch of `map` calls to `list(map(...))` to ensure the result is a list

3. Python3 `int()` expects a string, won't accept a list of characters

 Added a concatenation step that is effectively a no-op on Python2
2020-07-22 12:24:10 -07:00
Michael Gottesman
d7bd5aee2a Merge pull request #32976 from gottesmm/pr-5545885200c7c4f352e37991d9a5a10065d828da
[opt-remark] Always emit opt-remarks for the stdlib and benchmarks
2020-07-18 23:24:25 -07:00
Michael Gottesman
0ce7f29c72 [opt-remark] Add support for emitting opt-remark bitstream artifacts when building benchmarks with cmake.
I didn't do this for swiftpm as well since when I tried passing this via
unsafeFlags to swiftpm, swiftpm just created the opt-remarks in my source
directory instead of next to the .o in the build directory. A problem for
another time.
2020-07-18 20:19:27 -07:00
tbkka
3181dd1e4c Fix a bunch of python lint errors (#32951)
* Fix a bunch of python lint errors

* adjust indentation
2020-07-17 14:30:21 -07:00
Erik Eckstein
2387732ab5 benchmarks: support new executable file names in perf_test_driver
rdar://problem/65508278
2020-07-16 15:43:37 +02:00
tbkka
9bc5be372c Rework a couple of benchmarks to work with both Python2 and Python3 (#32905) 2020-07-15 15:16:14 -07:00
Erik Eckstein
a46cda8c51 benchmarks: fix run_smoke_bench to support new benchmark executable naming scheme
Find the right benchmark executable with a glob pattern.
Also, add an option "-arch" to select between executables for different architectures.
2020-07-07 11:01:49 +02:00
Mishal Shah
c89451138b [Apple Silicon] Add arm64 macOS support to benchmark suite 2020-07-02 16:24:17 -07:00
Robert Widmann
cddf73ecdb [Gardening] Clean Up OS-Test Patterns Across The Codebase
Clean up a few general patterns that are now obviated by canImport

This aligns more generally with the cleanup that the Swift Package
Manager has already done in their automated XCTest-plumbing tool in
apple/swift-package-manager#1826.
2020-06-30 22:55:58 -07:00
Nate Cook
e49a5b7655 Switch to benchmark remove* instead of drop* 2020-06-25 14:35:56 -05:00
Nate Cook
9855496a16 Add benchmarks for Substring.dropFirst(_:) and dropLast(_:) (#32473)
* Add benchmarks for Substring.dropFirst(_:) and dropLast(_:)

These are self-slicing operations, so they should be fast even for
this non-random-access collection.

* Fiddle with the iteration count and length
2020-06-25 10:53:14 -05:00
Doug Gregor
ade21a33fd Fix build of benchmark suite and Linux test 2020-06-23 13:00:26 -07:00
Mishal Shah
272c466e47 Update master to build with Xcode 12 beta 2020-06-22 15:43:20 -07:00
Ben Cohen
baa3a7dc10 [benchmarks] Add a benchmark for printing using mirrors (#32150)
* Add a benchmark for mirrors and typename->string conversion
2020-06-03 12:06:39 -07:00
Andrew Trick
c001de0359 Broaden the set of benchmarks tagged under .cpubench
These have all shown to be interesting, relevant, stable, and
optimized well enough by the compiler to be useful for cpu performance
tracking.
2020-05-18 23:43:07 -07:00
Meghana Gupta
911ac8e45e Fix code size reporting when input directory is missing a trailing '/'
run_smoke_bench script fails to report code size changes if you have a
trailing '/' in <old_build_dir> but not <new_build_dir>.

This change appends a separator if it is missing
2020-05-14 13:49:35 -07:00
Andrew Trick
9574be167f Merge pull request #31641 from atrick/add-bench-tag
Add .cpubench tag to ProtocolDispatch2
2020-05-08 10:38:35 -07:00
David Zarzycki
5dcc32f98f Remove all uses of -force-single-frontend-invocation
The `-force-single-frontend-invocation` flag predates WMO and is now an
alias for `-whole-module-optimization`. We should use the latter and let
the former fade into history.
2020-05-08 06:37:41 -04:00
Andrew Trick
eb1ac0bfd9 Add .cpubench tag to ProtocolDispatch2 2020-05-07 15:01:04 -07:00
Andrew Trick
80cd7ed40e Add a comment to the benchmark readme. 2020-05-04 09:48:26 -07:00
Patrick Pijnappel
ca9185deeb [benchmark] Revert removal of InsertCharacter & IntegerParsing 2020-04-26 19:26:40 +10:00
Pavol Vaskovic
c7524d3d9a Merge pull request #24677 from palimondo/janitor’s-last-stand
[benchmark] Janitor Duty: Final Sweep
2020-04-15 19:44:02 +02:00
Robert Widmann
80cc726ad4 Merge pull request #19954 from Lukasa/cb-bench-h2-enumeration
[benchmark] Add HTTP2StateMachine benchmark
2020-04-14 20:03:56 -07:00
Karoy Lorentey
c1bf5c9224 [benchmark] Fix thinko 2020-04-13 19:46:44 -07:00
Karoy Lorentey
59fe523c8c Merge remote-tracking branch 'origin/master' into fortify-benchmarks 2020-04-13 19:34:44 -07:00
brett koonce
7f0f6bbec2 rm minor warning 2020-04-09 10:08:10 -07:00
eeckstein
ecf1e4e370 Merge pull request #30822 from PatrickPijnappel/premultiply-case-conversion-benchmark
[benchmark] Premultiply N for case conversion benchmark
2020-04-08 08:26:55 +02:00
Patrick Pijnappel
6196a8a045 [benchmark] Rename premultiplied tests 2020-04-07 19:04:45 +10:00