Andrew Trick
c7b4e7c8b4
Add scale-test --save-temps option.
...
I'm not sure how anyone debugs these tests otherwise.
2019-05-13 16:54:55 -07:00
Pavol Vaskovic
c1388abd1b
[Gardening] Fix I201
...
I201 Missing newline before sections or imports.
2018-11-28 17:13:04 +01:00
Xi Ge
53121aff84
scale-test: teach the test driver to test parse only.
2018-09-12 14:15:28 -07:00
David Ungar
28b206008f
FrontendInputs data structure redo.
...
- Outlaw duplicate input files, fix driver, fix tests, and add test.
- Reflect that no buffer is present without a (possibly pseudo) named file.
- Reflect fact that every input has a (possible pseudo) name.
- Break up CompilerInstance::setup.
Don't bail on dups.
2017-12-05 17:28:03 -08:00
Graydon Hoare
2c281c7a20
[scale-test] Use -stats-output-dir when available.
2017-09-12 22:36:12 -07:00
Graydon Hoare
c774d7f21d
[scale-test] Revive direct linear fit as first-pass, tighten thresholds.
2017-09-12 22:36:11 -07:00
Mark Lacey
d302f8caca
Add --invert-result option to scale-test.
...
This makes it possible to distinguish between failed data fitting and
things that fail for other reasons (e.g. the test doesn't compile
properly).
2017-08-30 19:41:52 -07:00
swift-ci
f2a1ffeb64
Merge pull request #11700 from moiseev/scale-test-error
2017-08-30 18:44:27 -07:00
Max Moiseev
f2f352b1cc
[scale-test] Reporting an error if --step is wider than the begin/end range
2017-08-30 17:35:48 -07:00
Graydon Hoare
6053946eaf
[scale-test] Special-case constants; don't bother fitting anything.
2017-08-27 01:54:38 -07:00
Graydon Hoare
910c8540b7
[scale-test] Handle ill-fitting scenarios a bit more robustly.
2017-08-26 20:33:36 -07:00
Graydon Hoare
8be9394ded
[scale-test] Fix review comments.
2017-08-24 23:09:05 -07:00
Graydon Hoare
b082e05440
[scale-test] Numerical nonlinear regression, avoids linear(log()) mis-fitting.
2017-08-23 22:32:41 -07:00
Huon Wilson
7f149360b8
[scale-test] Allow compiler invocations that don't succeed.
...
This allows invocations that fail with a specific exit code, e.g. 0 is the old
behaviour, for success, but also, for instance, 1 for measuring examples that
fail to typecheck.
2017-08-11 15:39:28 -07:00
Huon Wilson
3f712ad87c
[scale-test] Diagnose exponential growth explicitly.
...
This, somewhat questionably, fits the polynomial model and the
exponential model, and then chooses the one with the best R^2. However,
no matter how statistically valid this is, it works reasonably in
practice.
Slow growing things sometimes get classified as 1.0^n or 1.1^n, but
these are either spurious or not relevant, and so a similar thresholding
to the polynomial fit is used.
2017-04-10 13:22:16 -07:00
Hugh Bellamy
ad4b338062
Fix python lint failures now not excluded as we provide custom exclusions
...
Looks like flake8 enables other rules when you add something to the
exclusion list. We added W291
2017-03-27 12:31:56 +07:00
Hugh Bellamy
a5e7514197
Prefer the print function to the print statment in python code
2017-02-20 11:12:21 +07:00
Hugh Bellamy
4f23d61da0
Import print_function wherever we use print() in python code
2017-02-20 11:11:27 +07:00
Hugh Bellamy
a977b8cc5f
Python lint scale-test
2017-02-09 18:15:06 +07:00
Slava Pestov
b9570eebfe
scale-test: Fix a typo
2017-01-08 18:12:47 -08:00
David Farler
b7d17b25ba
Rename -parse flag to -typecheck
...
A parse-only option is needed for parse performance tracking and the
current option also includes semantic analysis.
2016-11-28 10:50:55 -08:00
Graydon Hoare
2a89323077
[Compile perf] flake8 fixes for scale-test.
2016-11-07 15:57:51 -08:00
Graydon Hoare
3d8f8e050c
[Compile perf] Use lit tmpdir in scale-test, rdar://29090287
2016-11-07 15:57:33 -08:00
Graydon Hoare
ac7d397aee
[Compile perf] Add various convenience options to scale-test
2016-11-03 11:23:27 -07:00
Graydon Hoare
c6d38f5ac1
[Compile perf] Treat missing data as an error in scale-test.
2016-11-02 14:05:02 -07:00
Graydon Hoare
b9db5cf6b2
[Compile perf] Replace numpy with helper function in scale-test
2016-11-02 14:05:01 -07:00
Graydon Hoare
587df1e04d
[Compile perf] Add --debug to scale-test, to run tests under lldb
2016-11-02 09:40:59 -07:00
Graydon Hoare
d9fda6e0cb
[Compile perf] Add a multi-primary cumulative mode to utils/scale-test
2016-11-02 09:40:59 -07:00
Graydon Hoare
9fa3f49828
[scale-test] Add --dtrace and --select support
2016-10-13 11:45:50 -07:00
Graydon Hoare
0b3e451940
Add utils/scale-test
2016-10-11 12:04:33 -07:00
