Commit Graph

22 Commits

Author SHA1 Message Date
Dave Abrahams
18c75e0939 [pre-commit-benchmark] use new build directory
Also, dump commands as they are executed.

Also, accept additional parameters that are forwarded to build-script,
which allows me to run it with distcc, for example.

Swift SVN r24609
2015-01-21 21:32:08 +00:00
Maxwell Swadling
06c6bdf081 fixed benchmark script to work with new cmake
Swift SVN r24246
2015-01-07 22:09:21 +00:00
Dmitri Hrybenko
6670bb76ec Rewrite the CMake build system
Swift SVN r24124
2014-12-23 22:15:30 +00:00
Dave Abrahams
85782e4c3e [pre-commit-benchmark] Report speed ratios
Percentages were too hard for me to understand.

Swift SVN r23451
2014-11-19 22:57:43 +00:00
Dave Abrahams
edb9a6cf44 [pre-commit-benchmark] force needed CMake variable
Swift SVN r23002
2014-10-29 04:54:57 +00:00
Mikhail Zolotukhin
c0d301b225 Fix a typo in define name.
Swift SVN r21307
2014-08-20 15:48:28 +00:00
Mikhail Zolotukhin
75d6a75d0a Rename PrecommitBench to PerfTestSuite.
<rdar://problem/18006684>

Swift SVN r21306
2014-08-20 15:00:53 +00:00
Dave Abrahams
4a34eeb4db Fix pre-commit-benchmark
To test -O, you need to pass -O3 for now.  I haven't figured out how to
get Python argparse to allow an empty choice for the -O option.

Swift SVN r20486
2014-07-24 13:17:31 +00:00
Jordan Rose
b6818046a8 Eliminate optimization levels 0-3 in favor of -Onone/-O/-Ofast.
We were already effectively doing this everywhere /except/ when building
the standard library (which used -O2), so just use the model we want going
forward.

Swift SVN r20455
2014-07-24 01:12:59 +00:00
Dave Abrahams
94d317cbda [pre-commit-benchmark] fix -O handling
We were dropping all but the last specified optimization level

Swift SVN r20192
2014-07-18 23:55:02 +00:00
Dave Abrahams
4f7fa53008 [pre-commit-benchmark] Tabulate output
Make the raw output readable by formatting it into columns

Swift SVN r20180
2014-07-18 20:54:26 +00:00
Dave Abrahams
403a7e0bd3 [pre-commit-benchmark] Fix parsing bugs
Whoever updated the format of the timing files broke this script.
Here's my fix.

Swift SVN r20179
2014-07-18 20:54:25 +00:00
Dave Abrahams
cae6d2e158 [pre-commit-benchmark] Look in the right directory
Swift SVN r20178
2014-07-18 20:54:25 +00:00
Dave Abrahams
2b650714db [pre-commit-benchmark] debuggable subprocess calls
Swift SVN r20177
2014-07-18 20:54:24 +00:00
Andrew Trick
9487fe4810 Update regex for pre-commit-bench.
I'm in the process of testing this, but wanted to get it in now
since others are updating the script and maybe trying to use it!

Swift SVN r20169
2014-07-18 18:39:48 +00:00
Dave Abrahams
72acc077f7 [pre-commit-benchmark] clone benchmark repo...
...if it's not already there.

Swift SVN r20161
2014-07-18 18:02:37 +00:00
Michael Gottesman
94e3adc666 Update utils/pre-commit-benchmark for new benchmark repo.
Swift SVN r20158
2014-07-18 16:55:42 +00:00
Andrew Trick
ff1357d681 Update regex in the pre-commit-benchmark script.
Swift SVN r19792
2014-07-10 06:44:52 +00:00
Dave Abrahams
7e5e1b8110 [pre-commit-benchmark] Default to one run at -O3
Also add a -O option that allows one to specify desired optimization
levels.  This will make it much easier to get a lightweight answer to
"did I speed things up?" while still allowing

  pre-commit-benchmark -r3 -O3 -Ofast -O0

to do a more thorough test.

Swift SVN r19741
2014-07-09 20:38:57 +00:00
Dave Abrahams
8587dd6aed [pre-commit-benchmark] Bugfix
When the scores files have different numbers of iterations, use the
smaller of the two, not the larger.

Swift SVN r19740
2014-07-09 20:38:56 +00:00
Andrew Trick
39fe347e67 Update pre-commit-benchmark script for output changes.
Swift SVN r19703
2014-07-08 21:43:18 +00:00
Dave Abrahams
e67975d5cb [utils] add pre-commit-benchmark script
This script runs the benchmarks in benchmark/PrecommitBench/ against
your working tree and compares the result with the results of running
the benchmark against origin/master, or any commit you specify on the
command line.  Its output is roughly in CSV format.  It keeps a cache of
benchmark results, tagged with the working tree state, so chances are
good that it won't have to change your working copy state.  However, if
results for the specified commit are not in the cache, the script will
temporarily switch your working copy to that commit in order to build.

Timing parsing, comparison, and printing code by Andy Trick.  Thanks,
Andy!

Swift SVN r19646
2014-07-07 22:54:03 +00:00