Skip DataReplaceLargeBuffer benchmark by default.

Large buffer replacement is too dependent on the system state
to produce a meaningful benchmark score. 30% variation is common.
This commit is contained in:
Andrew Trick
2022-11-01 18:01:16 -07:00
parent 60c8b4b178
commit f0110201ad

View File

@@ -178,8 +178,10 @@ public let benchmarks = [
replaceBuffer($0*100, data: medium, subrange:431..<809, with: medium) },
tags: d, legacyFactor: 100),
BenchmarkInfo(name: "DataReplaceLargeBuffer", runFunction: {
replaceBuffer($0*10, data: medium, subrange:431..<809, with: large) },
tags: d),
replaceBuffer($0*100, data: medium, subrange:431..<809, with: large) },
tags: d + [.skip]),
// Large buffer replacement is too dependent on the system state
// to produce a meaningful benchmark score. 30% variation is common.
BenchmarkInfo(name: "DataAppendSequence",
runFunction: { append($0*100, sequenceLength: 809, to: medium) },