Pavol Vaskovic 0d318b6464 [benchmark] Discard oversampled quantile values ...

When num_samples is less than quantile + 1, some of the measurements are repeated in the report summary. Parsed samples should strive to be a true reflection of the measured distribution, so we’ll correct this by discarding the repetated artifacts from quantile estimation.

This avoids introducting a bias from this oversampling into the empirical distribution obtained from merging independent samples.

See also:
https://en.wikipedia.org/wiki/Oversampling_and_undersampling_in_data_analysis

2018-10-11 18:56:27 +02:00

40 KiB

Raw Blame History

View Raw