Michael Ilseman bd5189c25a [String] Grapheme fast paths for punctuation: 5-8x speedup. ...

Many strings use non-sub-300 punctuation characters (e.g. unicode
hyphen, CJK quotes, etc). This can cause switching between fast and
slow paths for grapheme breaking. Add in fast-paths for general
punctuation characters and CJK punctuation and symbol characters.

This results in about a 5-8x speedup for heavily (unicode) punctuated
Latiny and CJKy workloads.

2017-06-27 19:18:51 -07:00

4.8 KiB

Raw Blame History

View Raw