D German a7262e5417 renamed filed, fixed spelling mistake

2017-07-22 12:02:03 -04:00

..

goTokenizer

i removed the binary, and updated the header output to include version and language

2017-07-21 21:05:54 -04:00

jsonYamlTokenizer

moved files, i feel I do not want all these ones

2017-07-21 21:11:16 -04:00

srcMLtoken

added cregit version to the tokenized output

2017-04-12 02:55:51 -07:00

text

added simple tokenizer

2017-07-12 05:14:36 -07:00

tokenizeDispatcher.pl

renamed filed, fixed spelling mistake

2017-07-22 12:02:03 -04:00