Commit Graph

3 Commits

Author SHA1 Message Date
Anton Lydike
84562de98f added tests for tokenizer 2021-12-14 07:33:17 +01:00
Anton Lydike
d5a4acef67 tokenizer reimplemented 2021-12-13 23:23:55 +01:00
Anton Lydike
8cf381ec61 added basic tests 2021-04-18 00:57:53 +02:00