4 Commits

Include renames

Author	SHA1	Message	Date
patrick	4c0583c91f	Refactored tokenizer to lazily evaluate file locations.	2017-06-19 00:18:02 +02:00
patrick	268fa84c9e	Reimplemented tokenizer with plain streams.	2017-06-19 00:18:02 +02:00
patrick	230844c3ae	Fixed whitespace issue in typing sections and added test cases.	2017-06-19 00:18:02 +02:00
patrick	e312a91632	Renamed tokenizing module for clarity.	2017-05-12 14:17:57 +02:00