Alejandro Isaza a7bf219247 Improve BPETokenizer.readMerges performance (#169) ... From 240ms to 19ms on M1 MacBook Pro Co-authored-by: Alejandro Isaza <aisaza@apple.com>		2023-04-26 21:51:25 -07:00
..
BPETokenizer+Reading.swift	Improve BPETokenizer.readMerges performance (#169)	2023-04-26 21:51:25 -07:00
BPETokenizer.swift	Add Availability Annotations (#18)	2022-12-14 10:23:55 -08:00