Articles
VocabVacation: Does Vocab Size Matter?
Training tiny transformers with different vocab sizes to find the sweet spot
LoRAdor: LoRA from Scratch
Implementing Low-Rank Adaptation in pure PyTorch
TokTok: A Spanish Tokenizer
Ultra Low Power Encoder
Extensive Tokenizer Library
Making a 300k tokenizer