Tags
Products tagged: "llm"
Extensive Tokenizer Library
Making a 300k tokenizer
Ultra Low Power Encoder
How to build an ultra low power encoder for LLMs
LoRAdor: LoRA from Scratch
Implementing Low-Rank Adaptation in pure PyTorch
VocabVacation: Does Vocab Size Matter?
Training tiny transformers with different vocab sizes to find the sweet spot
Dope: Comparing Position Encodings
Four position encodings on longer sequences
FlashDance: Flash Attention vs Vanilla Attention
How much faster fused attention really is