Home›Cs336

Cs336

  • BPE tokenizer
  • Linear and Embedding modules
  • RMSNorm and SwiGLU
  • RoPE softmax and attention
By Mark Hudson
  • GitHub
  • Hugging Face
  • LinkedIn
  • Substack
  • X