LLM Learning

Fundamentals

• 📹 Intro to LLMs
• 📹 Language Modeling
• 📹 Tokenization
• 📹 BPE Tokenization
• 📹 Vectorizing Words (Word Embeddings)
• 📹 Intro to Large Language Models
• 📹 Developing an LLM: Building, Training, Finetuning
• 📹 How large language models work, a visual intro to transformers
• 🐱 Sampling methods and text generation

Hands-on Tutorials

• 🤗 Huggingface

Data extraction attack

• 📹 Video by carlini
• 📹 More detailed version of the same video
• 📑 Original data extraction paper

Advanced Topics

• 🐱 More advanced topics: LoRA, Quantization, etc.

Snippets

• Calculating perplexity