nano-ai

learning & rebuilding essential ai services

ToDo

• Understand Fundamentals.
• nanoPapers
  • BERT
  • llama
  • Attention is all you need
  • Deepseek v2
• nanoGPT
• nanoClaw
• nanoRL
• nanoAgent
• babyAGI

Learning Material that helped me

Machine Learning and Neural Networks Fundamentals

• Machine Learning Fundamentals (DeepLearning.ai)
• Neural Networks by 3Blue1Brown
• Give me 100 min, I will make Transformer click forever
• Give Me 40 min, I'll Make Neural Network Click Forever
• Give me 20 min, I will make Attention click forever

PyTorch

• PyTorch Fundamentals (DeepLearning.ai)
• Build Your First Pytorch Model In Minutes! [Tutorial + Code] (Rob Mulla)
• PyTorch in 1 hour (Zachary Huang)

Other

• LLM Pre-Training in 30 MIN
• Give Me 30 min, I'll Make CUDA Click Forever
• SFT in 30 min
• RLHF in 90 min
• KV Cache in 15 min

Learning Approach

• Watch the relevant videos. Digest it with Paper
• Dump them into NotebookLM, do quizzing + visual learning to iterate learning
• Self quiz later.