Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
e=mc²: Build an LLM From Scratch, One Lesson a Day Series' Articles
Back to AI Explore's Series
Build an LLM From Scratch in 5 Minutes on a Free GPU: I Trained a 5.9-Million-Parameter Storyteller, and Here Is What It Wrote
AI Explore
AI Explore
AI Explore
Follow
Nov 15
Build an LLM From Scratch in 5 Minutes on a Free GPU: I Trained a 5.9-Million-Parameter Storyteller, and Here Is What It Wrote
#
ai
#
machinelearning
#
python
#
beginners
Comments
Add Comment
5 min read
Moderation
How Attention Works: I Read All 24 Heads of a Tiny Language Model and Found the One That Watches the Main Character's Name
AI Explore
AI Explore
AI Explore
Follow
Nov 16
How Attention Works: I Read All 24 Heads of a Tiny Language Model and Found the One That Watches the Main Character's Name
#
ai
#
machinelearning
#
llm
#
beginners
Comments
1
comment
6 min read
Moderation
Why Small LLMs Memorize: I Trained the Same Model at Four Sizes and Watched It Start Reciting
AI Explore
AI Explore
AI Explore
Follow
Nov 17
Why Small LLMs Memorize: I Trained the Same Model at Four Sizes and Watched It Start Reciting
#
ai
#
machinelearning
#
llm
#
beginners
Comments
Add Comment
6 min read
Moderation
Catastrophic Forgetting, Measured: I Fine-Tuned a Small LLM on One New Character and Its Old Stories Went From Perplexity 9 to 156
AI Explore
AI Explore
AI Explore
Follow
Nov 18
Catastrophic Forgetting, Measured: I Fine-Tuned a Small LLM on One New Character and Its Old Stories Went From Perplexity 9 to 156
#
ai
#
machinelearning
#
llm
#
beginners
Comments
Add Comment
5 min read
Moderation
Instruction Tuning From Scratch: Two Special Tokens and One Masked Loss Turn a Story Generator Into a Prompt Follower
AI Explore
AI Explore
AI Explore
Follow
Nov 19
Instruction Tuning From Scratch: Two Special Tokens and One Masked Loss Turn a Story Generator Into a Prompt Follower
#
ai
#
machinelearning
#
python
#
beginners
Comments
Add Comment
5 min read
Moderation
LoRA Explained in Plain Words: I Fine-Tuned a Small LLM by Training 2% of Its Weights, and Here Is What It Cost
AI Explore
AI Explore
AI Explore
Follow
Nov 20
LoRA Explained in Plain Words: I Fine-Tuned a Small LLM by Training 2% of Its Weights, and Here Is What It Cost
#
ai
#
machinelearning
#
llm
#
beginners
Comments
Add Comment
6 min read
Moderation
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account