DEV Community

#gpu

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Sizing a looped LLM: SenseNova-Loop-9B stores 32 layers, runs 56, and fits a 20 GB card

Sizing a looped LLM: SenseNova-Loop-9B stores 32 layers, runs 56, and fits a 20 GB card

Comments
4 min read
How Much VRAM Does Your LLM Need? The Math Behind the EverXCloud Calculator

How Much VRAM Does Your LLM Need? The Math Behind the EverXCloud Calculator

Comments
4 min read
How I Run a 27B Local Agent on a 12GB Laptop GPU: KVMem, Tiered KV, and Honest Long-Context Limits

How I Run a 27B Local Agent on a 12GB Laptop GPU: KVMem, Tiered KV, and Honest Long-Context Limits

Comments
6 min read
FSDP vs DDP: when do you need sharded data parallel?

FSDP vs DDP: when do you need sharded data parallel?

Comments
9 min read
DeepSeek V4.1 Flash at 42 tok/s with 256K Context on RTX 5070 Ti x2 + 5060 Ti — Full Benchmark Record

DeepSeek V4.1 Flash at 42 tok/s with 256K Context on RTX 5070 Ti x2 + 5060 Ti — Full Benchmark Record

Comments
10 min read
LLM API vs. Dedicated Cloud GPU Break-Even Math in 2026 (Live Data)

LLM API vs. Dedicated Cloud GPU Break-Even Math in 2026 (Live Data)

Comments
3 min read
NVFP4 Won't Save Your VRAM: Quantization Tradeoffs on a 12GB Laptop GPU

NVFP4 Won't Save Your VRAM: Quantization Tradeoffs on a 12GB Laptop GPU

Comments
3 min read
How do you estimate GPU hours and cost for a training run?

How do you estimate GPU hours and cost for a training run?

Comments
8 min read
How much GPU memory does an LLM need? The whole sum, worked out on real cards

How much GPU memory does an LLM need? The whole sum, worked out on real cards

Comments
9 min read
کارت گرافیک دست دوم در ۲۰۲۶: چک لیست کامل قبل از خرید

کارت گرافیک دست دوم در ۲۰۲۶: چک لیست کامل قبل از خرید

Comments
1 min read
Скачал полтерабайта локальных LLM — но без GPU жизни нет

Скачал полтерабайта локальных LLM — но без GPU жизни нет

Comments
12 min read
When does reserved GPU capacity beat on-demand pricing?

When does reserved GPU capacity beat on-demand pricing?

Comments
9 min read
How many tokens per second should an LLM serve on one GPU?

How many tokens per second should an LLM serve on one GPU?

Comments
8 min read
What are the best Shadeform alternatives for buying GPU time?

What are the best Shadeform alternatives for buying GPU time?

Comments
9 min read
Why can a multi-GPU job wait while GPUs are idle?

Why can a multi-GPU job wait while GPUs are idle?

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.