DEV Community

#gpu

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
High-Throughput LLM Inference & Training: A Deep Dive into vLLM
gfactor profile

High-Throughput LLM Inference & Training: A Deep Dive into vLLM

#ai #machinelearning #python #gpu
Comments
9 min read
Same nvJPEG2000, different numbers: timer boundaries and frames in flight
fastvideo profile

Same nvJPEG2000, different numbers: timer boundaries and frames in flight

#cuda #gpu #performance #cpp
Comments
13 min read
Exploring Result Visibility of Fixed-Latency Instructions on the SM120 Architecture
comradepenguin1917 profile

Exploring Result Visibility of Fixed-Latency Instructions on the SM120 Architecture

#cuda #nvidia #gpu
1
Comments
10 min read
DeepSpeed ZeRO vs PyTorch FSDP2, Measured: 1.8x on NVLink, Barely Finishing on PCIe (Plus How to Actually Get GPUs on GKE)
tsho profile

DeepSpeed ZeRO vs PyTorch FSDP2, Measured: 1.8x on NVLink, Barely Finishing on PCIe (Plus How to Actually Get GPUs on GKE)

#machinelearning #pytorch #deepspeed #gpu
Comments
10 min read
Half of my FP8 convolutions were silently running in f32 – a one-line XLA fix
retretor profile

Half of my FP8 convolutions were silently running in f32 – a one-line XLA fix

#machinelearning #performance #compilers #gpu
2
Comments 1
6 min read
What Happens When You Ask an LLM a Question
vishnuhd profile

What Happens When You Ask an LLM a Question

#ai #localllm #llmbasics #gpu
Comments
8 min read
CUDA Cores vs Tensor Cores Explained
sumukh_dev profile

CUDA Cores vs Tensor Cores Explained

#gpu #machinelearning #deeplearning #beginners
Comments 1
2 min read
Inside SFPU Overflow Bugs: How a 40-Year-Old Rounding Trick Breaks on Modern AI Accelerators
truongsontung profile

Inside SFPU Overflow Bugs: How a 40-Year-Old Rounding Trick Breaks on Modern AI Accelerators

#ai #machinelearning #gpu #debugging
Comments
3 min read
I Put a Paid AI Video Generator on My Own Gaming GPU — No Cloud Bill
ernioiu8 profile

I Put a Paid AI Video Generator on My Own Gaming GPU — No Cloud Bill

#ai #gpu #selfhosting #machinelearning
Comments 1
3 min read
Reverse-Engineering NVIDIA: Modifying a CUDA binary
stjepan86 profile

Reverse-Engineering NVIDIA: Modifying a CUDA binary

#nvidia #gpu #cuda #hex
Comments
4 min read
From API to GPU, Week 6 (Part 2): Watching a Neural Network Learn
dramasamy profile

From API to GPU, Week 6 (Part 2): Watching a Neural Network Learn

#ai #llm #gpu #machinelearning
Comments
17 min read
From API to GPU, Week 6 (Part 1): A Model That Predicts, and How Wrong It Is
dramasamy profile

From API to GPU, Week 6 (Part 1): A Model That Predicts, and How Wrong It Is

#ai #llm #gpu #machinelearning
Comments
13 min read
Scale Before the Spike: Predictive Autoscaling for GPU Workloads on Kubernetes
ramkumar_nagaraj_38541938 profile

Scale Before the Spike: Predictive Autoscaling for GPU Workloads on Kubernetes

#kubernetes #autoscaling #gpu #devops
Comments
6 min read
DGX Spark (GB10) memory sizing for LLM serving: the numbers
conatusai profile
Jahn

DGX Spark (GB10) memory sizing for LLM serving: the numbers

#nvidia #llm #inference #gpu
Comments
7 min read
How Many AI Avatars Can One GPU Handle? Real-World Test Reveals 4 Avatars at ÂĄ7,600 Each per Month
orca_forge profile

How Many AI Avatars Can One GPU Handle? Real-World Test Reveals 4 Avatars at ÂĄ7,600 Each per Month

#gpu #sre #docker
Comments
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.