Rtx 3090

RTX 5080 and RTX 3090 reportedly achieve 80 Tok/s on Qwen 3.6 27B Q8, according to a Hacker News discussion.

Show HN claims Llama 3.1 70B can run on a single RTX 3090 using an NVMe-to-GPU path that bypasses the CPU.

A dense, data-driven diary of training a GPT-2 small base model from scratch on a single RTX 3090, detailing data prep, tokenization, sequence handling, speed tests, checkpoints, validation, and comparisons to OpenAI weights, with conclusions about feasibility and gaps to achieve a true Chinchilla-optimal train.