Search AI News
Find articles from 100+ AI sources
Found 168 results for "PyTorch"
Building Blocks for Foundation Model Training and Inference on AWS
Back to Articles Building Blocks for Foundation Model Training and Inference on AWS Enterprise Article…
Training mRNA Language Models Across 25 Species for $165
Back to Articles Training mRNA Language Models Across 25 Species for $165 Team Article Published March 31,…
Beyond Standard LLMs
From DeepSeek R1 to MiniMax-M2, the largest and most capable open-weight LLMs today remain autoregressive…
Understanding the 4 Main Approaches to LLM Evaluation (From Scratch)
How do we actually evaluate LLMs?It’s a simple question, but one that tends to open up a much bigger…
REINFORCE: Easy Online RL for LLMs
Reinforcement learning (RL) is playing an increasingly important role in research on large language models…
xAI’s Colossus 2 – First Gigawatt Datacenter In The World, Unique RL Methodology, Capital Raise
Much has been written about xAI’s Colossus 1. The Memphis build belongs in the history books: the largest…
Torch compile caching for inference speed
Replicate Blog Torch compile caching for inference speed Posted September 8, 2025 by nevillelyh gandalfhz We…
Understanding and Implementing Qwen3 From Scratch
Previously, I compared the most notable open-weight architectures of 2025 in The Big LLM Architecture…
H100 vs GB200 NVL72 Training Benchmarks – Power, TCO, and Reliability Analysis, Software Improvement Over Time
Frontier model training has pushed GPUs and AI systems to their absolute limits, making cost, efficiency,…
From GPT-2 to gpt-oss: Analyzing the Architectural Advances
OpenAI just released their new open-weight LLMs this week: gpt-oss-120b and gpt-oss-20b, their first…
Direct Preference Optimization (DPO)
(from [1, 2, 6, 9])Aligning large language models (LLMs) is a crucial post-training step that ensures models…
Last Week to Register to the Build Production-Ready LLMs From Scratch Course!
This Saturday, we kick off the latest cohort of the Build Production-Ready LLMs From Scratch course! This is…
Efficient MultiModal Data Pipeline
Back to Articles Efficient MultiModal Data Pipeline Published July 8, 2025 Update on GitHub Upvote 73 +67…
Understanding and Coding the KV Cache in LLMs from Scratch
KV caches are one of the most critical techniques for efficient inference in LLMs in production. KV caches…
Build Production-Ready LLMs From Scratch Starting on July 12th!
Get ready! The latest iteration of the Build Production-Ready LLMs From Scratch live course is starting on…
KV Cache from scratch in nanoVLM
Back to Articles KV Cache from scratch in nanoVLM Published June 4, 2025 Update on GitHub Upvote 120 +114…
Last Week to Register to the Build Production-Ready LLMs From Scratch Course!
This Saturday, we kick off the Build Production-Ready LLMs From Scratch course! This is the last week to…
Coding LLMs from the Ground Up: A Complete Course
I wrote a lot about reasoning models in recent months (4 articles in a row)! Next to everything "agentic,"…
Build Production-Ready LLMs From Scratch
Big news! I am now partnering with Maven as an instructor to teach the Build Production-Ready LLMs From…
4M Models Scanned: Protect AI + Hugging Face 6 Months In
Back to Articles 4M Models Scanned: Protect AI + Hugging Face 6 Months In Published April 14, 2025 Update on…
Vision Large Language Models (vLLMs)
After the popularization of text-based large language models (LLMs), one of the most important questions…
Reduce AI Model Operational Costs With Quantization Techniques
Model quantization is becoming a core strategy for training and deployment! I am excited to introduce you to…
How To Construct Self-Attention Mechanisms For Arbitrary Long Sequences
With Gemini models having a 2M tokens context size and Claude having a 200K tokens context size while having…
How To Reduce The Memory Usage Of The Self-Attention
With a bit of magic, we take a very inefficient computation like the Self-Attention and make it super…