Models News
AI models are trained neural network systems — like GPT, Claude and Gemini — that power modern artificial intelligence. This page tracks every model release, benchmark result and capability update as it happens.
2,782 articles · updated 24/7 from 100+ sources
Fine-Tune Wav2Vec2 for English ASR in Hugging Face with 🤗 Transformers
Fine-Tune Wav2Vec2 for English ASR in Hugging Face with 🤗 Transformers. Hugging Face - artificial…
Hugging Face Reads, Feb. 2021 - Long-range Transformers
Back to Articles Hugging Face Reads, Feb. 2021 - Long-range Transformers Published March 9, 2021 Update on…
Multimodal neurons in artificial neural networks
We’ve discovered neurons in CLIP that respond to the same concept whether presented literally,…
Simple considerations for simple people building fancy neural networks
Back to Articles 🚧 Simple considerations for simple people building fancy neural networks Published…
Retrieval Augmented Generation with Huggingface Transformers and Ray
Back to Articles Retrieval Augmented Generation with Huggingface Transformers and Ray Published February 10,…
Hugging Face on PyTorch / XLA TPUs
Back to Articles Hugging Face on PyTorch / XLA TPUs: Faster and cheaper training Published February 9, 2021…
Understanding the capabilities, limitations, and societal impact of large language models
Understanding the capabilities, limitations, and societal impact of large language models. OpenAI -…
Faster TensorFlow models in Hugging Face Transformers
Back to Articles Faster TensorFlow models in Hugging Face Transformers Published January 26, 2021 Update on…
Scaling Kubernetes to 7,500 nodes
We’ve scaled Kubernetes clusters to 7,500 nodes, producing a scalable infrastructure for large models…
Fit More and Train Faster With ZeRO via DeepSpeed and FairScale
Back to Articles Fit More and Train Faster With ZeRO via DeepSpeed and FairScale Published January 19, 2021…
How we sped up transformer inference 100x for 🤗 API customers
Back to Articles How we sped up transformer inference 100x for 🤗 API customers Published January 18, 2021…
DALL·E: Creating images from text
We’ve trained a neural network called DALL·E that creates images from text captions for a wide range of…
CLIP: Connecting text and images
We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural…
Organizational update from OpenAI
Organizational update from OpenAI. OpenAI - artificial intelligence news.
Leveraging Pre-trained Language Model Checkpoints for Encoder-Decoder Models
Leveraging Pre-trained Language Model Checkpoints for Encoder-Decoder Models. Hugging Face - artificial…
Porting fairseq wmt19 translation system to transformers
Porting fairseq wmt19 translation system to transformers. Hugging Face - artificial intelligence news.
Hyperparameter Search with Transformers and Ray Tune
Back to Articles Hyperparameter Search with Transformers and Ray Tune Published November 2, 2020 Update on…
OpenAI licenses GPT-3 technology to Microsoft
OpenAI licenses GPT-3 technology to Microsoft. OpenAI - artificial intelligence news.
Block Sparse Matrices for Smaller and Faster Language Models
Back to Articles Block Sparse Matrices for Smaller and Faster Language Models Published September 10, 2020…
Generative language modeling for automated theorem proving
Generative language modeling for automated theorem proving. OpenAI - artificial intelligence news.
Learning to summarize with human feedback
We’ve applied reinforcement learning from human feedback to train language models that are better at…
OpenAI Scholars 2020: Final projects
Our third class of OpenAI Scholars presented their final projects at virtual Demo Day, showcasing their…
The Reformer - Pushing the limits of language modeling
The Reformer - Pushing the limits of language modeling. Hugging Face - artificial intelligence news.
Procgen and MineRL Competitions
We’re excited to announce that OpenAI is co-organizing two NeurIPS 2020 competitions with AIcrowd, Carnegie…