Blog Posts

Feb 18, 2024

HELM Instruct: A Multidimensional Instruction Following Evaluation Framework with Absolute Ratings

Yian Zhang and Yifan Mai and Josselin Somerville Roberts and Rishi Bommasani and Yann Dubois and Percy Liang
Feb 08, 2024

Plans for v1.1 of the Foundation Model Transparency Index: Self-Assessment

Foundation Model Transparency Index
Dec 19, 2023

HELM Lite: Lightweight and Broad Capabilities Evaluation

Percy Liang and Yifan Mai and Josselin Somerville and Farzaan Kaiyom and Tony Lee and Rishi Bommasani
Dec 01, 2023

Towards compromise: A concrete two-tier proposal for foundation models in the EU AI Act

Rishi Bommasani and Tatsunori Hashimoto and Daniel E. Ho and Marietje Schaake and Percy Liang
Nov 18, 2023

Drawing Lines: Tiers for Foundation Models

Rishi Bommasani
Oct 12, 2023

Flash-Decoding for long-context inference

Tri Dao and Daniel Haziza and Francisco Massa and Grigory Sizov
Jul 30, 2023

Robust Distortion-free Watermarks for Language Models

Rohith Kuditipudi and John Thickstun and Tatsunori Hashimoto and Percy Liang
Jun 29, 2023

HyenaDNA: learning from DNA with 1 Million token context

Eric Nguyen* and Michael Poli* and Marjan Faizi
Jun 16, 2023

Levanter — Legible, Scalable, Reproducible Foundation Models with JAX

David Hall and Ivan Zhou and Percy Liang
Jun 16, 2023

Anticipatory Music Transformer: A Controllable Infilling Model for Music

John Thickstun and David Hall and Chris Donahue and Percy Liang
Jun 15, 2023

Do Foundation Model Providers Comply with the Draft EU AI Act?

Rishi Bommasani and Kevin Klyman and Daniel Zhang and Percy Liang
May 26, 2023

RA-CM3: Retrieval-Augmented Multimodal Modeling

Michihiro Yasunaga and Armen Aghajanyan and Weijia Shi and Rich James and Jure Leskovec and Percy Liang and Mike Lewis and Luke Zettlemoyer and Wen-tau Yih
May 22, 2023

AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback

Yann Dubois* and Xuechen Li* and Rohan Taori* and Tianyi Zhang* and Ishaan Gulrajani and Jimmy Ba and Carlos Guestrin and Percy Liang and Tatsunori B. Hashimoto
Mar 29, 2023

Ecosystem Graphs: The Social Footprint of Foundation Models

Rishi Bommasani and Thomas Liao and Percy Liang
Mar 28, 2023

From Deep to Long Learning?

Dan Fu and Michael Poli and Chris Ré
Mar 13, 2023

Alpaca: A Strong, Replicable Instruction-Following Model

Rohan Taori* and Ishaan Gulrajani* and Tianyi Zhang* and Yann Dubois* and Xuechen Li* and Carlos Guestrin and Percy Liang and Tatsunori B. Hashimoto
Mar 07, 2023

Hyena Hierarchy: Towards Larger Convolutional Language Models

Michael Poli* and Stefano Massaroli* and Eric Nguyen* and Dan Fu and Tri Dao and Stephen A. Baccus and Yoshua Bengio and Stefano Ermon and Chris Ré
Mar 05, 2023

Meerkat and the Path to Foundation Models as a Reliable Software Abstraction

Karan Goel and Sabri Eyuboglu and Arjun Desai and James Zou and Chris Ré
Feb 18, 2023

Year in Review 2022: Technical Advances, Applications, and Social Responsibility

Michael Wornow and Nandita Bhaskhar and Simran Arora and Percy Liang
Jan 17, 2023

Data Wrangling with Foundation Models

Avanika Narayan and Ines Chami and Laurel Orr and Chris Ré
Dec 15, 2022

BioMedLM

Elliot Bolton and David Hall and Michihiro Yasunaga and Tony Lee and Chris Manning and Percy Liang
Nov 17, 2022

Language Models are Changing AI: The Need for Holistic Evaluation

Rishi Bommasani and Percy Liang and Tony Lee
Jun 09, 2022

Can Longer Sequences Help Take the Next Leap in AI?

Chris Re and Tri Dao and Dan Fu and Karan Goel
May 17, 2022

The Time Is Now to Develop Community Norms for the Release of Foundation Models

Percy Liang and Rishi Bommasani and Kathleen Creel and Rob Reich
Oct 18, 2021

Reflections on Foundation Models

Rishi Bommasani and Percy Liang
Aug 26, 2021

Mistral — A Journey towards Reproducible Language Model Training

Siddharth Karamcheti and Laurel Orr