PaLM 2 Technical Report
We introduce PaLM 2, a new state-of-the-art language model that has better
multilingual and reasoning capabilities and is more compute-efficient than its
predecessor PaLM. PaLM 2 is a Transformer-based model trained using a mixture
of objectives. Through extensive evaluations on English and multilingual
language, and reasoning tasks, we demonstrate that PaLM 2 has significantly
improved quality on downstream tasks across different model sizes, while
simultaneously exhibiting faster and more efficient inference compared to PaLM.
This improved efficiency enables broader deployment while also allowing the
model to respond faster, for a more natural pace of interaction. PaLM 2
demonstrates robust reasoning capabilities exemplified by large improvements
over PaLM on BIG-Bench and other reasoning tasks. PaLM 2 exhibits stable
performance on a suite of responsible AI evaluations, and enables
inference-time control over toxicity without additional overhead or impact on
other capabilities. Overall, PaLM 2 achieves state-of-the-art performance
across a diverse set of tasks and capabilities.
  When discussing the PaLM 2 family, it is important to distinguish between
pre-trained models (of various sizes), fine-tuned variants of these models, and
the user-facing products that use these models. In particular, user-facing
products typically include additional pre- and post-processing steps.
Additionally, the underlying models may evolve over time. Therefore, one should
not expect the performance of user-facing products to exactly match the results
reported in this report.
6465be520e6c7618f6163459
Rohan Anil
6465be520e6c7618f616345a
Andrew M. Dai
6465be520e6c7618f616345b
Orhan Firat
6465be520e6c7618f616345c
Melvin Johnson
6465be520e6c7618f616345d
Dmitry Lepikhin
6465be520e6c7618f616345e
Alexandre Passos
6465be520e6c7618f616345f
Siamak Shakeri
6465be520e6c7618f6163460
Emanuel Taropa
6465be520e6c7618f6163461
Paige Bailey
admin_assigned
2023-05-19T13:36:41.368Z
60f300249b7e6dcb17723f3a
https://cdn-avatars.huggingface.co/v1/production/uploads/1642442497120-60f300249b7e6dcb17723f3a.jpeg
Paige Bailey
user
dynamicwebpaige
6465be520e6c7618f6163462
Zhifeng Chen
6465be520e6c7618f6163463
Eric Chu
6465be520e6c7618f6163464
Jonathan H. Clark
6465be520e6c7618f6163465
Laurent El Shafey
6465be520e6c7618f6163466
Yanping Huang
6465be520e6c7618f6163467
Kathy Meier-Hellstern
6465be520e6c7618f6163468
Gaurav Mishra
6465be520e6c7618f6163469
Erica Moreira
6465be520e6c7618f616346a
Mark Omernick
6465be520e6c7618f616346b
Kevin Robinson
6465be520e6c7618f616346c
Sebastian Ruder
admin_assigned
2023-05-19T13:37:32.250Z
624575789dc26c59bae6a19e
https://cdn-avatars.huggingface.co/v1/production/uploads/1648719221694-noauth.jpeg
Sebastian Ruder
user
ruder
6465be520e6c7618f616346d
Yi Tay
6465be520e6c7618f616346e
Kefan Xiao
6465be520e6c7618f616346f
Yuanzhong Xu
6465be520e6c7618f6163470
Yujing Zhang
6465be520e6c7618f6163471
Gustavo Hernandez Abrego
6465be520e6c7618f6163472
Junwhan Ahn
6465be520e6c7618f6163473
Jacob Austin
6465be520e6c7618f6163474
Paul Barham
6465be520e6c7618f6163475
Jan Botha
6465be520e6c7618f6163476
James Bradbury
6465be520e6c7618f6163477
Siddhartha Brahma
6465be520e6c7618f6163478
Kevin Brooks
6465be520e6c7618f6163479
Michele Catasta
6465be520e6c7618f616347a
Yong Cheng
6465be520e6c7618f616347b
Colin Cherry
admin_assigned
2023-05-19T13:38:37.532Z
6144bb22207b8aba44e8ec59
https://cdn-avatars.huggingface.co/v1/production/uploads/1631896530912-6144bb22207b8aba44e8ec59.jpeg
Colin Cherry
user
ColinCherry
6465be520e6c7618f616347c
Christopher A. Choquette-Choo
claimed_verified
2024-05-13T07:51:40.132Z
649c5307e89a7650158f4965
/avatars/3c71b501db27c86ed686ae26ad1391cd.svg
Christopher A. Choquette-Choo
user
cchoquette
6465be520e6c7618f616347d
Aakanksha Chowdhery
6465be520e6c7618f616347e
Clément Crepy
6465be520e6c7618f616347f
Shachi Dave
6465be520e6c7618f6163480
Mostafa Dehghani
6465be520e6c7618f6163481
Sunipa Dev
6465be520e6c7618f6163482
Jacob Devlin
6465be520e6c7618f6163483
Mark Díaz
6465be520e6c7618f6163484
Nan Du
6465be520e6c7618f6163485
Ethan Dyer
6465be520e6c7618f6163486
Vlad Feinberg
6465be520e6c7618f6163487
Fangxiaoyu Feng
6465be520e6c7618f6163488
Vlad Fienber
6465be520e6c7618f6163489
Markus Freitag
6465be520e6c7618f616348a
Xavier Garcia
6465be520e6c7618f616348b
Sebastian Gehrmann
admin_assigned
2023-05-19T13:37:19.440Z
618a8d67cabd3c4c8e4481f0
https://cdn-avatars.huggingface.co/v1/production/uploads/1636661214776-618a8d67cabd3c4c8e4481f0.jpeg
Sebastian Gehrmann
user
SebGehr
6465be520e6c7618f616348c
Lucas Gonzalez
6465be520e6c7618f616348d
Guy Gur-Ari
6465be520e6c7618f616348e
Steven Hand
6465be520e6c7618f616348f
Hadi Hashemi
6465be520e6c7618f6163490
Le Hou
6465be520e6c7618f6163491
Joshua Howland
6465be520e6c7618f6163492
Andrea Hu
6465be520e6c7618f6163493
Jeffrey Hui
6465be520e6c7618f6163494
Jeremy Hurwitz
6465be520e6c7618f6163495
Michael Isard
6465be520e6c7618f6163496
Abe Ittycheriah
6465be520e6c7618f6163497
Matthew Jagielski
6465be520e6c7618f6163498
Wenhao Jia
6465be520e6c7618f6163499
Kathleen Kenealy
6465be520e6c7618f616349a
Maxim Krikun
6465be520e6c7618f616349b
Sneha Kudugunta
6465be520e6c7618f616349c
Chang Lan
6465be520e6c7618f616349d
Katherine Lee
6465be520e6c7618f616349e
Benjamin Lee
6465be520e6c7618f616349f
Eric Li
6465be520e6c7618f61634a0
Music Li
6465be520e6c7618f61634a1
Wei Li
6465be520e6c7618f61634a2
YaGuang Li
6465be520e6c7618f61634a3
Jian Li
6465be520e6c7618f61634a4
Hyeontaek Lim
6465be520e6c7618f61634a5
Hanzhao Lin
claimed_verified
2023-12-21T09:56:45.561Z
63608df58fb9c2420fff8225
https://cdn-avatars.huggingface.co/v1/production/uploads/63608df58fb9c2420fff8225/TZlx0aSH3YxNbyWki65We.jpeg
Hanzhao Lin
user
hanzhao
6465be520e6c7618f61634a6
Zhongtao Liu
6465be520e6c7618f61634a7
Frederick Liu
6465be520e6c7618f61634a8
Marcello Maggioni
6465be520e6c7618f61634a9
Aroma Mahendru
6465be520e6c7618f61634aa
Joshua Maynez
6465be520e6c7618f61634ab
Vedant Misra
6465be520e6c7618f61634ac
Maysam Moussalem
6465be520e6c7618f61634ad
Zachary Nado
6465be520e6c7618f61634ae
John Nham
6465be520e6c7618f61634af
Eric Ni
6465be520e6c7618f61634b0
Andrew Nystrom
6465be520e6c7618f61634b1
Alicia Parrish
claimed_verified
2024-02-07T20:41:27.369Z
659d71eaf0ae1a57ae140831
/avatars/b9eb8c70b4fe5dbd0f1555602ae41b65.svg
Alicia Parrish
user
avparrish
6465be520e6c7618f61634b2
Marie Pellat
6465be520e6c7618f61634b3
Martin Polacek
6465be520e6c7618f61634b4
Alex Polozov
6465be520e6c7618f61634b5
Reiner Pope
6465be520e6c7618f61634b6
Siyuan Qiao
6465be520e6c7618f61634b7
Emily Reif
6465be520e6c7618f61634b8
Bryan Richter
6465be520e6c7618f61634b9
Parker Riley
6465be520e6c7618f61634ba
Alex Castro Ros
6465be520e6c7618f61634bb
Aurko Roy
6465be520e6c7618f61634bc
Brennan Saeta
6465be520e6c7618f61634bd
Rajkumar Samuel
6465be520e6c7618f61634be
Renee Shelby
6465be520e6c7618f61634bf
Ambrose Slone
6465be520e6c7618f61634c0
Daniel Smilkov
6465be520e6c7618f61634c1
David R. So
6465be520e6c7618f61634c2
Daniel Sohn
6465be520e6c7618f61634c3
Simon Tokumine
6465be520e6c7618f61634c4
Dasha Valter
6465be520e6c7618f61634c5
Vijay Vasudevan
6465be520e6c7618f61634c6
Kiran Vodrahalli
claimed_verified
2025-05-28T09:03:35.278Z
6835eea6b34ab1d58e6b8133
/avatars/eb013082aba7cd8688e16ea56d4a213c.svg
Kiran Vodrahalli
user
kiranvodrahalli
6465be520e6c7618f61634c7
Xuezhi Wang
6465be520e6c7618f61634c8
Pidong Wang
6465be520e6c7618f61634c9
Zirui Wang
6465be520e6c7618f61634ca
Tao Wang
6465be520e6c7618f61634cb
John Wieting
6465be520e6c7618f61634cc
Yuhuai Wu
6465be520e6c7618f61634cd
Kelvin Xu
6465be520e6c7618f61634ce
Yunhan Xu
6465be520e6c7618f61634cf
Linting Xue
6465be520e6c7618f61634d0
Pengcheng Yin
6465be520e6c7618f61634d1
Jiahui Yu
6465be520e6c7618f61634d2
Qiao Zhang
6465be520e6c7618f61634d3
Steven Zheng
6465be520e6c7618f61634d4
Ce Zheng
6465be520e6c7618f61634d5
Weikang Zhou
6465be520e6c7618f61634d6
Denny Zhou
claimed_verified
2024-02-20T18:28:40.639Z
65d4d62d493aeaf0bb295f1b
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/vXMxaoWwFziul8TqIhQw8.jpeg
Denny Zhou
user
dennyzhou
6465be520e6c7618f61634d7
Slav Petrov
6465be520e6c7618f61634d8
Yonghui Wu
PaLM 2 Technical Report
We introduce PaLM 2, a new state-of-the-art language model that has better
multilingual and reasoning capabilities and is more compute-efficient than its
predecessor PaLM. PaLM 2 is a Transformer-based model trained using a mixture
of objectives. Through extensive evaluations on English and multilingual
language, and reasoning tasks, we demonstrate that PaLM 2 has significantly
improved quality on downstream tasks across different model sizes, while
simultaneously exhibiting faster and more efficient inference compared to PaLM.
This improved efficiency enables broader deployment while also allowing the
model to respond faster, for a more natural pace of interaction. PaLM 2
demonstrates robust reasoning capabilities exemplified by large improvements
over PaLM on BIG-Bench and other reasoning tasks. PaLM 2 exhibits stable
performance on a suite of responsible AI evaluations, and enables
inference-time control over toxicity without additional overhead or impact on
other capabilities. Overall, PaLM 2 achieves state-of-the-art performance
across a diverse set of tasks and capabilities.
  When discussing the PaLM 2 family, it is important to distinguish between
pre-trained models (of various sizes), fine-tuned variants of these models, and
the user-facing products that use these models. In particular, user-facing
products typically include additional pre- and post-processing steps.
Additionally, the underlying models may evolve over time. Therefore, one should
not expect the performance of user-facing products to exactly match the results
reported in this report.
PaLM 2, a Transformer-based language model, improves multilingual and reasoning capabilities with enhanced efficiency and performance across various tasks compared to its predecessor.
Transformer-based model mixture of objectives BIG-Bench responsible AI evaluations