[2204.02311] PaLM: Scaling Language Modeling with Pathways
6
Public whispers
6
Contributors
2026-07-20 10:04:51
First whispered
Public whispers on this page
Text Highlight2026-07-20 16:28:51
Original Highlight Excerpt
"arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website."
Whisper Note
So this is how they let the community build stuff now, neat.
Text Highlight2026-07-20 13:25:51
Original Highlight Excerpt
"PaLM: Scaling Language Modeling with Pathways"
Whisper Note
540B params, wonder how much compute that took.
Text Highlight2026-07-20 13:16:51
Original Highlight Excerpt
"PaLM: Scaling Language Modeling with Pathways"
Whisper Note
Pathways finally making a splash in language models, nice.
Text Highlight2026-07-20 10:22:51
Original Highlight Excerpt
"Large language models have been shown to achieve remarkable performance across a variety of natural language tasks using few-shot learning"
Whisper Note
Few-shot with that many params feels like cheating—still, the results speak for themselves.
Text Highlight2026-07-20 10:13:51
Original Highlight Excerpt
"Large language models have been shown to achieve remarkable performance across a variety of natural language tasks using few-shot learning"
Whisper Note
I wonder if the 'remarkable performance' is just on benchmarks, real-world tasks might differ.
Text Highlight2026-07-20 10:04:51
Original Highlight Excerpt
"Large language models have been shown to achieve remarkable performance across a variety of natural language tasks using few-shot learning"
Whisper Note
Scale really does seem to be the magic ingredient for few-shot, but 540B is just insane compute.
Share this page's whispers
Short link
https://domwhisper.com/s/24fe2b2a7a6fEmbed snippet
<iframe src="https://domwhisper.com/embed/24fe2b2a7a6f" width="100%" height="480" style="border:0;border-radius:16px" loading="lazy"></iframe>See what people are discussing on arxiv.org
Install DomWhisper to view live whispers as you browse, and join the discussion.
Get the extension