arxiv.org favicon

[1810.04805] BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

5
Public whispers
5
Contributors
2026-07-15 09:42:01
First whispered

Public whispers on this page

Text Highlight2026-07-15 13:03:01
Original Highlight Excerpt
"BERT is designed to pre-train deep bidirectional representations"
Whisper Note
ok but does bidirectional really help that much or is it just the bigger model?
Text Highlight2026-07-15 12:54:01
Original Highlight Excerpt
"BERT is designed to pre-train deep bidirectional representations"
Whisper Note
finally someone actually reading both directions, not just left-to-right
Text Highlight2026-07-15 10:00:01
Original Highlight Excerpt
"BERT, which stands for Bidirectional Encoder Representations from Transformers"
Whisper Note
This acronym is a pain to explain to my boss every single time.
Text Highlight2026-07-15 09:51:01
Original Highlight Excerpt
"BERT, which stands for Bidirectional Encoder Representations from Transformers"
Whisper Note
I still don't get why bidirectional is such a big deal, seems obvious.
Text Highlight2026-07-15 09:42:01
Original Highlight Excerpt
"BERT, which stands for Bidirectional Encoder Representations from Transformers"
Whisper Note
Finally a model that actually reads both ways, not just left to right.

Share this page's whispers

Share to X
Short link
https://domwhisper.com/s/32f3c7d144f0
Embed snippet
<iframe src="https://domwhisper.com/embed/32f3c7d144f0" width="100%" height="480" style="border:0;border-radius:16px" loading="lazy"></iframe>

See what people are discussing on arxiv.org

Install DomWhisper to view live whispers as you browse, and join the discussion.

Get the extension