Attention? Attention! | Lil'Log

Public whispers

Contributors

2026-07-15 09:44:14

First whispered

Public whispers on this page

Text Highlight2026-07-15 13:05:14

Original Highlight Excerpt

"The attention mechanism was born to help memorize long source sentences in neural machine translation (NMT)"

Whisper Note

Makes sense—memory was the bottleneck, not the model itself.

Text Highlight2026-07-15 12:56:14

Original Highlight Excerpt

"The attention mechanism was born to help memorize long source sentences in neural machine translation (NMT)"

Whisper Note

So attention is basically a cheat code for long sentences, huh?

Text Highlight2026-07-15 10:02:14

Original Highlight Excerpt

"attention in deep learning can be broadly interpreted as a vector of importance weights"

Whisper Note

I always thought of it as a spotlight, but weights work too.

Text Highlight2026-07-15 09:53:14

Original Highlight Excerpt

"attention in deep learning can be broadly interpreted as a vector of importance weights"

Whisper Note

That's a neat way to frame it—makes the math less scary.

Text Highlight2026-07-15 09:44:14

Original Highlight Excerpt

"attention in deep learning can be broadly interpreted as a vector of importance weights"

Whisper Note

So basically it's just fancy weighted averaging, huh.

Short link

https://domwhisper.com/s/7eaf636d4e9c

Embed snippet

<iframe src="https://domwhisper.com/embed/7eaf636d4e9c" width="100%" height="480" style="border:0;border-radius:16px" loading="lazy"></iframe>

Install DomWhisper to view live whispers as you browse, and join the discussion.