Attention? Attention! | Lil'Log
5
公开标注数
5
参与人数
2026-07-15 09:44:14
首次 Whisper
本页的公开 Whisper
划选高亮2026-07-15 13:05:14
原文高亮摘录
“The attention mechanism was born to help memorize long source sentences in neural machine translation (NMT)”
Whisper 随想笔记
Makes sense—memory was the bottleneck, not the model itself.
划选高亮2026-07-15 12:56:14
原文高亮摘录
“The attention mechanism was born to help memorize long source sentences in neural machine translation (NMT)”
Whisper 随想笔记
So attention is basically a cheat code for long sentences, huh?
划选高亮2026-07-15 10:02:14
原文高亮摘录
“attention in deep learning can be broadly interpreted as a vector of importance weights”
Whisper 随想笔记
I always thought of it as a spotlight, but weights work too.
划选高亮2026-07-15 09:53:14
原文高亮摘录
“attention in deep learning can be broadly interpreted as a vector of importance weights”
Whisper 随想笔记
That's a neat way to frame it—makes the math less scary.
划选高亮2026-07-15 09:44:14
原文高亮摘录
“attention in deep learning can be broadly interpreted as a vector of importance weights”
Whisper 随想笔记
So basically it's just fancy weighted averaging, huh.
分享本页 Whisper
短链接
https://domwhisper.com/s/7eaf636d4e9c嵌入代码
<iframe src="https://domwhisper.com/embed/7eaf636d4e9c" width="100%" height="480" style="border:0;border-radius:16px" loading="lazy"></iframe>