The Illustrated Retrieval Transformer – Jay Alammar – Visualizing machine learning one concept at a time.
5
公开标注数
5
参与人数
2026-07-20 09:44:37
首次 Whisper
本页的公开 Whisper
划选高亮2026-07-20 13:05:37
原文高亮摘录
“Every third block starting from 9 is a RETRO block”
Whisper 随想笔记
I guess the smaller models just start earlier, makes sense for less depth.
划选高亮2026-07-20 12:56:37
原文高亮摘录
“Every third block starting from 9 is a RETRO block”
Whisper 随想笔记
So every third block after 9, got it. But why start at 9, seems kinda random.
划选高亮2026-07-20 10:02:37
原文高亮摘录
“the model can be much smaller. A neural database aids it with retrieving factual information”
Whisper 随想笔记
makes sense—why memorize when you can just look it up?
划选高亮2026-07-20 09:53:37
原文高亮摘录
“the model can be much smaller. A neural database aids it with retrieving factual information”
Whisper 随想笔记
so it's like having a cheat sheet, but for facts.
划选高亮2026-07-20 09:44:37
原文高亮摘录
“the model can be much smaller. A neural database aids it with retrieving factual information”
Whisper 随想笔记
smaller models are the future, but what if the database goes down?
分享本页 Whisper
短链接
https://domwhisper.com/s/23188f83a414嵌入代码
<iframe src="https://domwhisper.com/embed/23188f83a414" width="100%" height="480" style="border:0;border-radius:16px" loading="lazy"></iframe>