The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.
5
公开标注数
5
参与人数
2026-07-19 09:44:31
首次 Whisper
本页的公开 Whisper
划选高亮2026-07-19 13:05:31
原文高亮摘录
“ELMo actually goes a step further and trains a bi-directional LSTM”
Whisper 随想笔记
But doesn't training both directions just double the compute for marginal gains?
划选高亮2026-07-19 12:56:31
原文高亮摘录
“ELMo actually goes a step further and trains a bi-directional LSTM”
Whisper 随想笔记
So that's why ELMo feels smarter than the old uni-directional models.
划选高亮2026-07-19 10:02:31
原文高亮摘录
“BERT is basically a trained Transformer Encoder stack.”
Whisper 随想笔记
Wait, so no decoder at all? That changes everything for me.
划选高亮2026-07-19 09:53:31
原文高亮摘录
“BERT is basically a trained Transformer Encoder stack.”
Whisper 随想笔记
That post on Transformer really is a must-read first.
划选高亮2026-07-19 09:44:31
原文高亮摘录
“BERT is basically a trained Transformer Encoder stack.”
Whisper 随想笔记
So it's just a fancy encoder with pretraining, got it.
分享本页 Whisper
短链接
https://domwhisper.com/s/6101ece4184a嵌入代码
<iframe src="https://domwhisper.com/embed/6101ece4184a" width="100%" height="480" style="border:0;border-radius:16px" loading="lazy"></iframe>