arxiv.org favicon

[1607.06450] Layer Normalization

6
公开标注数
6
参与人数
2026-07-28 10:05:34
首次 Whisper

本页的公开 Whisper

划选高亮2026-07-28 16:29:34
原文高亮摘录
reduce the training time
Whisper 随想笔记
Finally a normalization that works for RNNs without all that batch size fuss.
划选高亮2026-07-28 13:26:34
原文高亮摘录
batch norma
Whisper 随想笔记
Does this actually scale well for CNNs though? Batch norm felt more natural there.
划选高亮2026-07-28 13:17:34
原文高亮摘录
batch norma
Whisper 随想笔记
So layer norm is basically batch norm but for single examples, makes sense for RNNs.
划选高亮2026-07-28 10:23:34
原文高亮摘录
normalize the activities of the neurons
Whisper 随想笔记
tried it on my lstm and yeah, training felt way smoother
划选高亮2026-07-28 10:14:34
原文高亮摘录
normalize the activities of the neurons
Whisper 随想笔记
but does it actually help with small datasets or just big ones?
划选高亮2026-07-28 10:05:34
原文高亮摘录
normalize the activities of the neurons
Whisper 随想笔记
finally something that works for rnns without batch size headaches

分享本页 Whisper

分享到 X
短链接
https://domwhisper.com/s/c0695dd7ff75
嵌入代码
<iframe src="https://domwhisper.com/embed/c0695dd7ff75" width="100%" height="480" style="border:0;border-radius:16px" loading="lazy"></iframe>

看看大家在 arxiv.org 上讨论了什么

安装 DomWhisper,浏览网页时实时查看 whisper,也可以加入讨论。

获取插件