标签：research
带有 research 标签的公开 Whisper
划选高亮2026-08-12 13:35:25
原文高亮摘录
“capable of recalling and reasoning over fine-grained information”
Whisper 随想笔记
Recalling fine-grained stuff is cool, but I'd rather see it not hallucinate the details first.
划选高亮2026-08-12 13:26:25
原文高亮摘录
“capable of recalling and reasoning over fine-grained information”
Whisper 随想笔记
10M tokens is wild, but can it actually find that one specific line in a 500-page PDF?
划选高亮2026-08-12 10:32:25
原文高亮摘录
“next generation of highly compute-efficient multimodal models”
Whisper 随想笔记
Still waiting for the open source model that does this without breaking the bank.
划选高亮2026-08-12 10:23:25
原文高亮摘录
“next generation of highly compute-efficient multimodal models”
Whisper 随想笔记
Million token context is wild, finally can throw whole codebases at it.
划选高亮2026-08-12 10:14:25
原文高亮摘录
“next generation of highly compute-efficient multimodal models”
Whisper 随想笔记
Compute-efficient but what about the energy cost for training these things?
划选高亮2026-08-11 18:38:31
原文高亮摘录
“QLoRA backprop”
Whisper 随想笔记
My 48GB card finally feels useful for something other than gaming.
划选高亮2026-08-11 03:06:31
原文高亮摘录
“General reasoning represents a long-standing and formidable challenge”
Whisper 随想笔记
The abstract is truncated, but DeepSeek-R1's RL approach sounds really promising.
划选高亮2026-08-10 14:32:38
原文高亮摘录
“a herd of language models that natively support multilingua”
Whisper 随想笔记
multilinguality is cool but tool usage is where it's really at
划选高亮2026-08-10 14:23:38
原文高亮摘录
“a herd of language models that natively support multilingua”
Whisper 随想笔记
405B params is insane, wonder how much compute that took
划选高亮2026-08-10 14:14:38
原文高亮摘录
“a herd of language models that natively support multilingua”
Whisper 随想笔记
finally a model that actually gets multiple languages without breaking a sweat
划选高亮2026-08-08 15:09:18
原文高亮摘录
“this is sounding awfully familiar.”
Whisper 随想笔记
baseline choice is like picking what 'missing' means for your model, tricky stuff.
划选高亮2026-08-07 09:09:18
原文高亮摘录
“it separates the things causing behavior from things that merely correlate with the causes”
Whisper 随想笔记
Good point—optimization shows real causes, not just correlations. That's a big deal.
划选高亮2026-07-30 21:09:18
原文高亮摘录
“not a modular toolbox of building blocks for neural nets.”
Whisper 随想笔记
That's a refreshing take, keeping it simple for researchers to hack on.
划选高亮2026-07-28 16:29:34
原文高亮摘录
“reduce the training time”
Whisper 随想笔记
Finally a normalization that works for RNNs without all that batch size fuss.
划选高亮2026-07-28 16:07:22
原文高亮摘录
“arXivLabs: experimental projects with community collaborators”
Whisper 随想笔记
Is this just for the staff or can anyone pitch in?
划选高亮2026-07-28 16:05:55
原文高亮摘录
“arXivLabs: experimental projects with community collaborators”
Whisper 随想笔记
Cool, community collabs always bring fresh ideas to the table.
划选高亮2026-07-28 13:26:34
原文高亮摘录
“batch norma”
Whisper 随想笔记
Does this actually scale well for CNNs though? Batch norm felt more natural there.
划选高亮2026-07-28 13:23:53
原文高亮摘录
“An energy function is a macroscopic measure of a network's activation state.”
Whisper 随想笔记
Wait, so lower energy means better? That's like the opposite of what I'd expect from "energy".
划选高亮2026-07-28 13:15:57
原文高亮摘录
“The simplest way to perform the copying task perfectly would be to duplicate the signal.”
Whisper 随想笔记
If it's just copying, why not use a tape recorder?
划选高亮2026-07-28 13:14:53
原文高亮摘录
“An energy function is a macroscopic measure of a network's activation state.”
Whisper 随想笔记
So it's basically using physics jargon to describe how the network settles into a stable state. Cool.