Gradient boosting - Wikipedia
6
Public whispers
6
Contributors
2026-07-20 10:03:22
First whispered
Public whispers on this page
Text Highlight2026-07-20 16:27:22
Original Highlight Excerpt
"Gradient boosting is typically used with decision trees (especially CARTs) of a fixed size as base learners."
Whisper Note
Fixed-size trees keep it simple but I wonder if that limits flexibility.
Text Highlight2026-07-20 13:24:22
Original Highlight Excerpt
"The idea of gradient boosting originated in the observation by Leo Breiman that boosting can be interpreted as an optimization algorithm on a suitable cost…"
Whisper Note
So Friedman and Mason were working on this around the same time? Wild.
Text Highlight2026-07-20 13:15:22
Original Highlight Excerpt
"The idea of gradient boosting originated in the observation by Leo Breiman that boosting can be interpreted as an optimization algorithm on a suitable cost…"
Whisper Note
Breiman really nailed it—boosting as optimization just clicks.
Text Highlight2026-07-20 10:21:22
Original Highlight Excerpt
"Gradient boosting is a machine learning technique based on boosting in a functional space, where the target is pseudo-residuals instead of residuals as in traditional…"
Whisper Note
I've seen gradient-boosted trees beat random forest in practice, no contest.
Text Highlight2026-07-20 10:12:22
Original Highlight Excerpt
"Gradient boosting is a machine learning technique based on boosting in a functional space, where the target is pseudo-residuals instead of residuals as in traditional…"
Whisper Note
Does this mean gradient boosting is just a fancy term for tweaking residuals?
Text Highlight2026-07-20 10:03:22
Original Highlight Excerpt
"Gradient boosting is a machine learning technique based on boosting in a functional space, where the target is pseudo-residuals instead of residuals as in traditional…"
Whisper Note
So it's basically fitting trees to the mistakes, but in a smarter way than old boosting.
Share this page's whispers
Short link
https://domwhisper.com/s/36477a14dfb2Embed snippet
<iframe src="https://domwhisper.com/embed/36477a14dfb2" width="100%" height="480" style="border:0;border-radius:16px" loading="lazy"></iframe>See what people are discussing on en.wikipedia.org
Install DomWhisper to view live whispers as you browse, and join the discussion.
Get the extension