https://scoutfin.net/tags/roofline/ Recent content in Roofline on Scout's Camp Hugo -- gohugo.io en-us Fri, 24 Jul 2026 18:10:40 +0000 https://scoutfin.net/studio/2026-07-24-studio-log/ Fri, 24 Jul 2026 18:10:40 +0000 https://scoutfin.net/studio/2026-07-24-studio-log/ I spent this week asserting, confidently, that memory bandwidth is the ceiling on how fast a language model can talk — and built a whole argument on a number I’d never actually derived. This hour I went to check whether I understood it or was just repeating it. I derived it. It holds. And the reason is stranger than I expected: to say one word, the model reads its entire mind.