从零构建大语言模型
Build a Large Language Model
Sebastian Raschka · 初版 2024 年
12人推荐
26位读者提及
26次提及
为什么值得读
- 讲解通俗易懂同时不失扎实的技术细节
- 清晰剖析类似GPT-2的基础核心构建模块
- 适合认真想要彻底吃透大模型底层逻辑的人
Hacker News 上怎么说
正在加载完整评论……
Build a Large Language Model
Sebastian Raschka · 初版 2024 年
正在加载完整评论……
……如果你真想把它彻底吃透（grok），起码得看两三章书！要是真有人想认真搞懂这玩意儿，我强烈推荐 Sebastian Raschka 的神作《从零开始构建大语言模型》（Build a Large Language Model (From Scratch)），我刚读完。深入浅出，细节也很到位。顺便问一句，大家有没有觉得把 QKV 类比成“数据库查找”的动机其实挺让人迷惑的？（文章里说，“Query (Q)：……
…requires two or three book chapters at least if you really want to start grokking it! For anyone serious about coming to grips with this stuff, I would strongly recommend Sebastian Raschka's excellent book Build a Large Language Model (From Scratch), which I just finished reading. It's approachable and also detailed. As an aside, does anyone else find the whole "database lookup" motivation for QKV kind of confusing? (in the article, "Query (Q):…
强烈推荐 Sebastian Raschka 写的《从零开始构建大语言模型》[1]。它非常清晰地讲解了初代 ChatGPT（如果我没记错的话应该是 GPT-2）所用的基础构件。模型的输出是一个包含 n 个元素的超大向量，……
I highly recommend Build a large language model from scratch [1] by Sebastian Raschka. It provides a clear explanation of the building blocks used in the first versions of ChatGPT (GPT 2 if I recall correctly). The output of the model is a huge vector of n elements,…
我今天偶然看到了 https://www.manning.com/books/build-a-large-language-model-f... ——目前还没完结，但听起来完全就是你想找的内容。
I stumbled across https://www.manning.com/books/build-a-large-language-model-f... today - it's not complete yet, but sounds like exactly what you're after.
……正在出版一套“从零开始”（X From Scratch）系列，目前包括：* 容器编排器：https://www.manning.com/books/build-an-orchestrator-in-go-fr... * LLM：https://www.manning.com/books/build-a-large-language-model-f... * 前端框架：https://www.manning.com/books/build-a-frontend-web-framework... 鉴于你特定的兴趣方向，第一本书可能会最合你的胃口。
…working on publishing a X From Scratch series, which currently includes: * Container Orchestrator: https://www.manning.com/books/build-an-orchestrator-in-go-fr... * LLM : https://www.manning.com/books/build-a-large-language-model-f... * Frontend Framework: https://www.manning.com/books/build-a-frontend-web-framework... The first book might be most interesting, given your particular subject interest.
…https://www.oreilly.com/library/view/designing-data-intensiv... - https://www.manning.com/books/100-go-mistakes-and-how-to-avo... - https://www.amazon.com/Systems-Performance-Brendan-Gregg/dp/... 还有最近看的：- https://www.manning.com/books/build-a-large-language-model-f... - https://www.manning.com/books/the-creative-programmer - https://www.manning.com/books/the-programmers-brain - https://www.amazon.com/Understanding-Software-Addison-Wesley... 我还觉得有些书……
…https://www.oreilly.com/library/view/designing-data-intensiv... - https://www.manning.com/books/100-go-mistakes-and-how-to-avo... - https://www.amazon.com/Systems-Performance-Brendan-Gregg/dp/... And more recently: - https://www.manning.com/books/build-a-large-language-model-f... - https://www.manning.com/books/the-creative-programmer - https://www.manning.com/books/the-programmers-brain - https://www.amazon.com/Understanding-Software-Addison-Wesley... I also find books…
……播放列表：https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThs... 他目前正在自己的新公司“Eureka Labs”下打造新的学习材料：https://eurekalabs.ai Sebastian Raschka 的新书《从零开始构建大语言模型》（Build a Large Language Model (From Scratch)）也刚刚出版：https://www.manning.com/books/build-a-large-language-model-f... 这些资源都棒极了。
…playlist: https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThs... He is building new learning materials under his new company "Eureka Labs": https://eurekalabs.ai Sebastian Raschka's book "Build a Large Language Model (From Scratch) just released: https://www.manning.com/books/build-a-large-language-model-f... All of these resources are excellent.