跳到正文
Hacker News (official RSS)(oshea00.github.io)·· 11 天前品質評分47

用於探索大型語言模型內部運作的工具

Tools for exploring the souls of large language models

重點導讀

TinyGPT Visualizer 是一款開源工具,讓使用者以視覺化方式觀察大型語言模型內部的數值矩陣,並嘗試機制可解釋性研究中的分析技術。

  • 開發目的:作者希望用這個工具瞭解相關研究方法如何運作,並讓更多人能探索模型內部。
  • 取得方式:程式碼、安裝說明與檔案已公開於 GitHub:github.com/oshea00/tinygpt-viz。

AI 伴隨問答

自備 Key 深度分析

針對這篇報導有疑問?可直接點選快捷問題或向 AI 追問背景脈絡與技術細節:

正文

There is that old joke told by Woody Allen describing his experience as a university student: “I was thrown out of college for cheating on the metaphysics exam; I looked into the soul of the boy sitting next to me.” If he’d managed to pass his course, Woody Allen might have been ahead of his time.

Metaphysics is becoming a popular topic today, and it seems now everyone desperately wants to look for souls in large language models (LLMs). A recent conference last April was held by Anthropic with religious scholars and philosophical thinkers to discuss the nature of the soul when it came to their latest Claude models. It seems they needed guidance that Dario Amodei was unable to provide.

The time seems ripe to dig into how we might actually peer into the mind of the LLM sitting next to you. There’s been a lot of ongoing research; however, the self-same foundation model companies, Anthropic and OpenAI among them, have been criticized for dedicating more compute dollars into better models rather than the safety research. Mechanistic interpretability, the field of AI research devoted to exploring what goes on inside these models, has grown from a handful of researchers in 2021 to hundreds of active contributors. Yet, in spite of funding gaps and the lack of larger colloquiums, the research community has been coming up with some interesting insights and tools to help do the “peering.”

Rather than sit on the sidelines and wonder how this could be done, I thought it would be interesting to create a tool that would allow more people to join the party. And that is what led to the development of the “TinyGPT Visualizer.” The goals I had for this were modest. I wanted a tool I could use to survey the field and try the actual techniques to learn how they work. Being a visual person, I began thinking about an X-ray machine—something able to see inside a real model. Not a toy model. A real one, but one small enough to see on a screen with all its working parts.

Let me show what it looks like:

TinyGPT Visualizer walkthrough: inside the network

We may wonder where the consciousness can be found in the collection of numeric matrices that our models comprise; the numbers are there to see. Unlike the brains of humans, we can stop and look at the numbers as the thoughts are formed without killing the patient, and, unlike human brains, we can search those numbers for patterns and algorithms which explain the results these models emit as well-formed prose, code, music, and videos. Will we find well-formed emotions? If so, they will be in the numbers.

Will philosophy and religion help us? These disciplines haven’t had to rely on numbers and calculations up to this point, but perhaps they now have new ground to pound.

TinyGPT Visualizer is open source. You can find the code, setup instructions, and documentation on GitHub: github.com/oshea00/tinygpt-viz.

來源: Hacker News (official RSS) (oshea00.github.io)
開啟原文

讀者討論

理性交流 · 即時討論