bbycroft / llm-viz Goto Github PK

Incredible work, really love the viz! But please, for the sake of all anal busybodies, correct the it's/its mistakes, especially since you're working on LLMs!

Thank you and sorry for my OCD haha

Hi.
Thanks for your amazing job

Do you have any place for accepting the translation contributions?

See:

Looks okay in Chrome.

This is an amazing work.

Could you consider removing the "press space to continue" text after it has been displayed once? It includes the text I want to read behind it!

maybe like "tjanks folks that's all", or maybe a CTA idk, maybe the last part the very last part can have some animation which is perhaps missing and maybe a final result thing, idk, just ideas, I loved the whole thing, it motivated me to read the code. thank you for building this, you are awesome

I love the visualisation in https://bbycroft.net/llm.
It would be great to see how RWKV works.

I have git clone this project, and install yarn。but how can i run this code?

I think there is a typo in the second step.

We can regard each column separately, so let's focus on the 4rd column (t = 3) for now.

Should be 4th.

Great project! It helps me easier to understand how gpt works.

Could I know how to viz the gpt2 network. Currently, it defaults to nano-gpt.

Hi,

Thanks for an excellent tool! My research lab would like to make some small modifications (for visualizing some slightly different models), and we were wondering what the license for the code is.

Cheers,
Dan

Thanks for your nice work.
When I was running this project, I encountered the following error after running "npm run start":

D:\Downloaded\llm-viz>npm install
npm WARN deprecated [email protected]: Package no longer supported. Contact Support at https://www.npmjs.com/support for more info.

added 545 packages, and audited 546 packages in 3m

161 packages are looking for funding
  run `npm fund` for details

3 vulnerabilities (1 low, 2 moderate)

To address all issues, run:
  npm audit fix --force

Run `npm audit` for details.

D:\Downloaded\llm-viz>npm run start

> start
> next start

- ready started server on [::]:3000, url: http://localhost:3000
[Error: ENOENT: no such file or directory, open 'D:\Downloaded\llm-viz\.next\BUILD_ID'] {
  errno: -4058,
  code: 'ENOENT',
  syscall: 'open',
  path: 'D:\\Downloaded\\llm-viz\\.next\\BUILD_ID'
}

What should I do besides running npm install, before running npm run start?

as mentioned, Its goal is a simple one: take a sequence of six letters:
C B A B B C

and sort them in alphabetical order, i.e. to "ABBBCC". but output is CBAAAA

Great project! I would like to know how to train the letter sorting model mentioned in the nano-GPT visualization project? I think the visualization here is more clear when combined with the nano-GPT project code? So is it convenient to provide training documents for the alphabetical sorting model? Thank you so much!

Thanks for this amazing work !

Is there a pipeline on generating this visualisation for new models ? I would love to get something running on BERT or T5 architecture. How can I achieve this ?