search

valine / NeuralFlow

Visualize the intermediate output of Mistral 7B
GNU General Public License v3.0
314 stars 13 forks source link

3D Visualization #3

Open zglin opened 9 months ago

zglin commented 9 months ago

Would it be helpful to do visualization across 3 dimensions to be able to traverse the layers (and probably give some benefit to those people who bought the Oculus headset)?

valine commented 9 months ago

The layers are the 2nd dimension in the current image. Could be interesting to plot more than one token in 3D. The oculus request is unfortunately outside the scope of this repo.