Added support for colored tokens with multiple values per token. Current visualization is a bit janky, but I think good enough to be useful. Use in the tokens_multi file. Currently each set of activations has the same color scheme, and exactly one set is shown at any given time (ie, I don't bother with color mixing). When a token is hovered over, the tooltip shows all values for that token.
Added a specific function to the tokens_multi.py file to visualize the logits, log probs and probabilities for a model
Made some minor changes elsewhere, tokens in TokensCustomTooltip now get bolded and outlined when hovered over.
Added support for colored tokens with multiple values per token. Current visualization is a bit janky, but I think good enough to be useful. Use in the
tokens_multi
file. Currently each set of activations has the same color scheme, and exactly one set is shown at any given time (ie, I don't bother with color mixing). When a token is hovered over, the tooltip shows all values for that token.Added a specific function to the
tokens_multi.py
file to visualize the logits, log probs and probabilities for a modelMade some minor changes elsewhere, tokens in TokensCustomTooltip now get bolded and outlined when hovered over.