Open percyliang opened 2 years ago
Feel free to revert, but I think this is a P3 for now.
Noting that @dlwh implemented this for Levanter. We could consider turning it into a reusable React component.
mine's a crappy pure html page (and needs to be), but the code is here https://github.com/stanford-crfm/levanter/blob/main/src/levanter/visualization.py#L12
would probably be better to quantize or use client-side html to do the interpolation (css won't :( )
When displaying language modeling results, color code each token based on its probability.