Open ezyang opened 1 year ago
As this is not a simple fix IMO, I have added it into our sprint so that I can be planned accordingly
a crappy mockup (like maybe just some manually drawn screens in excalidraw) I think would help us iterate on the UI design quickly, without having to build everything first
Two use cases:
Right now, benchmark grouping is hard-coded for the three benchmark suites. It would be nice if there were a light way to introduce new benchmark groupings on a model-by-model basis and see how they evolve over time. Some UI design necessary for managing these groupings.
cc @huydhn