Some metric tables are empty

[eu9ene]

For example for https://wandb.ai/moz-translations/da-en

[eu9ene]

Also see https://github.com/mozilla/firefox-translations-training/issues/688#issuecomment-2191805527

[vrigal]

This definitely looks like an issue with Weight & Biases, as I am able to list data from the API for those tables. It is certainly related to missing bar charts by the way. I noticed two types of empty tables (rows are blue, chrf and comet scores):

• No row:
  • aV89TBTaTtiG0M39A5i04Q / teacher 1 / flores_aug-mix_devtest_table (W&B run 9nmh995a)
• Rows with empty values:
  • N1O85rIASLmCwKfUpCvTlw / teacher-ensemble / flores_devtest_table (W&B run 0mnjufnk)

Here is the script I used to retrieve tables via the API:

>>> import json
>>> import wandb
>>> run = api.run(f"moz-translations/da-en/9nmh995a")
>>> artifact = next(
>>>     (artifact for artifact in list(run.files())[::-1] if artifact.name.startswith("media/table/flores_aug-mix_devtest_table")
>>> )
>>> json.load(artifact.download())
{'columns': ['Metric', 'Value'],
 'data': [['bleu_detok', 49.15], ['chrf', 72.12], ['comet', 0.9006]]}
>>> run = api.run(f"moz-translations/da-en/0mnjufnk")
>>> artifact = next(
>>>     (artifact for artifact in list(run.files())[::-1] if artifact.name.startswith("media/table/flores_devtest_table")
>>> )
>>> json.load(artifact.download())
{'columns': ['Metric', 'Value'],
 'data': [['bleu_detok', 48.93], ['chrf', 72.16], ['comet', 0.9013]]}

[eu9ene]

Ok, so to summarize we can see the values in the the artifact https://wandb.ai/moz-translations/da-en/artifacts/run_table/run-9nmh995a-flores_augmix_devtest_table/v0/files/flores_aug-mix_devtest_table.table.json but the table is empty in UI:

[eu9ene]

After a conversation with W&B support, they suggested a workaround that works for me: resetting the personal workspace.

@vrigal could you try this too for your workspace? It appears to also fix #688

[vrigal]

@eu9ene unfortunately I still see some tables with "No rows to display" in your workspace (but I see it has been saved on 2024-08-09T21:32:05.000Z). Even with resetting cache or changing the web browser. I cannot change the workspace on this dashboard, but it is surely related.

[eu9ene]

I reported this and W&B team is working on the fix but there's no ETA yet.