paper writing;: table overview of tasks

KennethEnevoldsen commented 4 weeks ago

see https://github.com/embeddings-benchmark/mteb/discussions/595#discussioncomment-9467714

KennethEnevoldsen commented 4 weeks ago

Assigned to @Sakshamrzt

Sakshamrzt commented 3 weeks ago

@KennethEnevoldsen Having a lang column seems necessary but it could lead to issues like above. What do you think should be done here?

KennethEnevoldsen commented 3 weeks ago

Ahh yea that seems a bit frustrating. A solution would be to reduce it to ["acm", "afr", "als", ...], with a maximum on n=10 languages. This does not convey the size though. So would add a column with the number or something like

N. Languages
---
107 ("acm", "afr", "als", ...)

Sakshamrzt commented 2 weeks ago

Sounds good! Thanks a lot for your input.

KennethEnevoldsen commented 2 weeks ago

Had a look at the table. Looking good so far!

A few suggestions at which point I think we are getting there)

introduce a space between name and citation
make the text smaller (size the table is quite large) e.g. see - ideally no more than 2 lines pr. dataset.
Move the table to appendix D (though that should probably be moved to be the last appendix). We should also add a small introduction here as well as long with a reference to the table on docs (which includes the description).
I would add a parenthesis around the language)
remove decimals from N. Docs, as well as reduce the avg. length decimals to 1.
We will probably need to add in the size for the cases where it is missing
there is one citation that does render properly

embeddings-benchmark / mteb

paper writing;: table overview of tasks #897