Closed nhamilakis closed 1 year ago
With this a2faf4db936c6f4a3b62adb0c4065dfac06b9977 commit, i added the basic integration layout for the new benchmark.
When task is more clear, add :
With this edf89260609d94a81f24866d4a26727af5672696 commit added the continuation of a2faf4db936c6f4a3b62adb0c4065dfac06b9977
TODO:
- [ ] Leaderboard entry (once scores have been evaluated)
3f51bc122f62b909e9143109e99d5204969fdd4b fixes mismatch on prosody scoring by_pair.
Syntactic benchmark had transcription and by_pair scoring was done using transcriptions as id. For prosody benchmark transcription column is null, so by_pair scoring needs to contain id column to be identifiable.
d58a500f014915a9884387870ac46f45b9d71bef added leaderboard schema
d63e0585c236e92581ecf6b49ce3e9ae4bc79576 added leadereboard generation