Tools ranking

[diglesia]

Where can we place the final ranking/comparison of the tools for a benchmarking event? This information has not been included in the data model yet: are we going to store it or it will be just a way to visualize the results?. Should we use benchmarkingEvent to that end?

[jlgelpi]

For me this is just another type of report. If it is a kind of fixed schema could be included in the Event

Sent from my phone

-------- Mensaje original -------- De: Diana de la Iglesia notifications@github.com Fecha: 05/05/2017 7:57 (GMT+01:00) Para: inab/benchmarking-data-model benchmarking-data-model@noreply.github.com Cc: Subscribed subscribed@noreply.github.com Asunto: [inab/benchmarking-data-model] Tools ranking (#13)

Where can we place the final ranking/comparison of the tools for a benchmarking event? This information has not been included in the data model yet: are we going to store it or it will be just a way to visualize the results?. Should we use benchmarkingEvent to that end?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/inab/benchmarking-data-model/issues/13, or mute the threadhttps://github.com/notifications/unsubscribe-auth/APVhnYV0PYlREKnROEoMUNJYq04MkUxFks5r2rolgaJpZM4NRhdp.

Aquest correu electrònic i els annexos poden contenir informació confidencial o protegida legalment i està adreçat exclusivament a la persona o entitat destinatària. Si no sou el destinatari final o la persona encarregada de rebre’l, no esteu autoritzat a llegir-lo, retenir-lo, modificar-lo, distribuir-lo, copiar-lo ni a revelar-ne el contingut. Si heu rebut aquest correu electrònic per error, us preguem que n’informeu al remitent i que elimineu del sistema el missatge i el material annex que pugui contenir. Gràcies per la vostra col·laboració.

Este correo electrónico y sus anexos pueden contener información confidencial o legalmente protegida y está exclusivamente dirigido a la persona o entidad destinataria. Si usted no es el destinatario final o la persona encargada de recibirlo, no está autorizado a leerlo, retenerlo, modificarlo, distribuirlo, copiarlo ni a revelar su contenido. Si ha recibido este mensaje electrónico por error, le rogamos que informe al remitente y elimine del sistema el mensaje y el material anexo que pueda contener. Gracias por su colaboración.

This email message and any documents attached to it may contain confidential or legally protected material and are intended solely for the use of the individual or organization to whom they are addressed. We remind you that if you are not the intended recipient of this email message or the person responsible for processing it, then you are not authorized to read, save, modify, send, copy or disclose any of its contents. If you have received this email message by mistake, we kindly ask you to inform the sender of this and to eliminate both the message and any attachments it carries from your account. Thank you for your collaboration.

[diglesia]

See issue #12

[JuergenHaasSIB]

I would not include a single ranking in the data coming from a certain community. There are several aspects to any prediction community and one ranking cannot reflect that properly. Either none at all and openEBench provides rankings - that would raise the question which scores are most important that the community has to provide.

I envision that the communities have to define several rankings or at least the top 5 scores such as "binding site accuracy", "quaternary state correctness", "model confidence", and others. In this way it is clear for openEBench which ones to aggregate and advertise in the spiderweb or similar plots.

[jmfernandez]

Changes from 1c6121e4e8318ceb0d47618bc212ae978f7e81e3 allow attaching datasets to the benchmarking event, including the "final" results.