Implementing RESTful web services for EvalAI

deshraj commented 7 years ago

Project Title: Implementing RESTful web services for EvalAI

Description: is an evaluation server that will host AI challenges like Visual Question Answering, Image Captioning. Our next goal of this project is to implement REST APIs. Some of the initial tasks include:

~~Add setInterval to API calls to get real-time data (see https://github.com/Cloud-CV/EvalAI/issues/653)~~ (Already fixed)
Setup Continuous Deployment for EvalAI.
Add integration tests using Selenium
~~Enforce unique random file name for files being uploaded~~ (Already fixed)
~~Create notification system for EvalAI~~ (Already fixed)
Add number of concurrent request metric in metrics middleware
Build a newsfeed for EvalAI (see https://github.com/Cloud-CV/EvalAI/issues/664)
Build a dashboard for participants and hosts where they can analyze the submissions for a competition and get relevant insights
Export the leaderboard table to Latex / PNG
Webhooks for integrating it with other services / sites / chat-bots etc
Scale the worker nodes system to run multiple competitions in the most optimal manner.
Create an EvalAI badging system for the challenge evaluation script, challenge submissions, and top 10 leaderboard entries. For reference, see this https://github.com/badges/shields

Besides this, students should also provide ideas of their own.

Deliverable: the issues mentioned above should be implemented by the end of the GSoC period. Moreover, we expect students to also have implemented improvements that they have proposed.

Mentor: Taranjeet Singh @TroJan, Akash Jain @aka-jain, Shiv Baran Singh @spyshiv

Co-Mentor: Deshraj Yadav @deshraj

Skills: AngularJS, Python, Django

Skill Level: Medium

Get started: Take a look at our issues on Github. Try to fix some (note that there are some issues labeled with GSOC).

muddlebee commented 7 years ago

Currently EvalAi uses ES5. Would it be any good including the idea of migrating from ES5 to ES6 ?

aka-jain commented 7 years ago

@anweshknayak thanks for your suggestion, but shifting whole app from ES5 to ES6 will take huge time, basically then we have to revamp the whole site. Means, then we should have to go with Angular2 or React. And at this point when our app is almost in stable condition it will not be a good option to migrate to ES6. And we had this in our list from very begning. Will let everyone know once we decided in case of migrating. Thanks :)

AnshulBasia commented 7 years ago

@deshraj Can you please elaborate the point Export Table to Latex / PNG ??

Ragib95 commented 7 years ago

Hey,I am Dilnawaz Ragib pre-final year UG student at IIT Kharagpur. I want to be part of this project for GSoC. I have previous experience with Python and Django. What I need to do before submitting a proposal?

deshraj commented 7 years ago

Hi @Ragib95 please see our GSOC website http://gsoc.cloudcv.org. There is a patch requirement for each project that you need to satisfy. Please see https://github.com/Cloud-CV/GSoC-Ideas/wiki/Patch-Requirement for more details.

esikachev commented 7 years ago

Hello! Can I work on CI/CD part?

amittbhardwj commented 7 years ago

Greetings, Right now I am occupied with my school examinations. But, I plan to contribute to the CloudCV after April 2. Is it okay to fulfil minimum patch requirement in the week starting April 3?

deshraj commented 7 years ago

HI @amittbhardwj, the patch requirement is not mandatory. It is just to make sure that you have a good sense of the projects going on. It would be great if you can submit patch ASAP after 3rd April.

guyandtheworld commented 7 years ago

@deshraj Are the issues that are not striked off still available for taking?

RishabhJain2018 commented 7 years ago

@isht3 Please take a look here . You can take up any unassigned issue. :)

Cloud-CV / GSoC-Ideas

Implementing RESTful web services for EvalAI #2