Ayre

"... I'll support you!"

Ayre is a Visual Question Answering project created by members of this organization as part of our semester V projects and coursework during our Bachelor's degree. This is primarily a research based project, since Visual Question Answering with Sentiment Analysis is a significant research gap that we would like to address. This project will feature several components coming together as a complete full-stack AI project.

Planned/Implemented features [checklist]

AI

All AI development to done using Torch, for better support with transformers. (20/11/2023: Proof of concept is complete)

• [x] Sentiment Analysis on images using integrating fuzzy logic.
• [x] NEW: Semantic Image Segmentation for Improved Understanding of the image.
• [x] Visual Question Answering task using data from semantic segmentation
• [x] MLOps pipelines that can be easily imported and deployed inside the backend.
• [ ] (Future Work) At least 1 Journal and 1 Conference paper based on novel approaches made here.
• [ ] (Optional) HuggingFace integration (Probably future work now).

Frontend

A simple, beautiful UI/UX with the following features:

• [ ] Responsive Design for accessibility.
• [x] Light/Dark themes.
• [ ] OAuth integration, with some of the benefits.
• [ ] Deployment on Vercel/Github Pages.
• [ ] (Optional) A Loading screen.

Backend

• [x] Minimal and fast backend created in FastAPI.
• [x] Modular design for improved CI/CD.
• [x] Basic self-hosting for anywhere access.
• [ ] (Future Work) Database connectivity for live storage of queries and information.
• [ ] (Optional) Improved cloud-based hosting with accessible APIs.