filecoin-project / devgrants

👟 Apply for a Filecoin devgrant. Help build the Filecoin ecosystem!
Other
369 stars 307 forks source link

NIIIFTY2 #1635

Closed edsilv closed 11 months ago

edsilv commented 1 year ago

Open Grant Proposal: NIIIFTY2

Project Name: NIIIFTY2

Proposal Category: Applications

Individual or Entity Name: Mnemoscene Ltd

Proposer: edsilv

Filecoin ecosystem affiliations: Web3.storage

Technical Sponsor: Dietrich Ayala

Do you agree to open source all work you do on behalf of this RFP under the MIT/Apache-2 dual-license?: Yes

Project Summary

This project proposal builds upon the success of Mnemoscene's previous Filecoin devgrant project, NIIIFTY.

We are delighted to have received positive feedback from our client Royal Holloway, demonstrating their interest in improving upon and testing the software for the benefit of their faculty and students.

Impact

In 2021, Mnemoscene successfully delivered the ARStoryDecks project for Royal Holloway as part of the StoryFutures Train the Trainer programme. This project introduced an augmented reality storytelling platform, enabling the display of 3D models on mobile devices using markers on cards. The project's success led to Will Shüler, Vice-Dean at Royal Holloway, being shortlisted for the prestigious Times Higher Education "Most Innovative Teacher of the Year" award.

However, a setback occurred several months after the project's launch when Google discontinued their 3D model hosting platform, known as "Poly." This platform played a crucial role in the ARStoryDecks project, and its closure meant that existing stories would no longer function, and new stories could not be created.

Furthermore, Royal Holloway has recently implemented an "Acting 360" course for their students, incorporating the use of 360-degree video hosted on YouTube. However, during a recent visit to Shanghai to build partnerships with other universities, they encountered a challenge. YouTube was inaccessible in China, preventing them from sharing these videos with their counterparts.

Outcomes

Royal Holloway is interested in leveraging the 3D model upload, compression, and retrieval capabilities of NIIIFTY. These features could serve as a viable alternative to the now defunct Google Poly platform, allowing them to revive the ARStoryDecks project. Additionally, they see value in NIIIFTY's utilisation of IPFS as a storage medium. This would ensure that their uploaded data is backed up in multiple locations, safeguarding against potential platform failures.

The implementation of IPFS also presents an attractive solution for storing their 360 video content, granting access to their Chinese partners via censor-proof URLs.

To proceed, we propose setting up a trial instance of NIIIFTY specifically for Royal Holloway. This will allow us to assess the ongoing running costs and determine the platform’s cost effectiveness.

Furthermore, we will make necessary modifications to the ARStoryDecks website, enabling it to load 3D models from Royal Holloway's NIIIFTY instance rather than relying on Google Poly. NIIIFTY will also require a new Google Poly style search function in order for ARStoryDecks users to be able to locate assets to use in their stories.

We aim to expand the capabilities of NIIIFTY to support the upload and preview of 360 video content.

We would also like to make uploaded content more discoverable via search by implementing auto-tagging of 3D model thumbnails and 360 videos using the Label Images with Cloud Vision AI and Label Videos with Cloud Video AI Firebase extensions.

Value

Deliverables

Adoption, Reach, and Growth Strategies

The target audience is higher education institutions running creative arts and design courses. There are 338 Universities in the UK alone who offer creative arts and design degrees. Currently we engage with Universities like Royal Holloway through programs like StoryFutures.

Royal Holloway will supply a cohort of students to test the application and prove its applicability in a higher education context.

Development Roadmap

Milestone 1: 3D model search and loading into ARStoryDecks

January 8th - March 15th 2024 10 weeks by one full stack developer

Milestone 2: 360 video

April 1st - April 19th 2024 4 weeks by one full stack developer

Milestone 3: Analytics

April 29th - May 10th 2024 2 weeks by one full stack developer

Milestone 4: Documentation

March 17th - March 28th 2025 2 weeks by one full stack developer

Total Budget Requested

Mnemoscene

Subtotal: $54,000.00

Royal Holloway

Staff time

Subtotal $28,900.00 (inc VAT)

Grand total: $82,900.00

Maintenance and Upgrade Plans

Potential paths forward for maintenance/upgrades will largely depend on uptake from the community and any further funded projects that emerge. It is our intention to promote NIIIFTY to this end.

Team

Team Members

Edward Silverton

Will Shüler

Team Member LinkedIn Profiles

https://www.linkedin.com/in/edsilv/

https://www.linkedin.com/in/will-sh%C3%BCler-a531085a/

Team Website

https://niiifty.com

https://www.royalholloway.ac.uk/

Relevant Experience

Edward Silverton is a full stack web developer with more than 20 years of experience, 10+ years of which working with galleries, libraries, archives, and museums. He is experienced in IPFS, nodejs, next.js, tailwindcss, and firebase, is the lead developer of NIIIFTY, the Universal Viewer, and Exhibit, and is co-chair of the IIIF 3D Technical Specification Group. He presented at the 2018 Internet Archive Decentralised Web Summit on the subject of P2P IIIF.

Will Shüler is the Vice Dean of Education and Student Experience for the School of Performing and Digital Arts at Royal Holloway, University of London, where he has worked as a Senior Lecturer in Drama and Theatre Studies since 2014. He has experience developing funded pedagogic projects integrating new technologies in performance training, including storytelling for Cinematic Virtual Reality and actor training for Volume LED Virtual Production. His published work ranges from articles in Times Higher Education such as “Augmented Reality in Teaching: Key Challenges and How to Overcome Them” and book chapters such as “The Emancipated Educator: Chance, Will and Intellectual Equality in Higher Education Role-Immersion Pedagogies” in Rancière and Performance (paperback re-release 2023).

Team code repositories

https://github.com/NIIIFTY

Additional Information

I learned about the Open Grants Program from contacts at Protocol Labs.

Please contact ed@mnemoscene.io to discuss the grant agreement and general next steps.

ErinOCon commented 11 months ago

Hi @edsilv, thank you for your proposal and for your patience with our review. Unfortunately, we will not be proceeding with a grant at this time. Wishing you all the best as you continue to build!