[Real Life Improvement] Develop Large Language Model on NVIDIA Jetson Devices and enable the control of interfaces on the board

[MatthewJeffson]

Overview

• We need your help to deploy a large language model on NVIDIA Jetson devices and allow people can use words to control the connections/interfaces on the board.
• This is the preparation for allowing the NVIDIA Jetson connecting with Home Assistant devices.

  What we are trying to present:

• Using any functional large language language model is fine.
  • Official NVIDIA website all things Jetson and AI
  • Github repository
• There are multiple AI-powered NVIDIA Jetson devices(maximum 200TOPS) in Seeed Studio:
  • the comparison between the NVIDIA Jetson powered devices
  • The different carrier boards for different interfaces
• Other references might be helpful:
  • What is MiniGPT-4? A Deep Dive in Multimodal LLM and Deploy on Jetson Orin
  • Deploy LLM into Jetson
  • Build an AI Chatbot Using Riva and OpenAI

How do we work together?

• Leave a comment with your GitHub name below as you accept this assignment and will complete the contents about what we are trying to present.
• The maintainer will assign and record you as our only contact for this assignment.
• You can first Deploy this Wiki Platform Locally (The entire source code .zip file is only 30 M)
• You will be invited as our "Contributor" once you "Pull Request".
• The maintainer will review the PR and then merge.

  What do we offer?

  We want to express our gratitude to our contributors by offering a range of rewards. Depending on the difficulties(Tier 0/1/2/3), the time we expect(Days 1/3/7/15), the actual submission time and the actual submission contents, we will offer different levels of rewards.

  1. We will provide our products or cash bonus to our contributors as a token of appreciation.
  2. For those contributors who join our "Ranger Program", we offer even more exciting rewards, including access to our prototype products.
  3. In addition, all contributors and their contributions will be acknowledged and showcased on our wiki platform.

     FAQ

• For any question, the contributor can directly commend here.

  I think I can complete the assignment, but I need more time?

• The timeframe here is based on our old experience, from people who has done it or something like that.
• However, many projects will take much more time under actual circumstances (including the main language of the contributors receiving the task and the actual creative difficulty)
• You can leave the time you need and a brief reason, we will evaluate the situation accordingly.

[feiticeir0]

Hi ! I would love this assignment. I'm waiting on my Jetson Nano (bought from you) . It should arrived during next week.

Feiticeir0

Thank you

[MatthewJeffson]

Wow! Nicce! and thank you!

[MatthewJeffson]

The assignment has been reopened.

[kouroshkarimi]

Hi @MatthewJeffson I can work on this if it is OK.