search

poboisvert / GPTARS_Interstellar

TARS from Interstellar x ChatGPT
https://i.ibb.co/JqcmVM3/Screenshot-2024-07-06-at-8-47-09-PM.png
43 stars 5 forks source link

Feature: Add a camera and microphone so TARS can see you and hear you. #2

Open rkeshwani opened 1 month ago

rkeshwani commented 1 month ago

GPT models are now multi-modal so would be nice if the cad file had a spot for a camera that could be connected. Same goes for the microphone.

poboisvert commented 1 month ago

You can find on Youtube tutorial to extrude the"spots" required to add microphone and camera

JFerguson576 commented 1 month ago

Hi guys,

Has anyone got working code for TARs CHATGPT integration (with voice and mobility control) that they are willing to share please?

Thank you.

John

John Ferguson

From: Pierre-Olivier @.> Sent: Monday, August 12, 2024 2:33:59 AM To: poboisvert/GPTARS_Interstellar @.> Cc: Subscribed @.***> Subject: Re: [poboisvert/GPTARS_Interstellar] Feature: Add a camera and microphone so TARS can see you and hear you. (Issue #2)

You can find on Youtube tutorial to extrude the"spots" required to add microphone and camera

— Reply to this email directly, view it on GitHubhttps://github.com/poboisvert/GPTARS_Interstellar/issues/2#issuecomment-2282781559, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACE2SAAOTWGB7PYQCT5SNK3ZQ5Y5PAVCNFSM6AAAAABMKISFOKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOBSG44DCNJVHE. You are receiving this because you are subscribed to this thread.Message ID: @.***>

rkeshwani commented 1 month ago

You could use function calling from large language models to call python functions to connect to movement and other functionality. For voice I suggest taking a look at https://github.com/coqui-ai/TTS.

rkeshwani commented 1 month ago

@poboisvert I'll take a look, not much recent experience with CAD. Do you have any free software suggestions? I have FreeCAD installed but I find the navigation a little clunky. Also, I was unable to download the file linked here but I was able to access the original. It seems at first glance that the hands are partially completed but might be due to my own ignorance around how the CAD software works. I see it is completed piecemeal. Example, no idea where smaller servos go. The arms appear to be partially completed but not linked to any servo. I am wanting to use aluminum for the outside and plastic for the inside but trying to figure out the best way to sort out the internal components.

SAMSAMPOP commented 1 month ago

I too am struggling with the code for TARs CHATGPT integration. Am currently working through the python scripts. I have the internals assembled and just calling the tars_runner.py file. I did get the servos working but it's stopped for some reason. Anyway, if anyone has success with the TARS voice and is happy to share I would be super grateful. Thank you