search

spongedsc / pathways

Pathways: multi-modal AI/ML models on discord
GNU Affero General Public License v3.0
3 stars 1 forks source link

Image recognition for GIFs & external links #51

Open artifishvr opened 1 month ago

artifishvr commented 1 month ago

My thoughs for this one is we can image recognition the first frame for a gif, and provide it to the bot as something like Attached:[recognized]. Please note that this is a GIF but due to technical limitations this description is of only the first frame.

daniwasonline commented 1 month ago

I'm primarily concerned about the external links because of safety. Would we have to create a dedicated proxy server for the bot to access the internet? This isn't just a concern with this case in particular, as #72 would also face a similar issue with safely accessing the internet.

artifishvr commented 1 month ago

for this one, could do something like how esmBot does it, https://github.com/esmBot/esmBot/blob/master/utils/imagedetect.js