huggingface / unity-api

Apache License 2.0
305 stars 25 forks source link

[FEATURE REQUEST] Implement AudioClassification Task for CLAP Models #22

Open DavidLMS opened 5 months ago

DavidLMS commented 5 months ago

Is your feature request related to a problem? Please describe. Currently, the Unity API for Hugging Face does not support the AudioClassification task, particularly for CLAP models. This limits the potential for developing interactive applications and games that can utilize audio recognition capabilities in Unity.

Describe the solution you'd like I would like to see the implementation of the AudioClassification task in the Hugging Face Unity API, with support for CLAP models, especially the 'laion/clap-htsat-unfused' model (https://huggingface.co/laion/clap-htsat-unfused). This would enable Unity developers to integrate advanced audio classification features into their applications, enhancing interactivity and user engagement.

Additional context The CLAP model (https://huggingface.co/docs/transformers/model_doc/clap) has significant potential for applications in game development and interactive experiences where audio input can trigger specific actions or responses. Implementing this feature in the Unity API would greatly benefit developers looking to explore innovative audio-based interactions in their projects.