facebookresearch / labgraph

LabGraph is a Python framework for rapidly prototyping experimental systems for real-time streaming applications. It is particularly well-suited to real-time neuroscience, physiology and psychology experiments.
MIT License
162 stars 47 forks source link

LabGraph AudioGen #116

Open jfResearchEng opened 1 year ago

jfResearchEng commented 1 year ago

🚀 Feature

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

A command-line interface (CLI) is a means of interacting with a computer program by inputting lines of text called command-lines.

This project focuses on the following use cases using python-based CLI (i.e. python command) in a Windows environment: Given a text input (e.g. a dog is barking in a restaurant), generates the audio using musicGen Given a text input (e.g. happy mood in a rainy day), generates the music using audioGen Given a text description of a person’s daily activities, generate a series of music and audio Given a high fidelity audio input, conduct audio reconstruction using EnCodec

Additional context

Example application can be found here The code should be added at folder is https://github.com/facebookresearch/labgraph/tree/main/extensions/labgraph_audiogen Create setup.py and README.md, where example can be found at: https://github.com/facebookresearch/labgraph/tree/main/extensions/labgraph_viz Add github action support, reference: https://github.com/facebookresearch/labgraph/actions/workflows/main.yml Add proper license header.