search

huggingface / huggingface-llama-recipes

532 stars 60 forks source link

Combine LLaMA with Image Segmentation using SAM 2 #48

Open farukalamai opened 1 month ago

ariG23498 commented 1 month ago

Hi @farukalamai

We appreciate your eagerness to work on this repository and start with your contribution. It would be great to add a description of what you think would be doing.

As I understand from the title, you would like to add Llama with SAM, but a more detailed description would help us brain storm together and make this more impactful!

Sakalya100 commented 1 month ago

Hi @farukalamai I really love the idea of this issue and would like to contribute to it. Are you currently working on this issue? If yes can you share what progress is already made and what exactly are you planning to include in the notebook.

Let me know and I would be happy to contribute!

Sakalya100 commented 1 month ago

Hi @ariG23498

I am not sure if @farukalamai is working on it. I have some initial idea and would like to start working on it.

This is my idea for a notebook that combines LLaMA and SAM 2

  1. Integrates LLaMA and SAM 2 for natural language-guided image segmentation
  2. Create a step by step process from loading relevant models, integrating and doing the final image-segmentation task
  3. Include visualization of segmentation results at the end

Let me know your thoughts!