search

instill-ai / instill-core

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
https://www.instill.tech
Other
2.17k stars 107 forks source link

[Feature] [VDP] [Components] Connects AI vendors #1024

Open chuang8511 opened 5 months ago

chuang8511 commented 5 months ago

Is There an Existing Issue for This?

Where do you intend to apply this feature?

Instill Core, Instill Cloud

Is your Proposal Related to a Problem?

Background

We want users to have more optional models to be used

Describe Your Proposed Solution

User Stories

Highlight the Benefits

The users can use more and more models in VDP

Anything Else?

Planned Components

Milestones

  1. Please create the skeleton PR first for the incoming components
  2. Connect those components.
  3. Build the designed pipeline after you connect those components.
linear[bot] commented 5 months ago

INS-5025 [Feature] [VDP] [Components] Connects AI vendors

namwoam commented 4 months ago

We can differentiate the AI vendors into the following three category: PaaS (Platform as a service) Providers, which requires complex IAM authentication and project permission settings.

  1. [ ] GCP (Google)
  2. [ ] AWS (Amazon)
  3. [ ] Azure (Microsoft)
  4. [ ] Watsonx (IBM)

  5. [ ] Oracle Cloud Infrastructure MaaS (Model as a service) Providers, which often use simple API keys and serverless model endpoint.

    1. [x] OpenAI - Proprietary text foundation models & image generation model
    2. [x] Anthropic - Proprietary text foundation models
    3. [x] Cohere - Proprietary text foundation models specialized on RAG usecase
    4. [x] Mistral AI - Proprietary & OSS text foundation models
    5. [x] Fireworks AI link - Serverless hosting for OSS models
    6. [x] AI21 labs link - Proprietary text foundation models & task-specific models
    7. [ ] Upstage link - Proprietary text foundation models specialized in Korean
    8. [ ] Voyage AI link - Proprietary domain-specific text embedding model
    9. [ ] Deep infra link - Serverless hosting for OSS models
    10. [ ] Deepgram link - Proprietary audio <-> text models
    11. [ ] unstructured link - Data Pre-processing
    12. [ ] Jina AI link - Proprietary text embedding model & Data Pre-processing
    13. [ ] BRIA link - Proprietary image generation model
    14. [ ] Nvidai NIM link - Serverless hosting for OSS models
    15. [ ] Lamini link - Serverless hosting for OSS models
    16. [ ] Together AI link - Serverless hosting for OSS models
    17. [ ] Groq SaaS (Software as a service), which often could only be accessed via GUI, thus impossible to integrate into VDP example: OpenArt link

    Others:

  6. [x] Ollama link OSS model self-hosting solution.