airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.53k stars 4k forks source link

[api] `source-google-drive` Not able to create source from airbyte API #35653

Open Marcus0086 opened 6 months ago

Marcus0086 commented 6 months ago

Connector Name

google-drive

Connector Version

0.0.9

What step the error happened?

Configuring a new connector

Relevant information

Not able to create google-drive source with Airbyte API. I tried creating other sources, they are working fine.

Relevant log output

Request Body: 

{
  "configuration": {
    "sourceType": "google-drive",
    "credentials": {
      "auth_type": "Client",
      "client_id": "fgbdfvdfv",
      "client_secret": "fcdfvdfvdfv",
      "refresh_token": " dsffdvdfvdf"
    },
    "streams": [
      {
        "globs": [
          "**/*.pdf",
          "**/*.doc",
          "**/*.docx",
          "**/*.ppt",
          "**/*.pptx"
        ],
        "validation_policy": "Skip Record",
        "days_to_sync_if_history_is_full": 3,
        "format": {
          "filetype": "unstructured",
          "processing": {
            "mode": "local"
          },
          "skip_unprocessable_files": true,
          "strategy": "fast"
        },
        "schemaless": false,
        "primary_key": "document_key",
        "name": "GDrive"
      }
    ],
    "folder_url": "https://drive.google.com/drive/folders/12345678"
  },
  "workspaceId": "cd9a2509-0f1b-452b-8b13-563e8135b5cf",
  "name": "Gdrive"
}

Response: 
{
  "type": "https://reference.airbyte.com/reference/errors",
  "detail": "Submitted value could not be found: google-drive",
  "title": "value-not-found",
  "status": 400
}

Contribute

cbarceloc commented 5 months ago

It happens the same to me...when I try to Initiate OAuth for a source or to create a source, the source type "google-drive" is not found. You can test it from the docs: https://reference.airbyte.com/reference/createsource.

The request: `const options = { method: 'POST', headers: { accept: 'application/json', 'content-type': 'application/json', authorization: 'Bearer xxxxxx' }, body: JSON.stringify({ configuration: { sourceType: 'google-drive', credentials: {auth_type: 'Client'}, folder_url: 'https://drive.google.com/drive/folders/1Xaz0vXXXX2enKnNYU5qSt9NS70gvMyYn' }, name: 'test', workspaceId: 'xxxxx-yyyyy-zzzzz' }) };

fetch('https://api.airbyte.com/v1/sources', options) .then(response => response.json()) .then(response => console.log(response)) .catch(err => console.error(err));`

The response:

{ "title": "value-not-found", "message": "Submitted value could not be found: google-drive", "type": "https://reference.airbyte.com/reference/errors" }