Debug issues with source-airtable connector

[aaronsteers]

Summary

The Airtable source is having issues when run in PyAirbyte. The goal is to replicate and document any observed issues and then propose a fix.

Resources to Assist

• PyAirbyte tutorials: https://github.com/airbytehq/quickstarts/tree/main/pyairbyte_notebooks
• PyAirbyte Documentaton: https://docs.airbyte.com/using-airbyte/pyairbyte/getting-started
• PyAirbyte API Reference: https://docs.airbyte.com/using-airbyte/pyairbyte/getting-started#api-reference
• Source-linkedin-ads documentation: https://docs.airbyte.com/integrations/sources/linkedin-ads

[puru-khedre]

Hello @aaronsteers, Please give it to me, I wanted to work on it

[marcosmarxm]

Hello @puru-khedre do you need any help?

[puru-khedre]

Hello 👋 @marcosmarxm, I don't understand what to do in this

[marcosmarxm]

@puru-khedre the idea is to see if you are able to run a sync using the source-airtable using PyAirbyte. If when you try get any error the idea is to report them here.

[fvgm-spec]

Hi @puru-khedre and @marcosmarxm I was reading a bit about this issue, and I think I can work on it, I currently work on a daily basis with Airtable datasets and Airtable API, could I take it or collaborate on this issue?

[marcosmarxm]

@puru-khedre let's @fvgm-spec work on this and select another one issue.

[marcosmarxm]

@fvgm-spec all yours

[fvgm-spec]

I have followed these steps to debug syncing data stored in Airtable using the source-airtable PyAirbyte connector:

1. Loaded some data in Airtable using Airteble API:

2. Once data is loaded into Airtable:

3. I have tried to sync with the data source using pyairbyte

4. I have previously set the variables for personal_access_token, refresh_token, client_id and client_secret, but still getting a syncing error:

[fvgm-spec]

Authentication succeeds with Airbyte OOS

[fvgm-spec]

Hi @marcosmarxm @aaronsteers please let me know if you'd need further debugging/research on this issue. Regards.

[aaronsteers]

@fvgm-spec - Do I correctly understand (in summary) that auth or config is still not working as expected when run via PyAirbyte? From the error log above, it looks like we might need an auth_method key within the credentials dictionary expression here:

If you have not already, could you try that and let us know if the source is able to authenticate?

[aaronsteers]

From what I can see from the above, other users have probably run into the same challenges in configuring the source with OAuth. It looks like you've tackled the hard part of getting OAuth secrets using localhost redirects. Hoping that the rest is just config nuance. 🤞

[fvgm-spec]

Hi @aaronsteers , yes the source is authenticating successfully, please let me know if you need further details:

[marcosmarxm]

Hi @aaronsteers , yes the source is authenticating successfully, please let me know if you need further details:

From this image it doesn't look the source is working with PyAirbyte. Can you check again @fvgm-spec