airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
14.87k stars 3.82k forks source link

:sparkles: Source AppsFlyer : Migrate Python CDK to Low-code CDK #28108

Open RealChrisSean opened 1 year ago

RealChrisSean commented 1 year ago

https://docs.airbyte.com/integrations/sources/appsflyer

Rules for the Connectors Hackathon You can only work on one connector at a time Make sure to resolve all suggestions from the Airbyte team Must include all streams of the connector you’re migrating. Otherwise, it will not be accepted. If you don’t commit anything within five days, the issue may be assigned to someone else.

RealChrisSean commented 11 months ago

Hello this has been assigned to you. You can learn more about our low-code/no-code docs here: https://airbyte.com/solutions/connector-development-kit

You can find more information on our landing page: https://airbyte.com/community/connector-hackathon

Good luck!

parthiv11 commented 11 months ago

i want to give it a try

RealChrisSean commented 11 months ago

Good luck this has been assigned to you :)

parthiv11 commented 11 months ago

Sorry @RealChrisSean , I am not familiar with AppsFlyer and it seems difficult to setup demo account for test creds.

anjshrg commented 10 months ago

@RealChrisSean Would like to give this a try.

KimuchuJr commented 9 months ago

I would like to give this a try.

justinbchau commented 9 months ago

Has been more than 5 days and no commits have come through so I am unassigning. This is now open!

abu-hasib commented 9 months ago

@justinbchau I want to work on this.

abu-hasib commented 8 months ago

hey @justinbchau, I'm getting this error when i try to run python3 main.py spec

Traceback (most recent call last):
  File "/Users/thisbo/oss/airbyte/airbyte-integrations/connectors/source-appsflyer/main.py", line 9, in <module>
    from source_appsflyer import SourceAppsflyer
  File "/Users/thisbo/oss/airbyte/airbyte-integrations/connectors/source-appsflyer/source_appsflyer/__init__.py", line 6, in <module>
    from .source import SourceAppsflyer
  File "/Users/thisbo/oss/airbyte/airbyte-integrations/connectors/source-appsflyer/source_appsflyer/source.py", line 5, in <module>
    from airbyte_cdk.sources.declarative.yaml_declarative_source import YamlDeclarativeSource
  File "/Users/thisbo/oss/airbyte/airbyte-integrations/connectors/source-appsflyer/.venv/lib/python3.11/site-packages/airbyte_cdk/sources/declarative/yaml_declarative_source.py", line 8, in <module>
    from airbyte_cdk.sources.declarative.manifest_declarative_source import ManifestDeclarativeSource
  File "/Users/thisbo/oss/airbyte/airbyte-integrations/connectors/source-appsflyer/.venv/lib/python3.11/site-packages/airbyte_cdk/sources/declarative/manifest_declarative_source.py", line 27, in <module>
    from airbyte_cdk.sources.declarative.parsers.model_to_component_factory import ModelToComponentFactory
  File "/Users/thisbo/oss/airbyte/airbyte-integrations/connectors/source-appsflyer/.venv/lib/python3.11/site-packages/airbyte_cdk/sources/declarative/parsers/model_to_component_factory.py", line 16, in <module>
    from airbyte_cdk.sources.declarative.auth.token import (
  File "/Users/thisbo/oss/airbyte/airbyte-integrations/connectors/source-appsflyer/.venv/lib/python3.11/site-packages/airbyte_cdk/sources/declarative/auth/token.py", line 12, in <module>
    from airbyte_cdk.sources.declarative.auth.token_provider import TokenProvider
  File "/Users/thisbo/oss/airbyte/airbyte-integrations/connectors/source-appsflyer/.venv/lib/python3.11/site-packages/airbyte_cdk/sources/declarative/auth/token_provider.py", line 31, in <module>
    @dataclass
     ^^^^^^^^^
  File "/usr/local/Cellar/python@3.11/3.11.2_1/Frameworks/Python.framework/Versions/3.11/lib/python3.11/dataclasses.py", line 1220, in dataclass
    return wrap(cls)
           ^^^^^^^^^
  File "/usr/local/Cellar/python@3.11/3.11.2_1/Frameworks/Python.framework/Versions/3.11/lib/python3.11/dataclasses.py", line 1210, in wrap
    return _process_class(cls, init, repr, eq, order, unsafe_hash,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/Cellar/python@3.11/3.11.2_1/Frameworks/Python.framework/Versions/3.11/lib/python3.11/dataclasses.py", line 958, in _process_class
    cls_fields.append(_get_field(cls, name, type, kw_only))
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/Cellar/python@3.11/3.11.2_1/Frameworks/Python.framework/Versions/3.11/lib/python3.11/dataclasses.py", line 815, in _get_field
    raise ValueError(f'mutable default {type(f.default)} for field '
ValueError: mutable default <class 'airbyte_cdk.sources.declarative.decoders.json_decoder.JsonDecoder'> for field _decoder is not allowed: use default_factory
abu-hasib commented 8 months ago

nothing from the searches so far

abu-hasib commented 8 months ago

@RealChrisSean

jonwihl commented 7 months ago

@abu-hasib I ran into the same issue, did you ever end up resolving it?

maver1ck commented 6 months ago

Same problem here.

maver1ck commented 6 months ago

@abu-hasib it should be fixed by https://github.com/airbytehq/airbyte/pull/33798

anjshrg commented 6 months ago

@maver1ck @abu-hasib issue is because appsflyer API returns a CSV. Can you please help me understand how #33798 will help in this case?

Jeroendevr commented 2 weeks ago

@abu-hasib this could also be related due the fact you used python 3.11.x using python 3.10.14 did not gave me an error.