quantile-development / dagster-meltano

A Dagster plugin that allows you to run Meltano in Dagster
MIT License
42 stars 17 forks source link

asyncio.exceptions.LimitOverrunError: Separator is found, but chunk is longer than limit #25

Closed jlloyd-widen closed 1 year ago

jlloyd-widen commented 1 year ago

One of my pipelines is getting this error when running: asyncio.exceptions.LimitOverrunError: Separator is found, but chunk is longer than limit

I assume this can be solved by increasing the limit on the asyncio.subprocess.create_subprocess_exec call, though I'm not entirely sure what an appropriate limit would be. Suggestion coming from this stackoverflow post.