dlt-hub / verified-sources

Contribute to dlt verified sources 🔥
https://dlthub.com/docs/walkthroughs/add-a-verified-source
Apache License 2.0
52 stars 40 forks source link

[enhancement] add include_custom_props to hubspot source #404

Closed cmpadden closed 3 months ago

cmpadden commented 3 months ago

Tell us what you do here

Related Issues

Was experiencing the same issue as #330.

<class 'dlt.extract.exceptions.ResourceExtractionError'>
In processing pipe companies: extraction of resource companies in generator companies caused an exception: Your request to Hubspot is too long to process. Maximum allowed query length is 2000 symbols, while your list of properties `about_us,address,address2,admin__c,annualrevenue,arr__c,auto_renew__c,channel_partner__c,cicd_provider__c,city,closedate,closedate_timestamp_earliest_value_a2a17e6e,cloud_credits__c,cloud_provider__c,`... is 2854 symbols long. Use the `props` argument of the resource to set t

This introduced a top-level parameter to disable the custom props on all resources.