dbt-labs / dbt-spark

dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
https://getdbt.com
Apache License 2.0
395 stars 221 forks source link

pin numpy to below 2.0 #1053

Closed McKnight-42 closed 3 months ago

McKnight-42 commented 3 months ago

resolves # docs dbt-labs/docs.getdbt.com/#

Problem

recent nypy release https://pypi.org/project/numpy/2.0.0/ seems to be causing issues with ci/cd

error seen in ci/cd

/databricks/python/lib/python3.7/site-packages/thinc/backends/numpy_ops.pyx in init thinc.backends.numpy_ops()
87: [1130.0s]   
87: [1130.0s]   ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject

Solution

StackOverflow article: https://stackoverflow.com/questions/78650222/valueerror-numpy-dtype-size-changed-may-indicate-binary-incompatibility-expec pin to below 2.0 release

Checklist

github-actions[bot] commented 3 months ago

Thank you for your pull request! We could not find a changelog entry for this change. For details on how to document a change, see the dbt-spark contributing guide.

mikealfare commented 3 months ago

Approved by @amychen1776 for backport to 1.6