I tried using anonlink.similarities.dice_coefficient_accelerated_python as an alternative, and it did not produce the error. However, this alternative is significantly slower, making it impractical for large datasets.
I ran into a similar problem in https://github.com/data61/anonlink/issues/566, I put a PR there that hopefully fixes it. However, I'm not clear what the contribution guidelines are, so not sure how to move it forward.
When running the following code snippet on AWS Glue:
I encounter the following error:
I tried using anonlink.similarities.dice_coefficient_accelerated_python as an alternative, and it did not produce the error. However, this alternative is significantly slower, making it impractical for large datasets.