Until today (30 Dec 2022), everything was working fine. But, now I am getting below exception.
InternalServiceException: An error occurred (InternalServiceException) when calling the SearchTables operation (reached max retries: 4): Unknown exception occurred.
When I decrease the number of filters to 10, it works fine. But when I make it >10, it is giving error. Normally, there were no limitation on number of filters that you can use. When I check AWS documentation, it is also not mentioning any kind of limitation.
Is it possible that AWS added a new limitation but not updated their documentation?
I wanted to test it myself. It is definitely something related to AWS limitations. But then, why is it not mentioned in the documentation? Check below image. I have tried with 10 filters and 11 filters. 10 filters works fine, but 11 filters gives error.
ghost
commented
1 year ago
I had a job running everyday that uses aws glue search tables api. I also had a filter to get results only for certain databases.
"Filter" = {"Key": "DatabaseName", "Value": "my_db"}Until today (30 Dec 2022), everything was working fine. But, now I am getting below exception.
InternalServiceException: An error occurred (InternalServiceException) when calling the SearchTables operation (reached max retries: 4): Unknown exception occurred.When I decrease the number of filters to 10, it works fine. But when I make it >10, it is giving error. Normally, there were no limitation on number of filters that you can use. When I check AWS documentation, it is also not mentioning any kind of limitation.
https://docs.aws.amazon.com/glue/latest/webapi/API_SearchTables.html
Is it possible that AWS added a new limitation but not updated their documentation?
I wanted to test it myself. It is definitely something related to AWS limitations. But then, why is it not mentioned in the documentation? Check below image. I have tried with 10 filters and 11 filters. 10 filters works fine, but 11 filters gives error.