an intermittent error that happens when I run batch jobs
[2024-06-19 01:22:13,885: ERROR/ForkPoolWorker-2] TypeError: Invalid attr. Exception handling: trying to convert invalid attrs to str: Invalid value for attr 'spec': RasterSpec(epsg=4326, bounds=(35.61721286854547, -0.199785319188288, 35.62736383125603, -0.18972418800614402), resolutions_xy=(8.9831528412e-05, 8.9831528412e-05)). For serialization to netCDF files, its value must be of one of the following types: str, Number, ndarray, number, list, tuple
[2024-06-19 01:22:15,595: ERROR/ForkPoolWorker-2] Task tensorlakehouse_openeo_driver.tasks.create_batch_jobs[d2ccddbf-c45a-45aa-87d4-cb68b1b5be81] raised unexpected: AttributeError("'Config' object has no attribute 'user_agent_appid'")
Traceback (most recent call last):
File "/opt/app-root/lib64/python3.9/site-packages/celery/app/trace.py", line 477, in trace_task
R = retval = fun(*args, **kwargs)
File "/opt/app-root/lib64/python3.9/site-packages/celery/app/trace.py", line 760, in __protected_call__
return self.run(*args, **kwargs)
File "/opt/app-root/src/tensorlakehouse-openeo-driver/tensorlakehouse_openeo_driver/tasks.py", line 87, in create_batch_jobs
cos_conn.upload_fileobj(
File "/opt/app-root/src/tensorlakehouse-openeo-driver/tensorlakehouse_openeo_driver/file_reader/cos_parser.py", line 130, in upload_fileobj
s3 = ibm_boto3.resource(
File "/opt/app-root/lib64/python3.9/site-packages/ibm_boto3/__init__.py", line 106, in resource
return _get_default_session().resource(*args, **kwargs)
File "/opt/app-root/lib64/python3.9/site-packages/ibm_boto3/session.py", line 532, in resource
client = self.client(
File "/opt/app-root/lib64/python3.9/site-packages/ibm_boto3/session.py", line 357, in client
return self._session.create_client(
File "/opt/app-root/lib64/python3.9/site-packages/ibm_botocore/session.py", line 1059, in create_client
client = client_creator.create_client(
File "/opt/app-root/lib64/python3.9/site-packages/ibm_botocore/client.py", line 160, in create_client
client_args = self._get_client_args(
File "/opt/app-root/lib64/python3.9/site-packages/ibm_botocore/client.py", line 492, in _get_client_args
return args_creator.get_client_args(
File "/opt/app-root/lib64/python3.9/site-packages/ibm_botocore/args.py", line 100, in get_client_args
final_args = self.compute_client_args(
File "/opt/app-root/lib64/python3.9/site-packages/ibm_botocore/args.py", line 235, in compute_client_args
preliminary_ua_string = self._session_ua_creator.with_client_config(
File "/opt/app-root/lib64/python3.9/site-packages/ibm_botocore/useragent.py", line 281, in to_string
*self._build_app_id(),
File "/opt/app-root/lib64/python3.9/site-packages/ibm_botocore/useragent.py", line 451, in _build_app_id
if self._client_config and self._client_config.user_agent_appid:
AttributeError: 'Config' object has no attribute 'user_agent_appid'
an intermittent error that happens when I run batch jobs