FIRST-Tech-Challenge / fmltc

FIRST Machine Learning Toolchain
Other
38 stars 14 forks source link

Exception while producing dataset #209

Closed lizlooney closed 2 years ago

lizlooney commented 2 years ago

I've seen this twice in the prod logs.

traceback: Traceback (most recent call last):

File "/workspace/action.py", line 177, in __perform_action ...     action_fn(action_parameters) ...  
File "/workspace/dataset_producer.py", line 117, in produce_dataset ...     storage.dataset_producer_starting( ...  
File "/workspace/storage.py", line 919, in dataset_producer_starting ...     transaction.put(team_entity) ...  
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/google/cloud/datastore/batch.py", line 328, in __exit__ ...     self.commit() ...  
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/google/cloud/datastore/transaction.py", line 298, in commit ...     super(Transaction, self).commit(**kwargs) ...  
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/google/cloud/datastore/batch.py", line 300, in commit ...     self._commit(retry=retry, timeout=timeout) ...  
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/google/cloud/datastore/batch.py", line 257, in _commit ...     commit_response_pb = self._client._datastore_api.commit( ...  
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/google/cloud/datastore_v1/services/datastore/client.py", line 627, in commit ...     response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,) ...  
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/google/api_core/gapic_v1/method.py", line 145, in __call__ ...     return wrapped_func(*args, **kwargs) ...  
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/google/api_core/grpc_helpers.py", line 69, in error_remapped_callable ...     six.raise_from(exceptions.from_grpc_error(exc), exc) ...  
File "<string>", line 3, in raise_from ... google.api_core.exceptions.InvalidArgument: 400 cannot write more than 500 entities in a single call