search

DeepDriveMD / DeepDriveMD-pipeline

DeepDriveMD: Deep-Learning Driven Adaptive Molecular Simulations
MIT License
15 stars 9 forks source link

Document Too Large #57

Open tkram01 opened 1 year ago

tkram01 commented 1 year ago

Hello,

I am trying to run the BBA integration test with an added aggregation step and I am getting this error which indicates it is trying to write a document larger than 16MB into MongoDB. There are no other errors reported. I've attached the config to this report.

1673773733.517 : re.session.ip-10-23-253-246.ubuntu.019370.0001 : 140303 : 140575344944896 : ERROR    : pymongo error: {'index': 0, 'code': 17419, 'errmsg': 'Resulting document after update is larger than 16777216'}
Traceback (most recent call last):
  File "/home/ubuntu/env/lib/python3.7/site-packages/radical/pilot/db/database.py", line 285, in pilot_command
    multi=True)
  File "/home/ubuntu/env/lib/python3.7/site-packages/pymongo/collection.py", line 3675, in update
    collation=collation,
  File "/home/ubuntu/env/lib/python3.7/site-packages/pymongo/collection.py", line 962, in _update_retryable
    (write_concern or self.write_concern).acknowledged and not multi, _update, session
  File "/home/ubuntu/env/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1644, in _retryable_write
    return self._retry_with_session(retryable, func, s, None)
  File "/home/ubuntu/env/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1532, in _retry_with_session
    return self._retry_internal(retryable, func, session, bulk)
  File "/home/ubuntu/env/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1565, in _retry_internal
    return func(session, sock_info, retryable)
  File "/home/ubuntu/env/lib/python3.7/site-packages/pymongo/collection.py", line 958, in _update
    retryable_write=retryable_write,
  File "/home/ubuntu/env/lib/python3.7/site-packages/pymongo/collection.py", line 907, in _update
    _check_write_command_response(result)
  File "/home/ubuntu/env/lib/python3.7/site-packages/pymongo/helpers.py", line 249, in _check_write_command_response
    _raise_last_write_error(write_errors)
  File "/home/ubuntu/env/lib/python3.7/site-packages/pymongo/helpers.py", line 222, in _raise_last_write_error
    raise WriteError(error.get("errmsg"), error.get("code"), error)

lassen-integration.txt