Lilypad-Tech / lilypad-modicum

This is the deprecated Lilypad v1. See https://github.com/bacalhau-project/lilypad for v2. Previous FEVM-Bacalhau bridge (v0): https://github.com/bacalhau-project/lilypad-v0
GNU General Public License v3.0
12 stars 8 forks source link

error with error handling #69

Open lukemarsden opened 1 year ago

lukemarsden commented 1 year ago
2023-07-21 10:22:43,200;ResourceProvider;JOB FAILED: Command '['bacalhau', 'list', '--output', 'json', '--id-filter', 'efa05cdc-c69c-42c2-b777-66f622594091\n\nError submitting job: not enough nodes to run job. requested: 1, available: 0; node QmaPe1PPKMhBtzxvQWLq9PiQ9TFyutWN7dDMNUDrPcQ9qU failed due to: error calculating resource requirements for job: error getting job disk space requirements: Post "http://127.0.0.1:5001/api/v0/object/stat?arg=%2Fipfs%2FQmQYTiwSZvr2L3xgFGfBZCk27n9sW3J9UzzNnx11E2GLuC": context deadline exceeded\nJob Results By Node:\n• Node QmaPe1PP, QmaPe1PP: error calculating resource requirements for job: error getting job disk space requirements: Post "http://127.0.0.1:5001/api/v0/object/stat?arg=%2Fipfs%2FQmQYTiwSZvr2L3xgFGfBZCk27n9sW3J9UzzNnx11E2GLuC": context deadline exceeded']' returned non-zero exit status 1. Error listing jobs: Job not found. ID: efa05cdc-c69c-42c2-b777-66f622594091

Error submitting job: not enough nodes to run job. requested: 1, available: 0; node QmaPe1PPKMhBtzxvQWLq9PiQ9TFyutWN7dDMNUDrPcQ9qU failed due to: error calculating resource requirements for job: error getting job disk space requirements: Post "http://127.0.0.1:5001/api/v0/object/stat?arg=%2Fipfs%2FQmQYTiwSZvr2L3xgFGfBZCk27n9sW3J9UzzNnx11E2GLuC": context deadline exceeded
Job Results By Node:
• Node QmaPe1PP, QmaPe1PP: error calculating resource requirements for job: error getting job disk space requirements: Post "http://127.0.0.1:5001/api/v0/object/stat?arg=%2Fipfs%2FQmQYTiwSZvr2L3xgFGfBZCk27n9sW3J9UzzNnx11E2GLuC": context deadline exceeded

Exception in thread Thread-1 (platformListener):
Traceback (most recent call last):
  File "/app/modicum/ResourceProvider.py", line 276, in platformListener
    resultHash = self.getJob(matchID, JO, True)
  File "/app/modicum/Mediator.py", line 104, in getJob
    listOutput = subprocess.run(['bacalhau', 'list', '--output', 'json', '--id-filter', jobID], text=True, capture_output=True, check=True)
  File "/usr/lib/python3.10/subprocess.py", line 524, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['bacalhau', 'list', '--output', 'json', '--id-filter', 'efa05cdc-c69c-42c2-b777-66f622594091\n\nError submitting job: not enough nodes to run job. requested: 1, available: 0; node QmaPe1PPKMhBtzxvQWLq9PiQ9TFyutWN7dDMNUDrPcQ9qU failed due to: error calculating resource requirements for job: error getting job disk space requirements: Post "http://127.0.0.1:5001/api/v0/object/stat?arg=%2Fipfs%2FQmQYTiwSZvr2L3xgFGfBZCk27n9sW3J9UzzNnx11E2GLuC": context deadline exceeded\nJob Results By Node:\n• Node QmaPe1PP, QmaPe1PP: error calculating resource requirements for job: error getting job disk space requirements: Post "http://127.0.0.1:5001/api/v0/object/stat?arg=%2Fipfs%2FQmQYTiwSZvr2L3xgFGfBZCk27n9sW3J9UzzNnx11E2GLuC": context deadline exceeded']' returned non-zero exit status 1.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/app/modicum/ResourceProvider.py", line 283, in platformListener
    self.logger.info(traceback.format_exc(e))
  File "/usr/lib/python3.10/traceback.py", line 183, in format_exc
    return "".join(format_exception(*sys.exc_info(), limit=limit, chain=chain))
  File "/usr/lib/python3.10/traceback.py", line 135, in format_exception
    te = TracebackException(type(value), value, tb, limit=limit, compact=True)
  File "/usr/lib/python3.10/traceback.py", line 502, in __init__
    self.stack = StackSummary.extract(
  File "/usr/lib/python3.10/traceback.py", line 357, in extract
    if limit >= 0:
TypeError: '>=' not supported between instances of 'CalledProcessError' and 'int'
^C