vmware-archive / database-stream-processor

Streaming and Incremental Computation Framework
Other
222 stars 20 forks source link

Compiler failures hangs python API #377

Open lalithsuresh opened 1 year ago

lalithsuresh commented 1 year ago

I noticed the create_demo_projects.sh script was stuck without any feedback on stdout during some Docker builds. Digging deeper, I noticed this in the manager logs (can happen due to a lot of docker builds):

[2023-04-17T19:26:46Z ERROR dbsp_pipeline_manager::compiler] compiler task failed; error: 'error returned from database: (code: 13) database or disk is full'

This error however doesn't cause the client to exit from the looks of it (demo-name/run.py seemed to be stuck in project.compile()).

It looks the default timeout is to wait practically forever for the compilation to finish (sys.maxsize):

class DBSPProject:
...
    def compile(self, *, timeout: float = sys.maxsize):