allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.71k stars 657 forks source link

File name too long on ClearML agent entry point #1337

Closed materight closed 1 month ago

materight commented 1 month ago

Describe the bug

When running a script with a lot of arguments on a remote clearml agent, the execution fails with clearml_agent: ERROR: [Errno 36] File name too long. It seems that the agent tries to parse the entry_point field of the task as a file, and if the entrypoint is larger than 255 characters it fails. Running the same script with less arguments works fine.

To reproduce

Run a python script with a list of arguments longer than 255 chars on a clearml agent.

Expected behaviour

The agent shouldn't consider the script's arguments as filename.

Environment