search

allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.68k stars 654 forks source link

Clearml agent packages not properly installed/used? #545

Open ColdTeapot273K opened 2 years ago

ColdTeapot273K commented 2 years ago

clearml==1.1.6 clearml-agent==1.1.1

Clearml agent executing task from a queue, package manager - poetry

...
Summary - installed python packages:
pip:
...
- 'clearml==1.1.6 # ClearML - Auto-Magical Experiment Manager, Version Control, and
    MLOps for AI'
...
Environment setup completed successfully

Starting Task Execution:

Traceback (most recent call last):
  File "path/to/my/script", line 3, in <module>
    from clearml import Task, Logger
ModuleNotFoundError: No module named 'clearml'
jkhenning commented 2 years ago

Hi @ColdTeapot273K ,

Can you share some more context from the agent's output?

ColdTeapot273K commented 2 years ago

@jkhenning

Yep, the full log

jkhenning commented 2 years ago

agent.python_binary = /home/acalabourdin/.pyenv/shims/python ... Creating virtualenv ds-614 in /home/acalabourdin/.clearml/venvs-builds/3.9/task_repository/ml_automation.git/.venv

It seems like you're running the agent from a virtualenv and not using the --docker option, which is not supported (this basically causes nested virtualenvs).

Can you try installing the agent in the system python and see if it works?