search

ploomber / soopervisor

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
https://soopervisor.readthedocs.io
Apache License 2.0
45 stars 18 forks source link

Tutorials: docker build may fail due to a mistune incompatibility #39

Closed edublancas closed 9 months ago

edublancas commented 2 years ago

mistune 2.0 is out, under some circumstances, the environment created after running pip install ploomber soopervisor may no work if the user ends up with mistune 2.0, this is because nbconvert is not compatible with it. I think this is a problem with the pip resolver:

Step 18/22 : RUN ploomber examples -n templates/ml-intermediate -o mli
 ---> Running in 9ea85016ecf2
Traceback (most recent call last):
  File "/opt/conda/bin/ploomber", line 5, in <module>
    from ploomber.cli.cli import cmd_router
  File "/opt/conda/lib/python3.7/site-packages/ploomber/__init__.py", line 2, in <module>
    from ploomber.dag.dag import DAG
  File "/opt/conda/lib/python3.7/site-packages/ploomber/dag/dag.py", line 91, in <module>
    from ploomber.dag.dagclients import DAGClients
  File "/opt/conda/lib/python3.7/site-packages/ploomber/dag/dagclients.py", line 4, in <module>
    from ploomber.tasks.abc import Task
  File "/opt/conda/lib/python3.7/site-packages/ploomber/tasks/__init__.py", line 6, in <module>
    from ploomber.tasks.notebook import NotebookRunner
  File "/opt/conda/lib/python3.7/site-packages/ploomber/tasks/notebook.py", line 7, in <module>
    from nbconvert import ExporterNameError
  File "/opt/conda/lib/python3.7/site-packages/nbconvert/__init__.py", line 4, in <module>
    from .exporters import *
  File "/opt/conda/lib/python3.7/site-packages/nbconvert/exporters/__init__.py", line 3, in <module>
    from .html import HTMLExporter
  File "/opt/conda/lib/python3.7/site-packages/nbconvert/exporters/html.py", line 23, in <module>
    from nbconvert.filters.highlight import Highlight2HTML
  File "/opt/conda/lib/python3.7/site-packages/nbconvert/filters/__init__.py", line 6, in <module>
    from .markdown import *
  File "/opt/conda/lib/python3.7/site-packages/nbconvert/filters/markdown.py", line 13, in <module>
    from .markdown_mistune import markdown2html_mistune
  File "/opt/conda/lib/python3.7/site-packages/nbconvert/filters/markdown_mistune.py", line 31, in <module>
    class MathBlockGrammar(mistune.BlockGrammar):
AttributeError: module 'mistune' has no attribute 'BlockGrammar'
The command '/bin/sh -c ploomber examples -n templates/ml-intermediate -o mli' returned a non-zero code: 1