None was passed to config.num_threads and the pipeline failed to start, but provided no indication as to why. Receiving a None value should throw an exception indicating why the pipeline is failing to start.
Minimum reproducible example
import cudf
from morpheus.config import Config
from morpheus.pipeline.linear_pipeline import LinearPipeline
from morpheus.stages.general.monitor_stage import MonitorStage
from morpheus.stages.input.in_memory_source_stage import InMemorySourceStage
from morpheus.stages.output.in_memory_sink_stage import InMemorySinkStage
def pipeline(num_threads):
config = Config()
config.num_threads = num_threads
pipe = LinearPipeline(config)
pipe.set_source(
InMemorySourceStage(config,
dataframes=[cudf.DataFrame({'foo': 'bar'})],
repeat=1)
)
pipe.add_stage(MonitorStage(config, description="Stage"))
pipe.add_stage(InMemorySinkStage(config))
pipe.run()
return True
Relevant log output
Click here to see error details
Exception has occurred: AssertionError (note: full exception trace is shown but execution is paused at: _run_module_as_main)
Pipeline must be started before joining
File "/workspace/morpheus-private/external/morpheus/morpheus/pipeline/pipeline.py", line 453, in join
assert self._post_start_future is not None, "Pipeline must be started before joining"
File "/workspace/morpheus-private/external/morpheus/morpheus/pipeline/pipeline.py", line 638, in run_async
await self.join()
File "/opt/conda/envs/morpheus/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
return future.result()
File "/opt/conda/envs/morpheus/lib/python3.10/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/workspace/morpheus-private/external/morpheus/morpheus/pipeline/pipeline.py", line 657, in run
asyncio.run(self.run_async())
File "/workspace/morpheus-private/examples/llm/cve/nspect_pipeline.py", line 504, in pipeline
pipe.run()
File "/workspace/morpheus-private/examples/llm/cve/run.py", line 376, in nspect_pipeline
return _pipeline(run_config)
File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
return self.main(*args, **kwargs)
File "/workspace/morpheus-private/examples/llm/main.py", line 29, in run_cli
cli(obj={}, auto_envvar_prefix='MORPHEUS_LLM', show_default=True, prog_name="morpheus_llm")
File "/workspace/morpheus-private/examples/llm/main.py", line 33, in
run_cli()
File "/opt/conda/envs/morpheus/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/opt/conda/envs/morpheus/lib/python3.10/runpy.py", line 196, in _run_module_as_main (Current frame)
return _run_code(code, main_globals, None,
AssertionError: Pipeline must be started before joining
Version
24.03
Which installation method(s) does this occur on?
Source
Describe the bug.
None was passed to
config.num_threads
and the pipeline failed to start, but provided no indication as to why. Receiving aNone
value should throw an exception indicating why the pipeline is failing to start.Minimum reproducible example
Relevant log output
Click here to see error details
Full env printout
Click here to see environment details
Other/Misc.
No response
Code of Conduct