async_pipeline is not exposed in the library

microsoft / DeepSpeedExamples

Example models using DeepSpeed

Apache License 2.0

5.99k stars 1.02k forks source link

async_pipeline is not exposed in the library #835

Open yaliqin opened 9 months ago

yaliqin commented 9 months ago

Hi team, I want to use async_pipeline and find mii.async_pipeline is not exposed out with the deepspeed-mii package. Can you add this in the code https://github.com/microsoft/DeepSpeed-MII/blob/main/mii/__init__.py#L6 ?

Thanks

mrwyattii commented 8 months ago

@yaliqin please post MII issues on the MII repository.

You can import with from mii.api import async_pipeline. However, please note that this is only intended for internal use (so we will not expose in the __init__.py file) and is very much tailored to work with the inference server in MII.