S95Sedan / Deepspeed-Windows

Deepspeed windows information
Apache License 2.0
30 stars 2 forks source link

Fail to build wheel for Deepspeed 14.0 #5

Closed slayermaster closed 4 months ago

slayermaster commented 4 months ago
(venv) V:\DeepSpeed-0.14.0>build_win.bat
Administrative permissions required. Detecting permissions...
Success: Administrative permissions confirmed.
DS_BUILD_OPS=1
test.c
LINK : fatal error LNK1181: cannot open input file 'aio.lib'
 [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
 [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
 [WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
 [WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.2
 [WARNING]  please install triton==1.0.0 if you want to use sparse attention
Install Ops={'async_io': False, 'fused_adam': 1, 'cpu_adam': 1, 'cpu_adagrad': 1, 'cpu_lion': 1, 'evoformer_attn': False, 'fused_lamb': 1, 'fused_lion': 1, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': 1, 'quantizer': 1, 'ragged_device_ops': False, 'ragged_ops': 1, 'random_ltd': 1, 'sparse_attn': False, 'spatial_inference': 1, 'transformer': 1, 'stochastic_transformer': 1}
fatal: not a git repository (or any of the parent directories): .git
version=0.14.0+unknown, git_hash=unknown, git_branch=unknown
install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': True, 'cutlass_ops': True, 'transformer_inference': True, 'quantizer': True, 'ragged_device_ops': True, 'ragged_ops': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': True, 'transformer': True, 'stochastic_transformer': True, 'deepspeed_not_implemented': False}
ext_modules=[<setuptools.extension.Extension('deepspeed.ops.adam.fused_adam_op') at 0x262605c7160>, <setuptools.extension.Extension('deepspeed.ops.adam.cpu_adam_op') at 0x2627b079030>, <setuptools.extension.Extension('deepspeed.ops.adagrad.cpu_adagrad_op') at 0x2627b079060>, <setuptools.extension.Extension('deepspeed.ops.lion.cpu_lion_op') at 0x2627b07a950>, <setuptools.extension.Extension('deepspeed.ops.lamb.fused_lamb_op') at 0x2627b079180>, <setuptools.extension.Extension('deepspeed.ops.lion.fused_lion_op') at 0x2627b07b970>, <setuptools.extension.Extension('deepspeed.ops.transformer.inference.transformer_inference_op') at 0x2627b07ba30>, <setuptools.extension.Extension('deepspeed.ops.quantizer.quantizer_op') at 0x2627b078fd0>, <setuptools.extension.Extension('deepspeed.inference.v2.ragged_ops') at 0x2627b0790c0>, <setuptools.extension.Extension('deepspeed.ops.random_ltd_op') at 0x2627b07a410>, <setuptools.extension.Extension('deepspeed.ops.spatial.spatial_inference_op') at 0x2627b078b50>, <setuptools.extension.Extension('deepspeed.ops.transformer.transformer_op') at 0x2627b07a320>, <setuptools.extension.Extension('deepspeed.ops.transformer.stochastic_transformer_op') at 0x2627b079b10>]
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
   or: setup.py --help [cmd1 cmd2 ...]
   or: setup.py --help-commands
   or: setup.py cmd --help

error: invalid command 'bdist_wheel'

I have no idea why it still tries to call libaio. I'm using your modification files, with my venv for ooba.

S95Sedan commented 4 months ago

"error: invalid command 'bdist_wheel' " is the actual error, the rest are warnings. Seems like an installation venv installation issue.