flexflow / FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.6k stars 219 forks source link

BatchNorm operator initialization missing #1289

Open FelixBrakel opened 5 months ago

FelixBrakel commented 5 months ago

At least when using FF from the python API.

Steps to reproduce

This issue can be reproduced by running the resnet.py example in examples/python/native/resnet.py which produces the following error:

legion_python: /path/to/FlexFlow/src/runtime/model.cc:3235: FlexFlow::Op* FlexFlow::FFModel::create_operator_from_layer(FlexFlow::Layer*, const std::vector<FlexFlow::ParallelTensorBase*>&): Assertion `false' failed.

Looking through the code it looks like the BatchNorm operator is mostly implemented but is missing the code to initialize it?