graphcore / poptorch

PyTorch interface for the IPU
https://docs.graphcore.ai/projects/poptorch-user-guide/en/latest/
MIT License
177 stars 15 forks source link

unsupported aten::alias #15

Closed ebisuke closed 1 year ago

ebisuke commented 1 year ago

I am attempting to learn using modified GPTNeoXJapaneseForCausalLM and am getting the following error. Is there any way to find clues as to where aten::alias is being used?

AliasProcessing.cpp exists, but I cannot find where it is being used.

Traceback (most recent call last):
  File "train_ipu.py", line 447, in <module>
    main()
  File "train_ipu.py", line 429, in main
    trainer.train()   # test
  File "/usr/local/lib/python3.8/dist-packages/optimum/graphcore/trainer.py", line 1012, in train
    return self._inner_training_loop(
  File "/usr/local/lib/python3.8/dist-packages/optimum/graphcore/trainer.py", line 1081, in _inner_training_loop
    self.compile_model(self.training_model, next(iter(train_dataloader)), log=True)
  File "/usr/local/lib/python3.8/dist-packages/optimum/graphcore/trainer.py", line 476, in compile_model
    model.compile(**sample_batch)
  File "/usr/local/lib/python3.8/dist-packages/poptorch/_poplar_executor.py", line 976, in compile
    self._compile(in_tensors)
  File "/usr/local/lib/python3.8/dist-packages/poptorch/_impl.py", line 358, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/poptorch/_poplar_executor.py", line 911, in _compile
    self._executable = self._compileWithDispatch(in_tensors_trace_view)
  File "/usr/local/lib/python3.8/dist-packages/poptorch/_impl.py", line 164, in wrapper
    return func(*args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/poptorch/_poplar_executor.py", line 872, in _compileWithDispatch
    executable = poptorch_core.compileWithManualTracing(
poptorch.poptorch_core.Error: In poptorch/source/ErrorOnUnsupportedAten.cpp:30: 'poptorch_cpp_error': Unsupported ops found in compiled model: [aten::alias]. Not all operations are supported yet by Graphcore's PyTorch compiler. If you believe any of these should be, please report this message to support@graphcore.ai.
Error raised in:
  [0] compileWithManualTracing