search

aws-neuron / aws-neuron-samples

Example code for AWS Neuron SDK developers building inference and training applications
Other
112 stars 33 forks source link

Request for backwards compatibility with older tensorflow (2.4.0 - 2.7.0) versions. I am unable to trace a calamari OCR model. #78

Open ParasSharmaIISL opened 1 month ago

ParasSharmaIISL commented 1 month ago

The calamari model is trained on tensorflow 2.7.0 which utilises tfaip library and the lowest tensorflow_neuron version 2.7.4 uses a higher keras version. Due to this version mismatch I am unable to load my (calamari-ocr) keras model to the python environment with tensorflow-neuron and not able to trace the model. If I save this model in a tensorflow saved model, the traced model's computation graph only works on CPU and not inferntia chips. This is the repository "https://github.com/Calamari-OCR/calamari".

aws-rhsoln commented 3 weeks ago

Thank you for reporting the issue. To unblock the issue, loading the saved model into the inference script might be a good idea. Can you elaborate a bit more on what you mean by not working on inferentia chips? Is there a compiler error or an execution failure?