Is there an example of the http client?

hpcaitech / EnergonAI

Large-scale model inference.

Apache License 2.0

631 stars 90 forks source link

Is there an example of the http client? #214

Open frankxyy opened 1 year ago

frankxyy commented 1 year ago

I am not sure about the json format of the request.

kurisusnowdeng commented 1 year ago

Our serving is designed according to FastAPI, which is very flexible for you to customize your request format. Details could be found in our opt and bloom demos in examples for your reference.