# Import libraries
import tritonclient.http as httpclient
# Initizlize client
client = httpclient.InferenceServerClient("localhost:8000",
concurrency=1,
verbose=False)
# ...
# Request text promp from user
print("Write any input prompt for the model and press ENTER:")
# Prepare tokens for sending to the server
inputs = prepare_inputs( [[input()]])
# Sending request
result = client.infer(MODEl_GPTJ_FASTERTRANSFORMER, inputs)
print(result.as_numpy("OUTPUT_0"))
Write any input prompt for the model and press ENTER:
What is the square root of 4
I0501 21:00:34.424219 3840 libfastertransformer.cc:834] Start to forward
I0501 21:00:38.273056 3840 libfastertransformer.cc:836] Stop to forward
### Reproduced Steps
```shell
I followed the article mentioned
https://developer.nvidia.com/blog/deploying-gpt-j-and-t5-with-fastertransformer-and-triton-inference-server/
but I am having no luck .
Any help you would help
Thanks
Description
Write any input prompt for the model and press ENTER:
What is the square root of 4
I0501 21:00:34.424219 3840 libfastertransformer.cc:834] Start to forward
[b'What is the square root of 4DOWNunodesDOWNuno Lawyerscher Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyerscheriframeiframeiframe Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyers Lawyersiframe Lawyersiframeiframeiframeiframe Lawyersiframe Lawyers Lawyers Lawyersiframe Lawyersuno Lawyers Lawyers Lawyersdes-|iframe Lawyersdesiframedesdesdesdescheriframeiframeiframeiframeiframe Lawyersdescheriframeiframeiframeiframe Lawyersdesiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframe Lawyersdescheriframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeiframeunoiframe']
I0501 21:00:38.273056 3840 libfastertransformer.cc:836] Stop to forward