[Gen AI] Build Basic Chat Engine

[head-iie-vnr]

input.txt validation.txt

Trained the system using basic text

Ran the server

uvicorn chat:app --reload

View the Results

curl -X POST "http://127.0.0.1:8000/chat" -H "Content-Type: application/json" -d '{"question": "Different types of generative AI models"}'

[head-iie-vnr]

Observations from the Results

• [x] It took 9 seconds to get the results. TOO LONG
• [x] The text is repetitive.
• [x] Quality of response is low.

Results

(base) kp@kuru:~/kp-learnings$ curl -X POST "http://127.0.0.1:8000/chat" -H "Content-Type: application/json" -d '{"question": "Different types of generative AI models"}' {"answer":"Different types of generative AI models:\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future. Generative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future.\n\nGenerative models are used to generate models that can be used to predict the future."}

[head-iie-vnr]

I need to improve the text quality by training with larger data.

That I will try to fix with next issue.

As of now time can be reduced by setting max_length=50