Text generation - Githubissues

Jamster3000 / adventure-generator

1 stars 0 forks source link

Text generation #3

Open Jamster3000 opened 3 months ago

Jamster3000 commented 3 months ago

Use text generation which can generate NPC dialogues, lore, descriptions, etc.

Find the best AI model on hugging face that can do this, Gemma or groq (or both combined) would do this quickly.
Impliment The AI (possibly using another AI as a fallback for when the major one doesn't work)
include examples of what the AI can be used for (e.g., specific what things it can generate content for, summarization, etc.).

Jamster3000 commented 2 months ago

from gradio_client import Client

client = Client("VinayHajare/MistralTalk")

while True: userInput = input(">>>")

result = client.predict(
        prompt=userInput,
        temperature=0.7,
        max_new_tokens=800,
        top_p=0.9,
        repetition_penalty=1.2,
        model="Mistral",
        enable_hinglish=False,
        api_name="/chat"
)
print(result)

This seems to be what I'm looking for to get this to work