TheAtlasRepository / Text2Map

Make maps from simple Text prompts using AI
GNU General Public License v3.0
5 stars 0 forks source link

Question: What do you think about performance? #53

Open fredrikmoger opened 5 months ago

fredrikmoger commented 5 months ago

Now it takes ... (45-60 sec) to run the ChatGPT text to map. What do you think about the performance?

Eiriksb commented 5 months ago

Big queries like "Which countries took part in WW2?", "All States in the USA" And queries with a lot of boundaries to load are currently quite bottlenecked by the fact that we have not set up Workers with Heruko. But compared to before the Json Update for the Assistant It takes significantly less time to get a response back (If it goes through as Heruko has a limit of 30 seconds of waiting before it closes the process) Small queries can take as little time as a few seconds now.

Potential fixes