AgrI-Mitra / bff

0 stars 3 forks source link

Caching of common Bhashini APIs #15

Open ChakshuGautam opened 1 year ago

ChakshuGautam commented 1 year ago
  1. Every request that has already been served by Bhashini (STT, TTS) should be cached.
  2. Status message should be divided into two parts => "new" + "static" (which should come from cached APIs)

Create a transparent proxy in fronte of Bhashini to store and give responses to these APIs. Since the number of requests could be huge, this should a CDN-driven transparent proxy.

This would be an application agnostic proxy so can be deployed to any application to speed up queries without changing application code.