I am working with a dataset of about 12,000 social media messages clustered into 100 topics using KMEANS (or Agglomorative) algorithm. I'm using openAI as a representative model which worked great for generating labels on the initial clustering. But when I try to generate hierarchical_topics, I hit the openAI rate limit. Is it possible to implement a delay on the 'hierarchical_topics' method or provide another work around?
I am working with a dataset of about 12,000 social media messages clustered into 100 topics using KMEANS (or Agglomorative) algorithm. I'm using openAI as a representative model which worked great for generating labels on the initial clustering. But when I try to generate hierarchical_topics, I hit the openAI rate limit. Is it possible to implement a delay on the 'hierarchical_topics' method or provide another work around?
CODE
ERROR
RateLimitError Traceback (most recent call last)