search

AI21Labs / SageMaker

Examples for using AI21's models through Amazon SageMaker
31 stars 15 forks source link

Batch processing #4

Closed htcai closed 1 year ago

htcai commented 1 year ago

Is it possible to parallelize the processing of models such as Jurassic-2 Ultra in AWS? Mainly, we are trying to utilize the LLMs to perform text classification and would like to classify texts in batches, rather than one by one.

yuvalbelfer commented 1 year ago

Currently, we do not support batch processing (but planning to add it in the near future)