SayelAbualigah / MixtralBasedFaithfulness

Faithfulness from scratch
0 stars 0 forks source link

SageMaker Bulk Inference #1

Closed SayelAbualigah closed 1 month ago

SayelAbualigah commented 1 month ago

Timeout when passing a batch of documents for sagemaker embedding endpoint using langchain-sagemaker configuration.

SayelAbualigah commented 1 month ago

I solved this by making the passing text batches smaller. Solution: https://github.com/SayelAbualigah/HF-EmbeddingBulkProcessing-/blob/main/BatchProcessing%26Inference%20HF.ipynb