Marker-Inc-Korea / RAGchain

Extension of Langchain for RAG. Easy benchmarking, multiple retrievals, reranker, time-aware RAG, and so on...
Apache License 2.0
277 stars 28 forks source link

Can't put passages to mongodb at DSTC11Track5 Evaluator #459

Open vkehfdl1 opened 9 months ago

vkehfdl1 commented 9 months ago

DSTC11Track5 Evaluator contains np.array metadata object in Passage's metadata. It occurs pymongo error, so I can't put passages with metadata

  def __make_passages(self, row):
      if row['doc_type'] == 'review':
          content = row['review_sentence']
          metadata_etc = {
              'domain': row['domain'],
              'entity_id': row['entity_id'],
              'entity_name': row['entity_name'],
              'doc_type': row['doc_type'],
              **row['review_metadata'] # This is the problem
          }

Should we fix Evaluator? or should we fix mongoDB???

vkehfdl1 commented 9 months ago

Check this out @bwook00 @minsing-jin