search

mytnguyen26 / METCS777-GenAIForTheme

This repository is a project for METCS777. This project focuses on fine-tuning Gen AI models for theme specific content
1 stars 2 forks source link

[data] data processing pipeline from source raw to embeddings #5

Open mytnguyen26 opened 2 months ago

mytnguyen26 commented 2 months ago

As data are collected, we need additional processing for data to be in embedding formats for finetuning