Preprocessing of the data of the Q&A dataset - Githubissues

amosproj / amos2024ss08-cloud-native-llm

MIT License

6 stars 1 forks source link

Preprocessing of the data of the Q&A dataset #61

Closed dominic0df closed 3 weeks ago

dominic0df commented 1 month ago

User story

As a developer
I want to transform the data of the Q&A dataset into the shape and format that the Gemma Model requires
So that I can perform LLM training afterwards

Acceptance criteria

The data of the Q&A dataset is preprocessed so that machine learning can be done afterwards with it
The data is ready to be trained with the Gemma model

Definition of done (DoD)

Bill of Materials in the planning document has been updated
All the complex logics have been tested
All feature branches have been merged and closed
New feature code has been documented
Potential new licenses have been checked
All GitHub Actions are passing
The requirement.txt is updated

DoD general criteria

Feature has been fully implemented
Feature has been merged into the mainline
All acceptance criteria were met
Product owner approved features
All tests are passing
Developers agreed to release

dominic0df commented 3 weeks ago

added DoD