Run Stackoverflow extraction to get more data

[dominic0df]

User story

1. As a developer
2. I want to run the Stackoverflow extraction for once completely
3. So that I get much more data in Q&A format that can be used for training afterwards

Acceptance criteria

• The script to run the Stackoverflow Extraction is executed and all the data related to CNCF from Stackoverflow is extracted
• The data is stored in the Stackoverflow Q&A dataset

Further information

• The pipeline to extract Stackoverflow content was already implemented in issue https://github.com/amosproj/amos2024ss08-cloud-native-llm/issues/34. The aim of this issue is to now extract all the content and not just extract a subset

Definition of done (DoD)

• Bill of Materials in the planning document has been updated
• All the complex logics have been tested
• All feature branches have been merged and closed
• New feature code has been documented
• Potential new licenses have been checked
• All GitHub Actions are passing
• The requirement.txt is updated

DoD general criteria

• Feature has been fully implemented
• Feature has been merged into the mainline
• All acceptance criteria were met
• Product owner approved features
• All tests are passing
• Developers agreed to release

[dominic0df]

Already done work: SP 01, we had some issues with rate limits so it took us a lot of time and therefore we need to spend more time on this task

[dominic0df]

invested time in the last Sprint Sp01. It still takes a lot of time, but we expect to finish the extraction in the next sprint