instructlab / dev-docs

Developer documents for the InstructLab organization
Apache License 2.0
4 stars 32 forks source link

Create a repository for knowledge doc ingestion tool #152

Open makelinux opened 1 month ago

makelinux commented 1 month ago

As previously discussed, the CLI and SDG repositories are not suitable for handling ingestion documents in various formats due to limitations in testability and maintainability. Therefore, a dedicated repository should be created for document ingestion, following scalable architecture principles and adhering to best practices for maintainability, testability, and long-term sustainability.

Related issues:

64

120

148

149