Open pengZHENG-e opened 2 weeks ago
Create folder of components called connectors Create the first ones : DB FileStorage LLMConnector
Add server groups in the system_config Create a yaml file that lists the library dependencies of each component custom_dependencies.yaml Write a script that generates the requirements per server group - it should also check if the libraries are compatible
[ ] Monolithic Dependency Management:
Consolidate dependencies into a single, monolithic codebase.
Use the versions specified in this codebase across all components to ensure consistency
[ ] Library Specification:
Add each required library and its version to the required section in the configuration YAML file.
[ ] Component-Based Installation:
Implement an installation strategy for each component, potentially using Dockerfile?? for isolated setup per component.
[ ] External Component Integration:
Configure a dedicated system manager to handle S3 API interactions (via boto3).
Ensure correct initialization of the external components within the appropriate parts of the codebase.