Open karatugo opened 1 month ago
Had a couple of meetings with the DBA team. They had a few options based on the API usage patterns. So we asked Kaur if he's aware of such patterns.
Next action item is to choose one of the database design options based on Kaur's feedback.
In our meetings with the DBA team, we identified key API usage patterns. Additionally, thanks to Kaur's feedback, my analysis of old Kubernetes logs supports these patterns:
Karthick suggested a few approaches for database design, and we decided to proceed with the second approach:
We acknowledge the challenges of handling Type 3 searches. In the future, we may consider an asynchronous approach (e.g., process the request and notify users via email upon completion).
MongoDB model implemented as discussed above.
We need to design and implement an efficient data model for storing eQTL (expression Quantitative Trait Loci) data in MongoDB. The goal is to ensure that the data can be loaded quickly and retrieved efficiently to support API queries and downstream analyses. The data model should handle large datasets, optimize for query performance, and accommodate the specific structure of eQTL data.