Closed HyunjunA closed 1 year ago
We have 2 potential solutions:
I think solution 1 is easier to build out and debug whereas solution 2 would involve more moving parts (ie keeping track of where all the documents are, how many shards we need to split the data into)
Actually solution 1 would require keeping track of where documents are. This can lead to orphaned files. GridFS takes care of this automatically for us. It saves files as chunks automatically. I'm leaning more towards solution 2.2. I've found the flow that saves these files:
The fact that json files are sent as a BSON document is what causes the error. So, my proposed solution is to re-route the pca and tsne json files to GridFS. This will be easy to do.
The second part of this solution involves the retrieval of these files. I would just need to retrieve them from GridFS. These files are retrieved by the frontend to be rendered along with the corresponding png files. This also should not be hard to implement, I just need to review the retrieval flow.
Re-opening issue. Tested but fix is unstable. After uploading a dataset, Aliro goes back to the landing page without showing the card for the uploaded dataset. If I try to upload again, I get an error message saying the dataset has already been registered. Steps to recreate:
docker system prune -a -f
docker volume prune -a -f
docker compose up
Reviewed updates with @HyunjunA. Confirmed new updates are stable.
In the case when the size of CVP, CVR and QQNR is over the limited size in the machine learning backend, the experiment variable in the React.js does not have corresponding values, which causes an error in the front end.
Data name: 1201 BNG BreastTumor.tsv Error message