When booting up with the full excellent articles dataset, the application takes ages to start up. After the embeddings have been generated with GPU acceleration (NVIDIA RTX 3090 takes ~10minutes to embed excellent articles full) the application hangs, 1 CPU core on 100%, GPU idle. Is it the storage of the embedding cache as json?
Terms
Behavior
When booting up with the full excellent articles dataset, the application takes ages to start up. After the embeddings have been generated with GPU acceleration (NVIDIA RTX 3090 takes ~10minutes to embed excellent articles full) the application hangs, 1 CPU core on 100%, GPU idle. Is it the storage of the embedding cache as json?
Operating System
runpod host with rtx 3090