Knowledge - Provide a way to stop ingestion process when files are in "Pending" or "Ingesting" state.

[sangee2004]

Trying to ingest knowledge files(from onedrive location in my case) which have audio and video files > 100 MB large results in 100% cpu consumption making the server unresponsive.

The files get stuck in "pending" state forever.

Excluding the files does not seem to result in the ingestion job to get cancelled since the cpu consumption continues to be very high even after this. I am not able to tell for sure since the api https://test.otto8.ai/api/agents/<agent-id>/knowledge-sources/<knowledge-source-id>/knowledge-files to return the ingestion run status is not responding at this time.

Expected Behavior: Provide a way to stop ingestion process when files are in "Pending" or "Ingesting" state.

[sangee2004]

Even after deleting the knowledge source , i am not able to see the cpu consumption go down and continues to be at 100% suggesting that the ingestion may continue to be happening even after the knowledge source was deleted?

I do see the runs relating to this agent being marked as "completed"

r1t6kjb                        t1-kst1-a1mz52w                                         completed   {"dataset":"default/kst1-a1mz52w","file":".conver...                                                          9 minutes ago
r1z6gfq                        t1-kst1-a1mz52w                                         completed   {"dataset":"default/kst1-a1mz52w","file":".conver...                                                          3 minutes ago
r1j76l4                        t1-kst1-a1mz52w                                         completed   {"dataset":"default/kst1-a1mz52w","file":".conver...                                                          3 minutes ago
r12ln4d                        t1-kst1-a1mz52w                                         completed   {"dataset":"default/kst1-a1mz52w","file":".conver...                                                          3 minutes ago
r15d9bq                        t1-kst1-a1mz52w                                         completed   {"dataset":"default/kst1-a1mz52w","file":".conver...                                                          3 minutes ago
r18dzdg                        t1-kst1-a1mz52w                                         completed   {"dataset":"default/kst1-a1mz52w","file":".conver...                                                          1 minute ago