rnadigital / agentcloud

Agent Cloud is like having your own GPT builder with a bunch extra goodies. The GUI features 1) RAG pipeline which can natively embed 260+ datasources 2) Create Conversational apps (like GPTs) 3) Create Multi Agent process automation apps (crewai) 4) Tools 5) Teams+user permissions. Get started fast with Docker and our install.sh
https://agentcloud.dev
GNU Affero General Public License v3.0
421 stars 90 forks source link

Datasource does not finish processing #245

Open anada10 opened 1 week ago

anada10 commented 1 week ago

Describe the bug The datasource has finished, but the loader is not reflecting this

To Reproduce Steps to reproduce the behavior:

  1. Add a datasource
  2. wait for it to finish loading (by looking at the backend)

Expected behavior Status completed or otherwise

Screenshots

Screenshot 2024-06-20 at 11 38 27 am

Environment DEV - Cloud

ragyabraham commented 1 week ago

From what I saw yesterday the counter is incrementing in mongo but it's not showing up on the FE. The total is always zero which is why the API call is not being sent

tomlynchRNA commented 1 week ago

Issue is that webapp sets same for docker and prod:

https://github.com/rnadigital/agentcloud/blob/e19ff6c75f44acfd5cdead679ee7b3ac0481453d/webapp/src/lib/airbyte/setup.ts#L148

Because webapp doesn't get the webhook, it never knows the "total" count and thus stays forever pending

Easy fix, just change it to be ${process.env.URL_APP}/webhook/sync-successful.

ragyabraham commented 1 week ago

Issue is that webapp sets same for docker and prod:

https://github.com/rnadigital/agentcloud/blob/e19ff6c75f44acfd5cdead679ee7b3ac0481453d/webapp/src/lib/airbyte/setup.ts#L148

Because webapp doesn't get the webhook, it never knows the "total" count and thus stays forever pending

Easy fix, just change it to be ${process.env.URL_APP}/webhook/sync-successful.

@tomlynchRNA do you mind implementing this fix on the cicd-testing branch so I can test it on cloud

tomlynchRNA commented 1 week ago

@ragyabraham d82ba4a