dosubot[bot]
commented
1 day ago I found a similar issue where uploaded files were queued and not processed after upgrading from version 0.6.8 to 0.8.3 in a self-hosted Dify environment. The problem is likely due to changes in the environment variable configuration.
To resolve this issue, you need to sync the environment variable configuration by updating your local .env file to match any new variables or changes in the .env.example file. Here are the steps to follow:
-
Navigate to the docker directory of the Dify source code:
cd dify/docker -
Bring down the current Docker containers:
docker compose down -
Pull the latest changes from the repository:
git pull origin main -
Pull the latest Docker images:
docker compose pull -
Start the Docker containers:
docker compose up -d -
Sync the environment variable configuration:
- Compare your local
.envfile with the updated.env.examplefile. - Add any new variables from
.env.exampleto your.envfile. - Update any values in your
.envfile that have changed in.env.example.
- Compare your local
Additionally, ensure that the encryption keys are correctly set up, as missing or incorrect keys can cause issues with file processing. If you encounter a "File not found" error in the logs, it may be due to missing encryption keys. You can reset the encryption public and private keys with the following command:
- Docker compose deployment:
docker exec -it docker-api-1 flask reset-encrypt-key-pair
By ensuring that your environment variables are correctly configured and encryption keys are properly set, you should resolve the issue of uploaded files being queued and not processed [1][2][3].
To continue talking to Dosu, mention @dosu.
create-my
Self Checks
Dify version
0.8.0
Cloud or Self Hosted
Self Hosted (Source)
Steps to reproduce
DES: I discovered this problem when I upgraded from version 0.6.8 to 0.8.3. Maybe my upgrade method is not correct. I downloaded the zip and configured the environment according to the steps. Later, I removed the docker container, recreated the python environment, and reconfigured it. The problem remains. V0.8.0 I suspect it is docker problem and I am planning to uninstall docker desktop and reinstall it
FIG:
DOCKER LOGS: 2024-09-18 08:24:11 sandbox-1 | [GIN] 2024/09/18 - 08:24:11 | 200 | 15.622µs | 127.0.0.1 | GET "/health" 2024-09-18 08:24:41 sandbox-1 | [GIN] 2024/09/18 - 08:24:41 | 200 | 17.314µs | 127.0.0.1 | GET "/health" 2024-09-18 08:25:02 db-1 | 2024-09-18 08:25:02.842 UTC [178] LOG: checkpoint starting: time 2024-09-18 08:25:11 sandbox-1 | [GIN] 2024/09/18 - 08:25:11 | 200 | 17.241µs | 127.0.0.1 | GET "/health" 2024-09-18 08:25:12 db-1 | 2024-09-18 08:25:12.645 UTC [178] LOG: checkpoint complete: wrote 86 buffers (0.5%); 0 WAL file(s) added, 0 removed, 0 recycled; write=8.605 s, sync=1.084 s, total=9.804 s; sync files=38, longest=0.079 s, average=0.029 s; distance=143 kB, estimate=2417 kB 2024-09-18 08:25:41 sandbox-1 | [GIN] 2024/09/18 - 08:25:41 | 200 | 16.429µs | 127.0.0.1 | GET "/health"
POTRY LOGS: 2024-09-18 08:25:40,530.530 INFO [Thread-220 (process_request_thread)] [_internal.py:97] - 127.0.0.1 - - [18/Sep/2024 08:25:40] "OPTIONS /console/api/datasets/e11a918b-1fb7-4692-9d6e-93b44a5fd1d5/documents?page=1&limit=15&keyword=&fetch= HTTP/1.1" 200 - 2024-09-18 08:25:40,532.532 INFO [Thread-221 (process_request_thread)] [_internal.py:97] - 127.0.0.1 - - [18/Sep/2024 08:25:40] "OPTIONS /console/api/datasets/e11a918b-1fb7-4692-9d6e-93b44a5fd1d5/related-apps HTTP/1.1" 200 - 2024-09-18 08:25:40,535.535 INFO [Thread-219 (process_request_thread)] [_internal.py:97] - 127.0.0.1 - - [18/Sep/2024 08:25:40] "OPTIONS /console/api/datasets/e11a918b-1fb7-4692-9d6e-93b44a5fd1d5/error-docs HTTP/1.1" 200 - 2024-09-18 08:25:40,555.555 INFO [Thread-222 (process_request_thread)] [_internal.py:97] - 127.0.0.1 - - [18/Sep/2024 08:25:40] "GET /console/api/datasets/e11a918b-1fb7-4692-9d6e-93b44a5fd1d5 HTTP/1.1" 200 - 2024-09-18 08:25:40,805.805 INFO [Thread-223 (process_request_thread)] [_internal.py:97] - 127.0.0.1 - - [18/Sep/2024 08:25:40] "GET /console/api/datasets/e11a918b-1fb7-4692-9d6e-93b44a5fd1d5/documents?page=1&limit=15&keyword=&fetch= HTTP/1.1" 200 - 2024-09-18 08:25:40,863.863 INFO [Thread-224 (process_request_thread)] [_internal.py:97] - 127.0.0.1 - - [18/Sep/2024 08:25:40] "GET /console/api/datasets/e11a918b-1fb7-4692-9d6e-93b44a5fd1d5/related-apps HTTP/1.1" 200 - 2024-09-18 08:25:40,869.869 INFO [Thread-225 (process_request_thread)] [_internal.py:97] - 127.0.0.1 - - [18/Sep/2024 08:25:40] "GET /console/api/datasets/e11a918b-1fb7-4692-9d6e-93b44a5fd1d5/error-docs HTTP/1.1" 200 -
✔️ Expected Behavior
File implementation conversion
❌ Actual Behavior
File status error