medialab / hyphe

Websites crawler with built-in exploration and control web interface
http://hyphe.medialab.sciences-po.fr/demo/
GNU Affero General Public License v3.0
329 stars 59 forks source link

Updating Hyphe makes Corpus inaccessible #381

Closed ralphverwegen closed 3 years ago

ralphverwegen commented 4 years ago

Hey,

I used the instructions on Github to update Hyphe after it had stopped functioning. Can anyone tell me if I can still access my old corpus and how? This would be greatly appreciated. My research depends on it.

Thank you

boogheta commented 4 years ago

I guess you are using Docker and followed this line? Do you know which version you used to have before, what TAG version is set in your .env file and/or when it was?

ralphverwegen commented 4 years ago

Thnx Boogheta. Yes, I am using docker and I followed that line. No, unfortunately I don't know which version I had. I installed docker and Hyphe about 5 months ago. How would I find the TAG version in my .env file?

The updates were made today

ralphverwegen commented 4 years ago

Oh, and thank you so much for trying to help me

ralphverwegen commented 4 years ago

It says Tag=Prod

boogheta commented 4 years ago

The prod containers have not been updated in the last 7 months https://hub.docker.com/layers/scpomedialab/hyphe_backend/prod/images/sha256-b382ef1f9a6dde5777bed9438dacb79dab7a4f5e0c3c9f04abdb0f34967248d8?context=explore so normally what you did should not have broken anything. Can you give a bit more info on what doesn't work?

ralphverwegen commented 4 years ago

Ok, so normally when I boot up Hyphe and navigate to the frontend, it will present me with the corpi that I have been using. Now, when I navigate to the frontend, after booting up, it shows me no corpi, and give me only the options of starting a new one.

The reason for the original update, was that I was attempting to fix an issue with Hyphe. Hyphe wouldn't boot up at all. It would start the backend and frontend, and then give a problem code '127' and then the frontend would also fail giving code '2'. In an attempt to fix it I updated Hyphe.

boogheta commented 4 years ago

that sounds bad :( What does docker volume ls say? Are there directories named mongo-data, traph-data or archives in your hyphe folder? Do you have anything set within the DATA_PATH var in .env?

ralphverwegen commented 4 years ago

Hyphe Help Screenshot

ralphverwegen commented 4 years ago

TAG=prod PUBLIC_PORT=80 DATA_PATH= RESTART_POLICY=no

ralphverwegen commented 4 years ago

I can find a directory called traph, but not traph-data, mongo-data or archives.

It's all gone isn't it? My research I mean

boogheta commented 4 years ago

Your data might still be in the volumes listed Can you run the following?

for v in $(docker volume ls -q); do
  docker volume inspect $v
  path=$(docker volume inspect $v | grep Mountpoint | awk -F '"' '{print $4}')
  du -sh $path
  ls -lha $path
done 

It might return unauthorized for the du and ls commands, in which case add sudo in the two lines

ralphverwegen commented 4 years ago

It returns as: cannot access not such file or directory

And it's not recognizing sudo as a command. Hyphe Help Screenshot 2

boogheta commented 4 years ago

mmm that is a bit weird about sudo. You need to find a way to access the content of the folders listed in the Mountpoint lines and check what's inside, maybe by logging as root on your machine

ralphverwegen commented 4 years ago

Hey Boogheta,

Firstly, thank you so much for helping me, it means a lot. Do you have a guide or some instructions on how to access the content of the folders listed in the Mountpoint?

Thank you

boogheta commented 4 years ago

Hi, sorry but I gave you the instructions I would use already. Apparently your machine has some weird setup, so you will need to figure out this part. Something along noting the path values for each directory, logging as root, then doing ls and du on these paths.

ralphverwegen commented 4 years ago

Ok, thnx. I'll keep on trying.

My machine runs on windows, not Linux, if that changes anything.

boogheta commented 4 years ago

Ha that might explain things, unfortunately I haven't had any experience with Windows in the last 15 years so I won't be able to help much on this part, but Google and StackOverflow will probably be helpful, sorry :/