search

mikeizbicki / cmc-csci143

big data course materials
40 stars 76 forks source link

Docker containers not building for normalized batch #529

Open pangsark opened 7 months ago

pangsark commented 7 months ago

Hi Prof. Mike!

I was having issues bringing up my pg_normalized batch database as it did not show up when I ran docker ps. Also, when I ran the sh load_tweets_parallel.sh I found that my denormalized files loaded but my normalized_batch did not.

I ran docker-compose logs and found this error with the normalized batch:

pg_normalized_batch_1 | initdb: error: directory "/var/lib/postgresql/data" exists but is not empty pg_normalized_batch_1 | initdb: hint: If you want to create a new database system, either remove or empty the directory "/var/lib/postgresql/data" or run initdb with an argument other than "/var/lib/postgresql/data".

I saw that Weston had a similar issue in a previous post and I was wondering if there are anything I can do or if you would need to delete the data as a root user as well.

Thank you so much, Sangeon

mikeizbicki commented 6 months ago

I ran the following command to delete the folder for you:

sudo rm -rf /home/sangpark/bigdata/pg_normalized_batch