tosdr / tosback2

Reimplementing TOSBack with Ruby and using git to see TOS changes!
http://tosback.org
GNU General Public License v2.0
125 stars 32 forks source link

Issue with mysql connection on tosback.org server? #75

Closed michielbdejong closed 3 years ago

michielbdejong commented 4 years ago

The tosback.org server ran out of diskspace. I removed the git history of this repo which was taking up 15Gb out of the 20Gb disk that server has, by doing a git shallow clone. The disk issue seems solved now, but I found that the script had stopped working.

When running it manually, I found it helps if I comment out https://github.com/tosdr/tosback2/blob/master/rubycode/main.rb#L12 I guess that will mean the git repo will still be updated, but the information on the web page will no longer get updated - I guess it uses mysql to communicate with https://github.com/tosdr/ToSBack3?

In any case, it's running now, I'll see if the website gets updated once the script is finished.

michielbdejong commented 4 years ago

at least it's crawling again now, it was interrupted from 8 to 22 June: https://github.com/tosdr/tosback2/commits/master/crawl

michielbdejong commented 3 years ago

Mentioned this problem on the main page at https://tosback.org and linked to both the tosback2 github repo and https://github.com/ambanum/CGUs:


michiel@dragon:/var/www/ToSBack3$ git diff
diff --git a/app/views/layouts/application.html.erb b/app/views/layouts/application.html.erb
index 5d99a6e..82dfdbc 100644
--- a/app/views/layouts/application.html.erb
+++ b/app/views/layouts/application.html.erb
@@ -28,11 +28,20 @@
                 TOSBack began as a collaboration between the <a href='https://www.eff.org/'>EFF</a>,
                 the <a href='http://www.internetsociety.org/'>Internet Society</a>,
                 and <a href='http://tosdr.org/'>ToS;DR</a>, and is now maintained by 
-                <a href='http://tosdr.org/'>ToS;DR</a>. Every day, we check the Terms and Policies
-                of many online services to see if any of them have changed. The project
-                is currently in beta as we are working on some improvements to ensure greater
+                <a href='http://tosdr.org/'>ToS;DR</a> in friendly collaboration with the
+                <a href='https://www.diplomatie.gouv.fr/en/french-foreign-policy/digital-diplomacy/'>French Ambassador for digital affairs</a>.
+                Every hour, we check the Terms and Policies
+                of many online services to see if any of them have changed.
+                The list below hasn't been updated since 6 June 2020, due to a
+                <a href="https://github.com/tosdr/tosback2/issues/75">misconfiguration</a>
+                which we hope to resolve soon.
+                See <a href="https://github.com/tosdr/tosback2">https://github.com/tosdr/tosback2</a> or
+                <a href="https://github.com/ambanum/CGUs#exploring-the-versions-history">these instructions</a>
+                for our latest data.
+                The project is currently in beta as we are working on some improvements to ensure greater
                 reliability and coverage. For now, please double check any results with        the website
                 operator before relying on them for important legal or journalistic purposes.
+                
     </p>
   </div>
JimmStout commented 3 years ago

It's working again. Some dependencies were missing and the shallow git clone likely erased the file containing the mysql credentials.

michielbdejong commented 3 years ago

w00t!