osome-iu / hoaxy-backend

Backend component for Hoaxy, a tool to visualize the spread of claims and fact checking
http://hoaxy.iuni.iu.edu/
GNU General Public License v3.0
139 stars 44 forks source link

Make it easier and document how to update source list #55

Closed filmenczer closed 3 years ago

filmenczer commented 4 years ago

Ideally, updating the list of sources (domains) should be as easy as updating the file and/or the configuration file and restarting the system. But recently we learned that it's much more complicated, and there is no documentation about how to do it.

If possible, we should make it as easy as described above. Else there should be a command to update the list. And this has to be documented.

In the future we expect the list to change often, possibly automatically, therefore the update system should be compatible with that.

@shaochengcheng is this possible?

shaochengcheng commented 4 years ago

Yes, I will make it as easier as one-line command.

------------------ Original ------------------ From: "Fil Menczer"<notifications@github.com>; Date: Sun, Mar 15, 2020 02:25 AM To: "IUNetSci/hoaxy-backend"<hoaxy-backend@noreply.github.com>; Cc: "Shao"<rojeeer@gmail.com>;"Assign"<assign@noreply.github.com>; Subject: [IUNetSci/hoaxy-backend] Make it easier and document how to update source list (#55)

Ideally, updating the list of sources (domains) should be as easy as updating the file and/or the configuration file and restarting the system. But recently we learned that it's much more complicated, and there is no documentation about how to do it.

If possible, we should make it as easy as described above. Else there should be a command to update the list. And this has to be documented.

In the future we expect the list to change often, possibly automatically, therefore the update system should be compatible with that.

@shaochengcheng is this possible?

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub, or unsubscribe.

mohawk2 commented 4 years ago

This issue shows up as an "easy start to contributing to this project". @shaochengcheng If you have an idea how to achieve it but it's not yet a priority for you, what do you think of at least outlining here the approach you'd take to make it easier for someone else to run with?

filmenczer commented 3 years ago

@mohawk2 thanks for the offer. This turned out to be more complicated than anticipated and we're working on it. If you are still interested, perhaps consider this other issue: #58 or some of the front-end issues: https://github.com/IUNetSci/hoaxy-frontend/issues?q=is%3Aopen+is%3Aissue+milestone%3AImprovements

chathuriw commented 3 years ago

To add new list of sites, we can use this command :

hoaxy site --load-domain --exclusive --site-type=claim --ignore-redirected --ignore-inactive /home/data/apps/hoaxy/hoaxy-backend-config/domains_claim_iffy.txt

If 'exclusive' specified, it will disable the existing claim sites in the database.