search

DedSecInside / gotor

This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.
GNU General Public License v3.0
159 stars 44 forks source link

Use WebSockets with Channels #16

Closed KingAkeem closed 4 years ago

KingAkeem commented 4 years ago

In order to take advantage of react and to improve the UX, I think the results from processLinks in parse.go should be fed to a channel that will distribute the values using server sent events. This will allow updating the link table as new values are received and reducing the content download for links with many children.

KingAkeem commented 4 years ago

66933b1a5cc5782a97b89ece415449973108c469