search

TorSpider / TorSpider-Backend

The database backend with which the spiders share their discoveries.
BSD 3-Clause "New" or "Revised" License
1 stars 0 forks source link

Populate the page title from the base domain title if the page title would be empty. #43

Open haxys opened 6 years ago

haxys commented 6 years ago

Like it says on the tin. Once we've got the domain titles populated from their base url, we can populate the page title based on the domain's title if the page title would otherwise be empty.

haxys commented 6 years ago

This should be complete with the offload_to_backend pull request.