Kagi Small Web is an initiative by Kagi.
Kagi's mission is to humanize the web and this project is built to help surface recent results from the small web - people and stories that typically zip by in legacy search engines. Read more about it in the announcement blog post.
Few things to note:
Kagi search engine surfaces posts from the small web for relevant queries in its search results.
Try the Kagi Small Web website.
You can also use the RSS feed or access these results as a part of a broader Kagi News Enrichment API.
There is an OPML file of the sites which make up the above RSS feed
If the blog is included in small web feed list (which means it has content in English, it is informational/educational by nature and it is not trying to sell anything) we check for these two things to show it on the site:
Add a new personal blog RSS feed to the list. Rules:
Hint: To extract the RSS link from a YouTube channel, you can use this tool.
Remove a website if :
Clicking "Remove website" will edit small web list in new tab, where you can locate and remove the website feed in question. Make sure to add in comments the reason for removal.
What is Small Web exactly? Recommend reading:
smallweb.txt - Contains the feeds of indexed blogs
smallyt.txt - Contains the feeds of indexed YouTube channels
yt_rejected.txt - Contains the list of YouTube channels that were reviewed (in an automated way) and rejected
app/ - App powering the Kagi Small Web website
The original list of small web blogs has been assembled from various sources including:
The seed list for YouTube channels has been assembled from these HN discussions.
Show duplicate domains:
awk -F/ '{print $3}' smallweb.txt | sort | uniq -d | while read domain; do echo "$domain"; grep "$domain" smallweb.txt; echo ""; done