hinneburg / TopicExplorer

TopicExplorer
GNU Affero General Public License v3.0
11 stars 3 forks source link

collect blog provider ulrls especially japanese #89

Open hinneburg opened 10 years ago

hinneburg commented 10 years ago

collect blog provider ulrls especially japanese

hinneburg commented 10 years ago

Wikipedia gives an overview: http://en.wikipedia.org/wiki/Category:Blog_hosting_services . See also the pages in other languages.

mangelus commented 10 years ago

that are the domains where kizashi.jp (a japanese blog search engine) is searching in: blog.goo.ne.jp, blogs.yahoo.co.jp, d.hatena.ne.jp, minkara.carview.co.jp, ameblo.jp, shinshu.fm, cocolog-nifty.com, txt-nifty.com, sportsnavi.com, air-nifty.com, moe-nifty.com, way-nifty.com, tea-nifty.com, election.ne.jp, de-blog.jp, a-thera.jp, oricon.co.jp, at.webry.info, blog.livedoor.jp, yaplog.jp, blogs.dion.ne.jp, ap.teacup.com, cscblog.jp, blog.so-net.ne.jp, blog.ocn.ne.jp, mo-blog.jp, asablo.jp, no-blog.jp, blog.shinobi.jp, blog.plaync.jp, doorblog.jp, 2chblog.jp.

fluecke commented 10 years ago

additional blog provider: hatenablog.com

Edit 15.08.2014: blogspot.com blog.fc2.com exblog.jp wordpress.com

Edit 15.09.2014: blog.excite.co.jp

fluecke commented 10 years ago

I took some time and identified the structure of links to blogs of the different providers kizashi.jp scans. Here is a list of globbing patterns that should contain Japanese blogs:

http*://blog.goo.ne.jp/*
http*://blogs.yahoo.co.jp/*
http*://d.hatena.ne.jp/*
http*://minkara.carview.co.jp/userid/*/blog/*
http*://ameblo.jp/*
http*://shinshu.fm/MHz/*
http*://*.cocolog-nifty.com
http*://*.txt-nifty.com/*
http*://*.air-nifty.com/*
http*://*.moe-nifty.com/*
http*://*.way-nifty.com/*
http*://*.tea-nifty.com/*
http*://plus-blog.sportsnavi.com/*
http*://election.ne.jp/*
http*://*.de-blog.jp/*
http*://*.a-thera.jp/*
http*://blog.oricon.co.jp/*
http*://*.at.webry.info/*
http*://blog.livedoor.jp/*
http*://yaplog.jp/*
http*://blogs.dion.ne.jp/*
http*://*.ap.teacup.com/*
http*://*.cscblog.jp/*
http*://*.blog.so-net.ne.jp/*
http*://*.blog.ocn.ne.jp/*
http*://*.mo-blog.jp/*
http*://*.asablo.jp/*
http*://*.no-blog.jp/*
http*://*.blog.shinobi.jp/*
http*://*.doorblog.jp/*
http*://*.2chblog.jp/*
http*://*.hatenablog.com/*