search

hmol / LinkCrawler

Find broken links in webpage
MIT License
117 stars 59 forks source link

Output to SqlLite db file #6

Open hmol opened 8 years ago

mgroves commented 8 years ago

This seems straightforward enough. I would likely try to use Dapper to do this if that's okay with you? That could also mean that you could hypothetically add other other relational databases easily: SQL Server, MySQL, and so on. I would assume it would just be one simple table with the contents of IResponseModel inserted into each row?

hmol commented 8 years ago

I have not used Dapper before, but to me it sounds very useful. So I really think you should use it :thumbsup: Contents of IResponseModel in each row is good yes

mgroves commented 8 years ago

Here's the gist of it: https://gist.github.com/mgroves/f48d3add58527e5324be525c56e5b2fd

mgroves commented 8 years ago

I should note that that sqlite file gets large pretty quickly. Perhaps only WriteError should write to the db?

hmol commented 8 years ago

Yeah, that sounds very reasonable :+1:

dokkillo commented 7 years ago

and other type of DB? like file nosql db? like https://github.com/mbdavid/LiteDB

d80ep08th commented 4 years ago

wow , no commit since then ha

bphermansson commented 3 years ago

There is a PR (https://github.com/hmol/LinkCrawler/pull/34), should it just be merged and this issue closed?

hiteshbhavsar commented 2 years ago

Is this issue yet not resolved? Can I contribute to this project?