DedSecInside / TorBot

Dark Web OSINT Tool
Other
2.95k stars 537 forks source link

Changed mysql database to mongo #118

Closed shivankar-madaan closed 5 years ago

shivankar-madaan commented 6 years ago

Issue # not assigned

Changes Proposed

Screenshots of new feature/change

screen shot 2018-08-22 at 5 52 49 pm

Creating a collection torbot, with the link field indexed and unique as True

PSNAppz commented 6 years ago

@atlking-Novetta Should we merge this?

PSNAppz commented 6 years ago

@shivankar-madaan Could you write test case for the same?

shivankar-madaan commented 6 years ago

sure @PSNAppz Just in case, any references for writing the test case, at your end?

PSNAppz commented 6 years ago

@shivankar-madaan I think you can ask @KingAkeem about it.

KingAkeem commented 6 years ago

@shivankar-madaan There aren't really any references for this since your making a database tests case. You're going to just need to research how to write db tests, you'll probably have to create a mock db object.

shivankar-madaan commented 6 years ago

ok sure @KingAkeem I will look into it. Just pitching an idea in, should we change the json structure which is stored in database, of the result, to something like this

{ "url":"user_inputted_tor_link.onion",
"links_result":[
"tor_link1.onion", 
"tor_link2.onion",
"tor_link3.onion"]
}
#the above just being one doc
{ "url":"another_user_inputted_tor_link.onion",
"links_result":[
"tor_link.onion", 
"tor_link2.onion",
"tor_link4.onion"]
}

Currently one doc is just storing one link, as per the screenshot I guess, the above proposed new idea, would be in terms of the visualizer module as well. https://github.com/DedSecInside/TorBot/issues/94

PSNAppz commented 6 years ago

Can we store some details like page title with the page so that the visual module can print names rather than printing the link.

PSNAppz commented 6 years ago

@shivankar-madaan Status on this?

KingAkeem commented 5 years ago

There has no been response for over a month.