Data Search Engine
Have the ability to search billions of datasets that are manually imported retroactively!
Fork of Search.0t.rocks
Instructions
- Clone the repo
git clone "https://github.com/vulnlol/DataSearchEngine"
- Enter into the repo
cd DataSearchEngine
- Run
sh ./build-and-run.sh or docker compose build; docker compose up
- After that is complete do
sh ./add-solar-records.sh
Adding Data (DO THIS AFTER FOLLOWING THE INSTRUCTIONS ABOVE)
- Download Solr from here using the BINARY release
- Extract and enter Solr
- Then enter
sh bin/post -c BigData -p 8983 -host 127.0.0.1:8983 FILE where you replace file with the actual path for the file containing the data.
Improvements
- Enhanced styling across all pages and those lacking any at all
- Implemented a json based login system
- Admin Panel (not implemented yet)
- Search News For Keywords (not implemented yet)
Admin Panel
( This Isn't Implemented Yet )
I will be introducing a admin panel in the future, it will have the ability to toggle user logins, the ability to toggle user registration, force password resets, and a way to add upload datasets to the databases.
Though the default login is admin:password
Contributions
I'm open to any and all contribtuions and suggestions to the search engine. Feel free to make a pull request and if all goes well then it will be merged.
Demo
REMOVED
Search Field Parameters
* Accuracy Radius
* Address
* ASN
* ASN Org
* Auto Body
* Auto Class
* Auto Make
* Auto Model
* Auto Year
* Birth Year
* Birth Month
* Birthday
* City
* Continent
* Country
* DOB
* Domain
* Emails
* Ethnicity
* FirstName
* MiddleName
* Gender
* Income
* IPs
* LastName
* LatLong
* Line
* Links
* Location
* Notes
* Party
* Passwords
* Phone Numbers
* Photos
* Source
* State
* Usernames
* VIN
* Zip Code
* VRN
* SSN
* License Number
* Debit Number
* Debit Expiration
* Debit Pin
* Credit Number
* Credit Expiration
* Credit Pin
* Passport Number
* Military ID
* Bank Account Numbers
* Schools Attended
* Certifications
Why is this open sourced?
Originally, I had not planned to open source this project or publish it online at all since I was going to run it on a local system. However, a turn of events has led me to reconsider this decision. A former collaborator, who was part of the project but did not contribute to the backend development, coding, or design—areas where I exclusively worked—began to show an unexpected interest in the detailed setup and operation of the project just before their departure. They did not contribute any suggestions or code during their time with the project.
Their inquiries intensified suddenly, focusing on how to get the project started, where the problems in the original code were, and how various components were supposed to function. This occurred despite the known issues with the original version hosted at searchl.0t.rocks, which included a non-functional wallet system and broken setup scripts.
After they left, I learned through mutual contacts at a convention that they were attempting to sell the project despite it having an Apache V2 license. Given these circumstances, I have decided to open source the project to protect its integrity and ensure that its use aligns with my terms and conditions. This decision is meant to reflect the true scope of my contributions and safeguard the project's original vision.
Was going to call it valor intelligence search engine if you are wondering what the names are in the various pages.
Ps, fuck you