search

subfinder / research

❄️ Research project for SubFinder core API V2
MIT License
35 stars 8 forks source link

Add waybackarchive #41

Closed picatz closed 6 years ago

picatz commented 6 years ago

This PR aims to fix https://github.com/subfinder/research/issues/35

picatz commented 6 years ago 
$ go test -run=Wayback -bench=Wayback -v
=== RUN   TestWaybackArchive
--- PASS: TestWaybackArchive (23.82s)
    waybackarchive_test.go:25: 21 
         Success:  21 Failure:  0
=== RUN   TestWaybackArchiveMultiThreaded
--- PASS: TestWaybackArchiveMultiThreaded (16.03s)
=== RUN   ExampleWaybackArchive
--- PASS: ExampleWaybackArchive (7.61s)
=== RUN   ExampleWaybackArchiveMultiThreaded
--- PASS: ExampleWaybackArchiveMultiThreaded (10.52s)
goos: darwin
goarch: amd64
BenchmarkWaybackArchiveSingleThreaded-8            1    23100700580 ns/op
BenchmarkWaybackArchiveMultiThreaded-8             1    19794600772 ns/op
PASS
ok      _/research/core/sources 100.901s