search

crtsh / certwatch_db

Database schema
https://crt.sh/
GNU General Public License v3.0
199 stars 36 forks source link

Queries with a limit of 999 results #70

Closed franccesco closed 4 years ago

franccesco commented 4 years ago

I've noticed that some queries have a limit of 999 results when appending &output=json, which is fine actually, but is there a way to get the rest of the results? Maybe a pagination option on the URL?

image

Example: https://crt.sh/?dNSName=%25edu.ni&output=json

robstradling commented 4 years ago

This was due to https://crt.sh/forum?place=msg%2Fcrtsh%2FPJBu5cvm0G8%2FiCIy0vBPAwAJ. I'm not sure how I managed to implement a limit of 1000 but write "10000" in that post. Sorry about that!

The new crt.sh system (launched yesterday) definitely does have a 10000 limit. https://crt.sh/?dNSName=edu.ni&output=json currently returns 3271 entries.

(Unfortunately, removing this 10000 limit causes crt.sh to fall over, due to the volume of searches that users keep performing for domain names for which there are hundreds of thousands of certs).