projectdiscovery / katana

A next-generation crawling and spidering framework.
MIT License
10.97k stars 583 forks source link

Can auto crawl parent dir #867

Open anquanscan opened 5 months ago

anquanscan commented 5 months ago

Is support auto scan parent dir,such as find a link like "/templates/2009/index.css", then auto detect /templates/2009/ /templates/

anquanscan commented 5 months ago

@ehsandeep

anquanscan commented 5 months ago

@Mzack9999

dogancanbakir commented 5 months ago

This could be a valuable inclusion in the input preprocessing stage to improve the crawling coverage -it can be optional. 💭 What do you think @Mzack9999 ?

anquanscan commented 5 months ago

This could be a valuable inclusion in the input preprocessing stage to improve the crawling coverage -it can be optional. 💭 What do you think @Mzack9999 ?

I have found that other tools can do this, and I really hope to add this feature. Thank you

0x3D55476273463264 commented 5 months ago

This could be a valuable inclusion in the input preprocessing stage to improve the crawling coverage -it can be optional. 💭 What do you think @Mzack9999 ?

I have found that other tools can do this, and I really hope to add this feature. Thank you

Could you tell which ones?

anquanscan commented 5 months ago

This could be a valuable inclusion in the input preprocessing stage to improve the crawling coverage -it can be optional. 💭 What do you think @Mzack9999 ?

I have found that other tools can do this, and I really hope to add this feature. Thank you

Could you tell which ones?

this https://github.com/chaitin/rad , but it is not opensource。

anquanscan commented 5 months ago

@Mzack9999 When can this requirement be developed? Thank you.