1
0
Fork 0
mirror of https://github.com/tldr-pages/tldr.git synced 2025-07-23 02:55:36 +02:00

katana: update page (#16355)

This commit is contained in:
Fazle Arefin 2025-05-04 01:47:14 +10:00 committed by GitHub
parent f0a0f57e5e
commit a0862638e7
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -2,7 +2,7 @@
> A fast crawler focused on execution in automation pipelines offering both headless and non-headless crawling.
> See also: `gau`, `scrapy`, `waymore`.
> More information: <https://github.com/projectdiscovery/katana>.
> More information: <https://docs.projectdiscovery.io/tools/katana/running>.
- Crawl a list of URLs:
@ -12,10 +12,6 @@
`katana -u {{https://example.com}} {{[-hl|-headless]}}`
- Use `subfinder` to find subdomains, and then use [p]a[s]sive sources (Wayback Machine, Common Crawl, and AlienVault) for URL discovery:
`subfinder {{[-dL|-list]}} {{path/to/domains.txt}} | katana -passive`
- Pass requests through a proxy (http/socks5) and use custom headers from a file:
`katana -proxy {{http://127.0.0.1:8080}} {{[-H|-headers]}} {{path/to/headers.txt}} -u {{https://example.com}}`