httpx

httpx is an HTTP probing toolkit written in Go and built on the retryablehttp library. It accepts hosts, URLs, or CIDR ranges as input (via -u, -l list files, or raw request files with -rr, including Burp input mode) and runs a set of probes against each target. It falls back from https to http by default and handles retries and backoffs to cope with WAFs, aiming to keep results reliable at higher thread counts.

Probes cover status code, content length and type, title, web server, response time, line and word counts, redirect location, body hash (md5, mmh3, simhash, sha1, sha256, sha512), favicon mmh3 hash, JARM fingerprint, IP, CNAME, ASN, CDN/WAF detection, WebSocket, HTTP/2, HTTP pipelining, and virtual hosts. Technology detection uses the Wappalyzer dataset, with an option to supply a custom fingerprint file. Additional flags probe domains extracted from TLS certificates (-tls-probe) or CSP headers (-csp-probe), set ports with nmap-style syntax (-p), and probe specific paths (-path). A headless Chrome mode (-screenshot) saves page screenshots and can run JavaScript after navigation.

Output can be narrowed with matchers (-mc, -ml, -ms, -mr, -mcdn, -mrt, DSL conditions via -mdc) and filters (-fc, -fl, -fs, -fe, -fcdn, -frt, -fd for near-duplicate responses, -fpt for page types such as login, captcha, parked). Extractors (-er, -ep) pull content using a regex or presets for url, ipv4 and mail. Defaults are 50 threads and 150 requests per second, adjustable with -t, -rl and -rlm.

It is mainly used by security researchers, penetration testers, and bug bounty hunters to triage large lists of hosts, for example output from subdomain enumeration, and by anyone who needs bulk HTTP service fingerprinting. The README notes it is under active development with possible breaking changes, and that it was built as a standalone CLI, so running it as a service may carry security risks. Installation requires Go 1.25.0 or later.

Installation

# via Go
go install -v github.com/projectdiscovery/httpx/cmd/httpx@latest