httpx
httpx is a powerful HTTP toolkit designed for automated workflows within the Canva cybersecurity platform. It effectively detects web application technologies and captures screenshots, enabling thorough reconnaissance of web assets during security assessments.
Ideal Use Cases & Fit
This tool is particularly effective in scenarios that require comprehensive evaluation of web applications, such as discovering application layers, technologies used, and potential weaknesses. Inputs typically consist of newline-separated subdomains, making it suitable for large-scale investigations. It excels in identifying vulnerabilities in environments under active surveillance, but may not be the best fit for deep penetration testing where more intrusive tools are required.
Value in Workflows
In security workflows, httpx serves as an essential reconnaissance step, providing valuable insights into the structure and technology stack of web applications. By integrating it in early stages of assessments, teams can gather crucial data for follow-up analysis or more targeted penetration tests. Its flexibility allows for output that can be utilized in subsequent workflow phases, enhancing overall efficiency and effectiveness.
Input Data
The tool expects input in the form of a newline-separated list of subdomains. This is necessary for targeting specific web applications for probing and reconnaissance. For example:
subdomain.example.com
subdomain2.example.com
Configuration
- silent: Controls whether output is saved silently to a file. Defaults to true.
- proxy: Specifies the proxy to be used for HTTP requests, essential for monitoring output.
- json: Determines if the output should be formatted as JSON. Typically set to true.
- status_code: Optionally displays the HTTP response status code from requests.
- content_length: Optionally displays the content length of the HTTP response.
- content_type: Optionally displays the content type for the response received.
- favicon: Optionally includes the mmh3 hash for the favicon in the output.
- tech_detect: Optionally enables technology detection used by the web application.
- follow_redirects: Dictates whether to follow HTTP redirects during the probing process.
- include_response: Determines if the response body should be included in the output.
These configurations allow users to customize the behavior of httpx to suit specific reconnaissance needs, optimizing the flow of security assessments in automated workflows.