Option to store http responses to file

[vulnerablecodes]

An option to download all discovered files would be great. I know I can write a simple function to download all files via curl/wget etc, but having the option via katana itself would be ideal.

Based on - projectdiscovery/httpx#848

   -sr, -store-response              store http response to output directory
   -srd, -store-response-dir string  store http response to custom directory

[wdahlenburg]

@ehsandeep What are your thoughts on expanding this to allow for storing the HTTP request as well? In some cases I may just want the requests and in others the responses would be helpful. Perhaps they are stored as a pair, rather than the same file?

The current PR seems to drop the request body, which is a fixable issue on it's own, but I'd consider to be a bug.

The raw HTTP request is something that could be used by other tools, so long as it's "well-formed".

[ehsandeep]

@wdahlenburg thanks for pointing this and good point on the request, I will create a follow-up ticket as this can be extended to get more controls like response, request + response, response body and response header.

[wdahlenburg]

@wdahlenburg thanks for pointing this and good point on the request, I will create a follow-up ticket as this can be extended to get more controls like response, request + response, response body and response header.

I wrote that comment before I messed with proxify, but is there a good reason for the output formats to be different between katana and proxify?