You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
TLSH hashing of response bodies to create a way to offline compare crawled files.
Describe the use case of this feature:
To compare file "signatures" offline (without saving the crawled files) hashes are the simple and usually accepted solution. However, with dynamic pages, the requested files can be different on each request. TLSH could be used to solve this issue (without getting into interpreting the files, which could be another , more complex feature).
In order to avoid slowing down the crawler, the feature could be added as optional that can be enabled with a CLI flag.
Output is only needed in JSON IMO.
The text was updated successfully, but these errors were encountered:
Please describe your feature request:
TLSH hashing of response bodies to create a way to offline compare crawled files.
Describe the use case of this feature:
To compare file "signatures" offline (without saving the crawled files) hashes are the simple and usually accepted solution. However, with dynamic pages, the requested files can be different on each request. TLSH could be used to solve this issue (without getting into interpreting the files, which could be another , more complex feature).
In order to avoid slowing down the crawler, the feature could be added as optional that can be enabled with a CLI flag.
Output is only needed in JSON IMO.
The text was updated successfully, but these errors were encountered: