Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unique url #247

Closed
yuzhe-Mortal opened this issue Dec 22, 2022 · 1 comment · Fixed by #371
Closed

Unique url #247

yuzhe-Mortal opened this issue Dec 22, 2022 · 1 comment · Fixed by #371
Assignees
@RamanaReddy0M
Labels
Status: Completed Nothing further to be done with this issue. Awaiting to be closed. Type: Enhancement Most issues will probably ask for additions or changes.
Milestone
katana v1.0.1

Comments

@yuzhe-Mortal
Copy link
Contributor

https://baike.baidu.com/planet/talk?lemmaId=3407384
https://baike.baidu.com/planet/talk?lemmaId=3407385
https://baike.baidu.com/planet/talk?lemmaId=3407386
https://baike.baidu.com/planet/talk?lemmaId=......
Many urls with different parameters
It should be possible to filter these links by adding a options
image
@yuzhe-Mortal yuzhe-Mortal added the Type: Enhancement Most issues will probably ask for additions or changes. label Dec 22, 2022
@Mzack9999 Mzack9999 mentioned this issue Dec 22, 2022
Closed
@Mzack9999 Mzack9999 self-assigned this Dec 22, 2022
@yuzhe-Mortal
Copy link
Contributor Author

I don't know if removing params has any other effect

@Mzack9999 Mzack9999 removed their assignment Dec 22, 2022
@ShubhamRasal ShubhamRasal self-assigned this Feb 22, 2023
@ShubhamRasal ShubhamRasal removed their assignment Mar 6, 2023
RamanaReddy0M added a commit that referenced this issue Mar 21, 2023
@RamanaReddy0M
Ignore crawling same path with different query-param values (#247)
497cf5b
@RamanaReddy0M RamanaReddy0M linked a pull request Mar 21, 2023 that will close this issue
Ignore crawling same path with different query-param values #371
Merged
@RamanaReddy0M RamanaReddy0M mentioned this issue Mar 21, 2023
Merged
ehsandeep pushed a commit that referenced this issue Mar 23, 2023
@RamanaReddy0M
Ignore crawling same path with different query-param values (#371)
8360c8a 
* Ignore crawling same path with different query-param values (#247)

* fix lint error
@ehsandeep ehsandeep added the Status: Completed Nothing further to be done with this issue. Awaiting to be closed. label Mar 23, 2023
@ehsandeep ehsandeep added this to the katana v1.0.1 milestone Mar 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@RamanaReddy0M RamanaReddy0M

Labels
Status: Completed Nothing further to be done with this issue. Awaiting to be closed. Type: Enhancement Most issues will probably ask for additions or changes.
Projects
None yet
Milestone
katana v1.0.1
Development

Successfully merging a pull request may close this issue.

Ignore crawling same path with different query-param values projectdiscovery/katana
5 participants
@ehsandeep @Mzack9999 @ShubhamRasal @yuzhe-Mortal @RamanaReddy0M