Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Baidu Search API] Scrape actual links in Baidu results #2255

Closed
alexbarron opened this issue Dec 23, 2024 · 2 comments
Closed

[Baidu Search API] Scrape actual links in Baidu results #2255

alexbarron opened this issue Dec 23, 2024 · 2 comments
Assignees
@zyc9012
Labels
status: completed Completed work status: users notified Users were notified about the change type: improvement Something needs to be improved

Comments

@alexbarron
Copy link

We currently only scrape a Baidu link in the <a> tag that redirects to the actual search result. However Baidu makes the real link available in the mu param:

image

What we currently return:

image

Public links: Baidu Search

Internal links: Intercom
@alexbarron alexbarron added status: queued Ready to work on type: improvement Something needs to be improved labels Dec 23, 2024
@Taolinxs
Copy link

The same goes for mobile devices

@zyc9012 zyc9012 self-assigned this Jan 1, 2025
@zyc9012 zyc9012 closed this as completed Jan 3, 2025
@zyc9012
Copy link

zyc9012 commented Jan 3, 2025

We've released a fix for this. Now direct links are returned.

20250103_091854

@zyc9012 zyc9012 added status: completed Completed work and removed status: queued Ready to work on labels Jan 3, 2025
@alexbarron alexbarron added the status: users notified Users were notified about the change label Jan 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zyc9012 zyc9012

Labels
status: completed Completed work status: users notified Users were notified about the change type: improvement Something needs to be improved
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@zyc9012 @alexbarron @Taolinxs