Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Too Many Requests" when bookmarking Reddit links #127

Closed
disposedtrolley opened this issue Apr 7, 2019 · 1 comment
Closed

"Too Many Requests" when bookmarking Reddit links #127

disposedtrolley opened this issue Apr 7, 2019 · 1 comment

Comments

@disposedtrolley
Copy link
Contributor

When attempting to bookmark a Reddit link, shiori is immediately blocked and a "Too Many Requests" error is returned, shown below.

Screenshot from 2019-04-07 10-55-50

It appears that Reddit is taking measures to prevent content from being scraped, and the workaround is to set a custom user-agent header for any requests destined for Reddit - https://www.reddit.com/r/redditdev/comments/3qbll8/429_too_many_requests/

One possible solution might be to feed the PID or Docker container ID into the readability module to be set as part of the user-agent header. This way each instance of shiori is identified separately which should prevent any rate limiting.

@RadhiFadlillah
Copy link
Collaborator

Since the ramadhan branch is merged, this issue should be fixed now. Now Shiori uses its own user agent :

User-Agent: Shiori/2.0.0 (+https://github.com/go-shiori/shiori)

Now it should works fine as can be seen in screenshot on readme.

With that said, I will close this issue for now. Feel free to reopen it if needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants