New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Technology detection failures #67

Open

max-ostapenko opened this issue Sep 24, 2024 · 0 comments

Labels

bug

max-ostapenko commented Sep 24, 2024 •

edited

Loading

During the crawl no technology detected for 2% out of top 10000 pages.
Running detection on my laptop is successful.

SELECT
  page,
  rank
FROM `httparchive.all.pages`
WHERE date = "2024-09-01"
  AND is_root_page
  AND client = 'mobile'
  AND rank <= 10000
  AND ARRAY_LENGTH(technologies)=0
ORDER BY rank, page

Tried to retest it on WPT:

WPT testing lasted really long (10-20min) and nothing detected again. Pages loaded slow too (up to 100s).
Seems like a performance issue.

@pmeenan is it possible to investigate these?

max-ostapenko added the bug label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment