Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Katana Performs Poorly on Nuxt JS websites #579

Open
mitchgreen opened this issue Sep 2, 2023 · 1 comment
Open

Katana Performs Poorly on Nuxt JS websites #579

mitchgreen opened this issue Sep 2, 2023 · 1 comment
Labels
Type: Bug Inconsistencies or issues which will cause an issue or problem for users or implementors. Type: Question A query or seeking clarification on parts of the spec. Probably doesn't need the attention of all.

Comments

@mitchgreen
Copy link

katana version:

Katana Version 1.0.3

Current Behavior:

Currently when katana headless -hl or standard (without -hl) is run against a website that leverages the Nuxt JS framework, Katana performs poorly, missing obviously linked pages, returning few or no meaningful results for the website.

Expected Behavior:

Examples of websites where I would expect Katana to perform better but it does not, likely due to the site leveraging Nuxt JS:

  1. gitlab.com
  2. cdnjs.com
  3. upwork.com
  4. openai.com

Steps To Reproduce:

katana.exe -u 'https://cdnjs.com' -hl

Anything else:

Nothing else to add at this time, will update with more information as it is available.
@mitchgreen mitchgreen added the Type: Bug Inconsistencies or issues which will cause an issue or problem for users or implementors. label Sep 2, 2023
@Mzack9999 Mzack9999 added the Type: Question A query or seeking clarification on parts of the spec. Probably doesn't need the attention of all. label Dec 28, 2023
@Mzack9999
Copy link
Member

I think this might be mostly related to the way nuxt.js renders the page (ref. https://stackoverflow.com/questions/48577766/nuxt-sites-not-getting-crawled) as apparently the DOM is not fully generated but only upon UI interactions (such as scroll, click, etc) which katana is not currently supporting

@Mzack9999 Mzack9999 mentioned this issue Dec 28, 2023
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Type: Bug Inconsistencies or issues which will cause an issue or problem for users or implementors. Type: Question A query or seeking clarification on parts of the spec. Probably doesn't need the attention of all.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mitchgreen @Mzack9999