Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

--watch will error if the folder contains too many files #1007

Open
JakeChampion opened this issue Sep 6, 2023 · 4 comments
Open

--watch will error if the folder contains too many files #1007

JakeChampion opened this issue Sep 6, 2023 · 4 comments
Labels
bug Something isn't working

Comments

@JakeChampion
Copy link
Contributor

My project has lots of files (214,269 files) and when I try and use the --watch mode, the cli will error

Version

❯ fastly version
Fastly CLI version v10.4.0 (4b869ab)
Built with go version go1.21.0 linux/amd64
Viceroy version: viceroy 0.7.0

What happened

I ran fastly compute serve --watch and had this error happen:

2023/09/06 02:20:55 error configuring watching for file changes: open polyfill-libraries/polyfill-library-3.52.1/polyfills/__dist/Intl.PluralRules.~locale.os: too many open files
@JakeChampion JakeChampion added the bug Something isn't working label Sep 6, 2023
@Integralist
Copy link
Collaborator

@JakeChampion

214,269 files

Why Jake, why!? 😂

@JakeChampion
Copy link
Contributor Author

Nearly all of those files are used for KV Store entries ☺️

@Integralist
Copy link
Collaborator

We typically recommend defining a .fastlyignore and adding patterns for files/directories to skip. I appreciate that's not going to necessarily help your particular issue though.

@fgsch
Copy link
Member

fgsch commented Sep 22, 2023

Have you tried bumping your file descriptor limits (ulimit -n)? Even if this works I suspect keeping tabs of so many files is going to be very slow.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants