Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bus Error(Core dumped) when add lots of sectors in a short time #5531

Closed
zzx234234 opened this issue Feb 5, 2021 · 1 comment
Closed

Bus Error(Core dumped) when add lots of sectors in a short time #5531

zzx234234 opened this issue Feb 5, 2021 · 1 comment

Comments

@zzx234234
Copy link
Contributor

Describe the bug
I run a localnet with 512MiB sectors and pledge lots of sectors in a very short time (using a script), then this error occured in minutes.

it seems this error caused by multicore addpiece. my cpu has 112 cores, when adding more than 20 pieces in the same time, lotus creates tens of thousands threads to do the work and receive SIGSEGV at __memmove_avx_unaligned_erms().

I revert /extern/sector-storage/ffiwrapper/sealer_cgo.go before #5320 , there's no error

To Reproduce
run a localnet with 512MiB sectors
pledge 100 sectors in a short time

Version (run lotus version):
since #5320

@Reiers
Copy link

Reiers commented Mar 16, 2022

@zzx234234 Hi

Well if you throw to many sectors at your miner or worker it will stop - shutdown with: Bus Error(Core dumped)
My guess is that your CPU has 56 cores, and 56 threads - total 112.

when adding more than 20 pieces in the same time, lotus creates tens of thousands threads to do the work and receive SIGSEGV at __memmove_avx_unaligned_erms().

  • If you want utilize multicore then you can run max 18 AP jobs at once.
    If you dont have the environment FIL_PROOFS_USE_MULTICORE_SDR=1 set, then you can throw 56 AP jobs at your CPU at once.

I dont see this as an issue - just dont pledge more sectors than your system can handle.

If you are still experiencing problems, ask for help in our Discussions forum.

Thank you !

@Reiers Reiers closed this as completed Mar 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants