Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Plasma][C++] plasma-store-server start with -h , occur bus error #33204

Closed
asfimport opened this issue Oct 12, 2022 · 4 comments
Closed

[Plasma][C++] plasma-store-server start with -h , occur bus error #33204

asfimport opened this issue Oct 12, 2022 · 4 comments

Comments

@asfimport
Copy link
Collaborator

use plasma as a shared-memory ,

start with these args:

./plasma-store-server -m 1000000 -s /tmp/test -d /dev/shm -h

occurs bus error

/home/arrow/arrow/cpp/src/plasma/store.cc:1277: Allowing the Plasma store to use up to 0.001GB of memory.
/home/arrow/arrow/cpp/src/plasma/store.cc:1300: Starting object store with directory /dev/shm and huge page support enabled
/home/arrow/arrow/cpp/src/plasma/store.cc:1328:  hugepage enable , SetMallocGranularity.
/home/arrow/arrow/cpp/src/plasma/store.cc:1349: starting server listening on /tmp/test
/home/arrow/arrow/cpp/src/plasma/store.cc:1154: new PlasmaStore...
/home/arrow/arrow/cpp/src/plasma/store.cc:1163: Memalign...pointer
/home/arrow/arrow/cpp/src/plasma/plasma_allocator.cc:34: Memalign,alignment=64;bytes=997952
internal memalign
internal malloc req = 998056,nb = 997968,min_chunk_size = 32,chunk_overhead = 8
Bus error

 

env:

[root@02a40e9b75b6 release]# free
              total        used        free      shared  buff/cache   available
Mem:       12979512     6299224     1163552      369948     5516736     5990072
Swap:       4194304       16480     4177824
[root@02a40e9b75b6 release]# uname -a
Linux 02a40e9b75b6 5.10.16.3-microsoft-standard-WSL2 #1 SMP Fri Apr 2 22:23:49 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Environment: [root@02a40e9b75b6 release]# free
total used free shared buff/cache available
Mem: 12979512 6299224 1163552 369948 5516736 5990072
Swap: 4194304 16480 4177824
[root@02a40e9b75b6 release]# uname -a
Linux 02a40e9b75b6 5.10.16.3-microsoft-standard-WSL2 #1 SMP Fri Apr 2 22:23:49 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Reporter: xingwang li

Note: This issue was originally created as ARROW-18000. Please see the migration documentation for further details.

@asfimport
Copy link
Collaborator Author

Joris Van den Bossche / @jorisvandenbossche:
Not an answer to you actual issue, but note that Plasma is deprecated (see ARROW-17860 and the email thread that is linked there)

@asfimport
Copy link
Collaborator Author

Kouhei Sutou / @kou:
https://arrow.apache.org/docs/python/plasma.html#using-plasma-with-huge-pages

It seems that you need to crate a new filesystem to use huge page.

@asfimport
Copy link
Collaborator Author

xingwang li:
@jorisvandenbossche Plasma is deprecated. which component is replace it ? Is there a shared-memory component?

@jorisvandenbossche
Copy link
Member

Plasma has been deprecated (#33077) in Arrow 10.0 and subsequently removed in Arrow 12.0 (#33243). Given Plasma is no longer an existing component, closing this issue.

For reference, see this mailing list discussion around possible alternatives: https://lists.apache.org/thread/lk277x3b9gjol42sjg27bst2ggm5s0j2

@jorisvandenbossche jorisvandenbossche closed this as not planned Won't fix, can't repro, duplicate, stale Aug 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants