Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

jemalloc thread creation error on older distro #6331

Closed
lnicola opened this issue Sep 8, 2022 · 3 comments
Closed

jemalloc thread creation error on older distro #6331

lnicola opened this issue Sep 8, 2022 · 3 comments

Comments

@lnicola
Copy link
Contributor

lnicola commented Sep 8, 2022

Expected behavior and actual behavior.

$ docker run --rm osgeo/gdal:latest gdalinfo --version
<jemalloc>: arena 0 background thread creation failed (1)
GDAL 3.6.0dev-e10d39568c6ab37077f4b6bc2ee3fb93e1e4d41e, released 2022/06/28

Not yet sure if this is just a cosmetic problem or if it causes other problems too.

Operating system

CentOS 7: can reproduce
Arch Linux: can't reproduce

@rouault
Copy link
Member

rouault commented Sep 8, 2022

I believe this might be related to the Parquet driver since libarrow/libparquet uses jemalloc. https://stackoverflow.com/questions/59495151/reading-pandas-from-disk-during-concurrent-process-pool has a similar error message.
Perhaps something too old with CentOS 7 Linux kernel or some additional parameter to pass to docker. May be try adding --privileged just after --rm ?

Looking at http://jemalloc.net/jemalloc.3.html#tuning, maybe you can also try adding -e MALLOC_CONF=background_thread:false just after --rm

@lnicola
Copy link
Contributor Author

lnicola commented Sep 8, 2022

MALLOC_CONF doesn't work, but --privileged does. I think this might be related to using an older version of Docker and https://bugzilla.redhat.com/show_bug.cgi?id=2011523.

Sorry for the noise, but at least it might provide some workaround to anyone else running into it.

@rouault
Copy link
Member

rouault commented Sep 8, 2022

cf #6332 for a troubleshooting section added to the Docker README.md

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants