Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Memory stack overflow when loading large GeoPackages #1

Closed
redmer opened this issue Sep 14, 2023 · 0 comments · Fixed by #2 or #3
Closed

Memory stack overflow when loading large GeoPackages #1

redmer opened this issue Sep 14, 2023 · 0 comments · Fixed by #2 or #3

Comments

@redmer
Copy link
Owner

redmer commented Sep 14, 2023

When loading a 180 MB GeoPackage file, too many RDF.Quads are generated in a non-streaming fashion.

First priority, enable some limits on the Quad generation.

Secondly, work out how RDF.Stream works.
redmer added a commit that referenced this issue Sep 14, 2023
@redmer
feat: limit features to a bounding box
ca2c4bf 
partially resolves #1
@redmer redmer mentioned this issue Sep 14, 2023
Merged
@redmer redmer closed this as completed in #2 Sep 14, 2023
redmer added a commit that referenced this issue Sep 14, 2023
@redmer
feat: limit features to a bounding box (#2)
ffbb0b9 
partially resolves #1
@redmer redmer mentioned this issue Sep 15, 2023
Merged
redmer added a commit that referenced this issue Sep 15, 2023
@redmer
feat: streaming result (#3)
cd48e53 
This update adds full streaming capabilities. File limits are no longer an issue generating quad files.

Also:

- skip binary values
- skip certain layers
- provide a base IRI

fixes #1
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
1 participant
@redmer