Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

how to deal with filenames when downloading data from WIS2 ? #19

Open
maaikelimper opened this issue Jun 13, 2024 · 0 comments
Open

how to deal with filenames when downloading data from WIS2 ? #19

maaikelimper opened this issue Jun 13, 2024 · 0 comments
Assignees
Labels
question Further information is requested

Comments

@maaikelimper
Copy link
Collaborator

When using the filename from the URL and subscribing to cache, we noted that depending on which cache was used, files may or may not have a file-extension:
image

When subscribing to origin we also noted for data-providers like de-dwd we end up with ',' in the filename extracted from the URL:
image

Dave experimented with using a hashed data-id plus extension extracted from mimetype, which ends up with filenames that offer no information whatsoever about the content:

image

(in this example I self-subscribed and published test-data, in the downloaded result I lose the convenient naming convention of the bufr process used in wis2box!)

Discussing with Enrico he suggested that as a user you would at least want to get "datetime" include in the filename, which may or may not be included in the original URL, but could be parsed from the message-properties.

@tomkralidis what would you suggest based on your experience on users using pywis-pubsub for downloading data ?

@maaikelimper maaikelimper added the question Further information is requested label Jun 13, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants