Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Update S3 Ingestion workflow to support PerSectionParameter #1056

Open
Tracked by #780 ...
manasaV3 opened this issue Aug 21, 2024 · 0 comments
Open
Tracked by #780 ...

Update S3 Ingestion workflow to support PerSectionParameter #1056

manasaV3 opened this issue Aug 21, 2024 · 0 comments
Assignees
Labels
backend P0 Must have

Comments

@manasaV3
Copy link
Contributor

manasaV3 commented Aug 21, 2024

Task

Update the existing ingestion workflow to support capturing metadata for the per section parameters.

The changes required for the entities are as follows:

Tiltseries Metadata

{
...
"per_section_parameters" : [
    {
        "frame_path": "10000/TS_026/Frames/frame1.tiff",
        "raw_angle": 0.1,
        "z-index": 15,
        "frame_acquistion_order": 1,
        "astigmatic_angle": 0.324,
        "major_defocus": 1.234,
        "minor_defocus": 2.345,
        "phase_shift": 3.456,
        "max_resolution": 9.876
    },
    ...
],
...

How are the data sourced?

Name Data type Nullable Where is this sourced from
astigmatic_angle float true The ctf file should be the source for this. ctf_model.azimuth
frame_acquisition_order int false The Mdoc file should be the source for this field.
frame_path str true The Mdoc file should be the source for this field.
major_defocus float true The ctf file should be the source for this. ctf_model.defocus_1
minor_defocus float true The ctf file should be the source for this. ctf_model.defocus_2
max_resolution float true The ctf file should be the source for this. ctf_model.max_resolution
phase_shift float true The ctf file should be the source for this. ctf_model.phase_shift
raw_ange float false The Mdoc file should be the source for this field.
z_index int false This is the index of the angle, in the raw tlt file. The raw-tlt file is zero-indexed.

What done looks like?

Notes

  1. https://gist.github.com/uermel/9632d5e32e4ee861502ba2a019e3bc20
@manasaV3 manasaV3 added backend P0 Must have labels Aug 21, 2024
@junxini junxini added this to the sprint 3 (phase 4) milestone Aug 22, 2024
@manasaV3 manasaV3 added P1 Should have and removed P0 Must have labels Aug 28, 2024
@manasaV3 manasaV3 removed this from the sprint 3 (phase 4) milestone Sep 4, 2024
@manasaV3 manasaV3 removed their assignment Nov 27, 2024
@manasaV3 manasaV3 changed the title Update S3 Ingestion workflow to support CTF Update S3 Ingestion workflow to support PerSectionParameter Jan 24, 2025
@manasaV3 manasaV3 added P0 Must have and removed P1 Should have labels Jan 24, 2025
@junxini junxini added this to the sprint 1 (phase 5) milestone Jan 28, 2025
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
backend P0 Must have
Projects
None yet
Development

No branches or pull requests

2 participants