Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Defined field for uncertainties on each axis #53

Open
Chantler1 opened this issue Aug 25, 2015 · 2 comments
Open

Defined field for uncertainties on each axis #53

Chantler1 opened this issue Aug 25, 2015 · 2 comments

Comments

@Chantler1
Copy link

Dear Matt and Bruce
I feel that we should have definitions for column fields for uncertainty (standard deviation or standard error) both for the uncertainty in mass attenuation coefficient (cm^2/g) and also for the energy.
While energy is sometimes represented as a single offset with a single energy uncertainty, ideally it maps into a field for each channel, whether in slew or step mode.
For the attenuation coefficient it is quite clear that independent uncertainties permit a more unbiased determination of quality, especially with metadata indicating methodology or provenance. It also permits strong hypothesis testing. Hope that this helps ;)
In principle I would also expect a defined column field for both attentuation and for absorption. The latter is of course more directly relevant for XAFS, but most users will not know how to extract it so the attenuation column represents more fairly the data.

Very best wishes
Chris

@newville
Copy link
Member

@Chantler1 Thanks -- I agree that adding fields to hold uncertainties for all the signals (including energy) is a good idea. I believe that this can be solved at the level of documentation, convention and "recommended" settings (that is, that the code already can support this).

The XAS data library for the database uses names like "energy_stderr", "itrans_stderr", etc. We should probably use the same naming conventions. I would propose we add those as recommended labels for arrays containing standard error (or, at least some value expressing the estimated uncertainty in the corresponding data), but another naming convention could be fine too.

I think we haven't explicitly mentioned units for any of the intensity values, or distinguished attenuation from absorption in the intensity signals. I think it's OK to allow for these, but almost all the data will not make this distinction. Again in the data library code, there are "energy_notes", "i0_notes", etc. These could be used to hold such information, but probably this would be only "human readable". Thinking bout ow to encode these better would be interesting....

@Chantler1
Copy link
Author

Thanks for that Matt
I will maybe try a mock-up with my next paper and pass it to you, possibly before publication, to see if it might be helpful

Chris


Christopher Chantler, Professor, FAIP
Editor-in-Chief, Radiation Physics and Chemistry
Chair, International IUCr Commission on XAFS
Vice-President (Australasia) International Radiation Physics Society
School of Physics, University of Melbourne
Parkville Victoria 3010 Australia
+61-3-83445437 FAX +61-3-93474783
chantler@unimelb.edu.auhttps://owa.unimelb.edu.au/owa/redir.aspx?C=c7BoS0kVVkC1_S95-9x9l5cBu6YTjdAITgSrfUpfDAUV5oUH1LFYBcz08w8xvHMJoosZRdagfQM.&URL=mailto%3achantler%40unimelb.edu.au chantler@me.comhttps://owa.unimelb.edu.au/owa/redir.aspx?C=c7BoS0kVVkC1_S95-9x9l5cBu6YTjdAITgSrfUpfDAUV5oUH1LFYBcz08w8xvHMJoosZRdagfQM.&URL=mailto%3achantler%40me.com
http://optics.ph.unimelb.edu.au/~chantler/xrayopt/xrayopt.htmlhttps://owa.unimelb.edu.au/owa/redir.aspx?C=c7BoS0kVVkC1_S95-9x9l5cBu6YTjdAITgSrfUpfDAUV5oUH1LFYBcz08w8xvHMJoosZRdagfQM.&URL=http%3a%2f%2foptics.ph.unimelb.edu.au%2f%7echantler%2fxrayopt%2fxrayopt.html
http://optics.ph.unimelb.edu.au/~chantler/home.htmlhttps://owa.unimelb.edu.au/owa/redir.aspx?C=c7BoS0kVVkC1_S95-9x9l5cBu6YTjdAITgSrfUpfDAUV5oUH1LFYBcz08w8xvHMJoosZRdagfQM.&URL=http%3a%2f%2foptics.ph.unimelb.edu.au%2f%7echantler%2fhome.html


From: Matt Newville [notifications@github.com]
Sent: Tuesday, 25 August 2015 7:23 PM
To: XraySpectroscopy/XAS-Data-Interchange
Cc: Christopher Thomas Chantler
Subject: Re: [XAS-Data-Interchange] Defined field for uncertainties on each axis (#53)

@Chantler1https://github.com/Chantler1 Thanks -- I agree that adding fields to hold uncertainties for all the signals (including energy) is a good idea. I believe that this can be solved at the level of documentation, convention and "recommended" settings (that is, that the code already can support this).

The XAS data library for the database uses names like "energy_stderr", "itrans_stderr", etc. We should probably use the same naming conventions. I would propose we add those as recommended labels for arrays containing standard error (or, at least some value expressing the estimated uncertainty in the corresponding data), but another naming convention could be fine too.

I think we haven't explicitly mentioned units for any of the intensity values, or distinguished attenuation from absorption in the intensity signals. I think it's OK to allow for these, but almost all the data will not make this distinction. Again in the data library code, there are "energy_notes", "i0_notes", etc. These could be used to hold such information, but probably this would be only "human readable". Thinking bout ow to encode these better would be interesting....


Reply to this email directly or view it on GitHubhttps://github.com//issues/53#issuecomment-134537770.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants