Compare factors in differential expression #185
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This enables comparing all pairs of experimental factors in differential expression (DE) datasets.
Previously in #184, only two factors could be compared, e.g. "space flight" and "ground control". This was inadequate for DE datasets with more than two factors, e.g. "space flight", "ground control", and "vivarium control".
See the updated "Differential expression" example:
For datasets with many factors, naively encoding all possible pairwise combinations in the same Ideogram.js annotation JSON file causes very large file sizes. The number of pairwise comparisons in a dataset with n factors is given by n! / (2! * (n - 2)!).
Left unoptimized, for 20 factors this could yield 30-50 MB JSON files and load times of 10-20 seconds with average U.S. bandwidth -- an unacceptable user experience.
To address that, these changes also split DE datasets with n factors into n JSON files. So instead of a 20-factor DE dataset requiring a file size of 190x, it requires a file size 20x. This graphs shows the relative rates of growth of the old and new data structures.