More cnmf stuff

[kushalkolar]

No description provided.

[kushalkolar]

Ideas:

• Put each gridplot in an accordian widget so they can be minized if desired

Current issues:

• Some infinite recursion issue when clicking components or using slider, should be easy to fix. But moving the heatmap works to select components.
• Heatmap y-axis component selector acts weird (too fast) when changing row.
• Other weird stuff when changing row

mesviz-sep-2023-09-18_05.44.23.mp4

[kushalkolar]

button to zscore or 0-1 normalize heatmaps and temporals

[kushalkolar]

• changing CNMF items seems to work fine

TODO:

• click events on spatial contours is causing infinite recursion and is very slow, even before changing cnmf items
• checkbox to have auto-zoom into spatial component when it is selected from the heatmap.
• switch CNMF to just using ImageWidget if the data requested for a given gridplot are all image-type. Do not allow a mix of image and temporal data within the same gridplot. This is too complicated now, especially since everything now works with contours and all the events etc. The only thing we loose from ImageWidget at this point is vmin-vmax setters, which will come from fpl vmin-vmax histogram widget eventually, and the mean windows functions which could be implemented within the CNMFVizContainer
• color components in diff ways
• use this type of DummyMovie to display 2D images and movies within the same ImageWidget for both mcorr and CNMF

  class DummyMovie:
      def __init__(self, image: np.ndarray, shape, ndim, size):
          self.image = image
          self.shape = shape
          self.ndim = ndim
          self.size = size
          
      def __getitem__(self, index: int):
          return self.image

[kushalkolar]

Component eval would be nice to add to here but I will do that later.

[kushalkolar]

Current state:

mesviz_epic-2023-10-14_02.53.48.mp4

@EricThomson note that it's a bit slower because I was recording and encoding at 4k while using this.

[kushalkolar]

This is not yet implemented, will do in a future PR

[kushalkolar]

I'm going to delete this later, we will let pynapple take care of this :D

[kushalkolar]

I was able to remove this because of ImageWidget.set_data()

[kushalkolar]

One more easy todo:

• gsig filt viz for mcorr, use a checkbox to enable it.

[kushalkolar]

I'm just going to enforce this layout for CNMF:
temporal & heatmap on the left, gridplot of any combo of images on the right

[kushalkolar]

Since I have decided to contrain the CNMF viz to be temporal & heatmap + images, I should just switch to using ImageWidget because it will handle all of this automatically: fastplotlib/fastplotlib#344

We can still allow some customization:

• choosing to postprocessing temporal and heatmap (zscore etc.)
• choosing which images to show

Eval UI can then just be placed below everything.

[kushalkolar]

alright, the beta is basically done. Works in notebook and Qt via %gui qt. Dataframe and UI is shown in notebook regardless because heavy Qt UI is tedious

https://www.youtube.com/watch?v=GWvaEeqA1hw

Final result is:

mcorr

ImageWidget that displays any selection of image-sequences (input, mcorr) and images (mean, corr etc.).

CNMF

This offers a lot

Displays single temporal component, heatmap, and a selection o image-sequences or images (just like mcorr).

Features:

• Color contours based on quality metrics, or accepted/rejected.
• View only accepted or rejected components, all components, or all with transparency on accepted or rejected.
• Interactive component evaluation with sliders/int spinbox to set quality params and then view the result immediately using the contour color option that is set.
• Manually accept or reject a component using "a" and "r" keys.
• Zoom into components automatically while using the slider or heatmap selector to move through components
• Displays the quality metric values for the currently selected component
• Save the new component indices after evaluation with quality metrics and manual selection