Data inspector

[ffreyer]

Plots TODO:

• 2D and 3D scatter (marker position)
• 2D and 3D meshscatter (marker position)
• 2D and 3D mesh (bounding box)
• 2D and 3D lines (position on line)
• 2D and 3D linesegments (position on line)
• heatmap, image (indices + value)
• barplot (and hist) (bar x-position + height)
• arrows kinda
• surface (position on surface)
• volume?
• text

Any plot that isn't listed will fallback to the primitives it uses. (I.e. mesh, meshscatter, scatter, lines, linesegments, surface, heatmap, image, volume, text)

General/outside TODO:

• Change stencil to scissor test in SSAO GLMakie.jl#175 include model in the calculation of bounding boxes so that the 3D indicator works with a background mesh. Alternatively adjust SSAO/the renderloop such that SSAO works with clear = false so that we can use the figure scene.
• Add pickable attribute GLMakie.jl#174 or Change ranged pick to return all plots sorted by distance GLMakie.jl#177 and Update pick functions #696 So that certain plots can be excluded when picking at range.
• Ignore axis plots regardless of order.
• fix ranged pick_native GLMakie.jl#173 (Some general fixes for pick(..., range)
• always forward model matrix in Text GLMakie.jl#176 to get backgrounds behind displayed text
• revamp things to work in screen space
• make things work with Axis3
• correctly adjust for scene offsets
• add attributes to control visualization
• adjust direction of tooltip to always be visible
• stop 3d scenes from resizing maybe?
• Allow text attributes to pass by default GLMakie.jl#183 for compatibility with general scenes (i.e. not a figure or axis)
• write some documentation

To try it out, get JuliaPlots/GLMakie.jl#177 and #696 and use

fig, ax, p = lines(rand(Point3f0, 10))
x = DataInspector(fig) # or ax or any scene
fig

[ffreyer]

Related:
MakieOrg/Makie.jl#839
https://discourse.julialang.org/t/interactive-plot-data-inspection-with-makie-a-la-plotlyjs/58095/8

[ffreyer]

Just a reminder to myself - meshes are currently drawn under 2d scatter markers because those use fxaa = false and are therefore rendered later. I don't think that means depth tests shouldn't work though. Maybe I can fix that... This just happens due to overdraw=true as that disables the depth test.

[jkrumbiegel]

Would be cool if this also worked with Axis in that one can enable and disable the interaction, now it looks to me as if it's an "add once" kind of thing

[ffreyer]

Also related: MakieOrg/Makie.jl#810

[ffreyer]

Would be cool if this also worked with Axis in that one can enable and disable the interaction, now it looks to me as if it's an "add once" kind of thing

I added an enable!/disable! now. I would like this to work with any scene so I don't want to rely on Axis interactions.

I'm also still thinking about how to best ignore plots. With how it is right now only plots that exist when DataInspector(fig/ax) is called are added to the blacklist/whitelist. So you may end up being able to inspect things you generally want to ignore, or not being able inspect thing you do want to inspect.

My favorite solution for this is still adding an attribute pickable/inspectable. It would allow us to set, for example, Axis plots as not inspectable by default regardless of when they are added. I think plot!(..., inspectable = false) is also nicer for a user than messing with a blacklist or whitelist. It would just take a lot of tiny edits to do this now.

(If you want to try this you'll need to checkout JuliaPlots/GLMakie.jl#177 and #696)

[ffreyer]

If think this should be in a merga-able state now, if tests pass.

Some things we should do later:

• precompilation to reduce lag
• find some way to stop 3d scenes from resizing when bounding boxes are shown
• after priority observables get merged this should get some priority too. (Should work with default too)

[ffreyer]

 Stacktrace:
  [1] error(s::String)
    @ Base ./error.jl:33
  [2] rgbatuple(c::Char)
    @ CairoMakie ~/.julia/packages/CairoMakie/GFZiw/src/utils.jl:87
  [3] draw_poly(scene::Scene, screen::CairoMakie.CairoScreen{Cairo.CairoSurfaceIOStream{UInt32}}, poly::Poly{Tuple{Vector{Vector{Point{2, Float32}}}}}, points::Vector{Point{2, Float32}}, color::Char, model::StaticArrays.SMatrix{4, 4, Float32, 16}, strokecolor::Symbol, strokewidth::Float64)
    @ CairoMakie ~/.julia/packages/CairoMakie/GFZiw/src/overrides.jl:45
  [4] (::CairoMakie.var"#58#59"{Scene, CairoMakie.CairoScreen{Cairo.CairoSurfaceIOStream{UInt32}}, Poly{Tuple{Vector{Vector{Point{2, Float32}}}}}})(points::Vector{Point{2, Float32}}, color::Char, strokecolor::Symbol, strokewidth::Float64)
    @ CairoMakie ~/.julia/packages/CairoMakie/GFZiw/src/overrides.jl:56
  [5] broadcast_foreach(::Function, ::Vector{Vector{Point{2, Float32}}}, ::Vararg{Any, N} where N)
    @ AbstractPlotting ~/work/AbstractPlotting.jl/AbstractPlotting.jl/src/utilities/utilities.jl:162
  [6] draw_poly(scene::Scene, screen::CairoMakie.CairoScreen{Cairo.CairoSurfaceIOStream{UInt32}}, poly::Poly{Tuple{Vector{Vector{Point{2, Float32}}}}}, points_list::Vector{Vector{Point{2, Float32}}})
    @ CairoMakie ~/.julia/packages/CairoMakie/GFZiw/src/overrides.jl:53

Could this be related to JuliaPlots/CairoMakie.jl#159 @jkrumbiegel ?

[ffreyer]

I checked a couple of plots, everything seems to be working. I also split up the docs for interactivity a bit, because I thought it was getting a bit large and fragmented for one page.

[SimonDanisch]

Thanks, this looks great :)