Interuptable queries in jupyter notebooks

[timsaucer]

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

As a user, if I have written a query that takes a long time, I want to be able to interrupt it so I can make changes for rapid development. Currently, this does not work in jupyter notebooks. Instead you have to terminate the kernel or sometimes the entire jupyter session and restart.

Describe the solution you'd like

• Open a jupyter notebook.
• Write a query in datafusion that takes a long time. Usually some operation with multiple sorts, joins, and aggregates.
• Press the interrupt key.

You should be able to return to the notebook, make changes to the query, and run again without having to terminal the kernel.

Describe alternatives you've considered

None

[kylebarron]

See https://pyo3.rs/v0.25.0/faq.html#ctrl-c-doesnt-do-anything-while-my-rust-code-is-executing and https://docs.rs/pyo3/latest/pyo3/marker/struct.Python.html#method.check_signals

[kosiew]

take