opt_touch_all
argument of dak.map_partitions
should no longer be necessary
#915
Labels
bug
Something isn't working
The
opt_touch_all
argument tomap_partitions
was added to make layers in dask-awkward graphs manually touchable (that is, tell the optimization code to not rely on the typetracer graph for touching in that layer, just touch all awkward data at that point). This allowed us to workaround operations where automatic typetracer touching wasn't working. I think we're in a place now where we don't need it. I see it's used in coffea here:https://github.com/CoffeaTeam/coffea/blob/c541a8ae095aa8db71f734bfbe085d4dba6dadf1/src/coffea/ml_tools/helper.py#L351
More info just for completeness:
The only place where we needed this was in
dask_awkward.zip
, where if we did something like:That compute would fail if we didn't also touch
upstream
'sbar
data, butbar
wouldn't get touched by the compute on onlyfoo
, hence the need to manually touch the whole zipped up array.I've made draft PR dask-contrib/dask-awkward#395 for testing
The text was updated successfully, but these errors were encountered: