You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Inferring types and parsing leaf level columns in the JSON reader launches separate kernels for each column.
We can obtain improved performance by gathering the offsets for columns contiguously, and then parsing them in a single kernel.
Describe the solution you'd like
Partitioning strategies to consider:
For parsing, 1 thread per offset.
1 warp / column (but 32 offsets/warp), consecutive warps will most likely access nearby memory and probably benefit from coalescing
Fixed number of characters per thread, but more careful thought is required for distributing work depending on column type.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
![Image](https://private-user-images.githubusercontent.com/7304582/372572671-68458944-77ad-4aab-84ba-91c75421b48f.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkwMzg3MjgsIm5iZiI6MTczOTAzODQyOCwicGF0aCI6Ii83MzA0NTgyLzM3MjU3MjY3MS02ODQ1ODk0NC03N2FkLTRhYWItODRiYS05MWM3NTQyMWI0OGYucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIwOCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMDhUMTgxMzQ4WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9ZWVjZDkyMTZmNWU2MmQyOTU4MjM3N2RjNjdjYzUwNzY5NWI1ZjZmYTJhOTBmNTc4NzlhOWYzZDM0ZTRiMWYxYyZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.y1NXYWe9UI6XZMrxWkUg7sy-5FyeYbr9phzT2i0cOPs)
Inferring types and parsing leaf level columns in the JSON reader launches separate kernels for each column.
We can obtain improved performance by gathering the offsets for columns contiguously, and then parsing them in a single kernel.
Describe the solution you'd like
Partitioning strategies to consider:
The text was updated successfully, but these errors were encountered: