Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Support Semi-structured Data Types (like json format) #3916

Closed
BohuTANG opened this issue Jan 20, 2022 Discussed in #3911 · 3 comments
Closed

Support Semi-structured Data Types (like json format) #3916

BohuTANG opened this issue Jan 20, 2022 Discussed in #3911 · 3 comments
Assignees
Labels
A-query Area: databend query C-feature Category: feature community-take
Milestone

Comments

@BohuTANG
Copy link
Member

BohuTANG commented Jan 20, 2022

Discussed in #3911

Originally posted by ZhiHanZ January 19, 2022
clickhouse json format is especially helpful for logging and monitoring application and we could support it
https://clickhouse.com/docs/en/interfaces/formats/#jsoneachrow
https://clickhouse.com/docs/en/sql-reference/functions/json-functions/
https://docs.snowflake.com/en/sql-reference/data-types-semistructured.html

@BohuTANG BohuTANG added the C-feature Category: feature label Jan 20, 2022
@BohuTANG BohuTANG mentioned this issue Jan 20, 2022
4 tasks
@BohuTANG
Copy link
Member Author

BohuTANG commented Jan 21, 2022

If we support Semi-structured Data Types like snowflake :
https://docs.snowflake.com/en/sql-reference/data-types-semistructured.html

We can make the functions more powerful and streamlined, for example, clickhouse URLS functions:
https://clickhouse.com/docs/en/sql-reference/functions/url-functions/

We can only use a parse_url -> Object to do all the URLS function in clickhouse:

select parse_url('https://github.com:80/repo/trunck');
{   "fragment": null,   "host": "github.com",   "parameters": null,   "path": "repo/trunck",   "port": "80",   "query": null,   "scheme": "https" }

select parse_url('https://github.com:80/repo/trunck'):scheme;
"https"

select parse_url('https://www.snowflake.com/'):host;
"github.com"

select parse_url('https://www.snowflake.com/'):port;
"80"

@ZhiHanZ
Copy link
Collaborator

ZhiHanZ commented Feb 8, 2022

interesting papers:
https://db.in.tum.de/people/sites/durner/papers/json-tiles-sigmod21.pdf

@b41sh
Copy link
Member

b41sh commented Feb 17, 2022

/assignme

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
A-query Area: databend query C-feature Category: feature community-take
Projects
None yet
Development

No branches or pull requests

5 participants