This week in Databend #60
Databend is an open source elastic and reliable Modern Cloud Data Warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.
What's Changed
Below is a list of some major changes that we don't want you to miss.
Exciting New Features ✨
planner
- support independent right join (#7634)
storage
- delay start the worker for simple select hive query (#7595)
- get all parquet file list for fuse engine (#7631)
query
- unify pipeline for all inputs with format (#7613)
- add security token support for AWS S3 (#7758)
- implement copy from ipfs (#7729)
- add
and_filters
function (#7712) - idempotent-copy file (#7719)
- support jsonb format (#7522)
- add select from share db and show tables from share db SQL support (#7640)
cluster
- auto discover ip when ip is unspecified or loop back (#7617)
new expression
- migrate regexp func to func-v2 (#7459)
Code Refactor 🎉
meta
planner
- Old Planner Never See Again (Part 2) (#7767)
interpreter
- remove sendable stream in interpreter (#7582)
processor
- save pipeline executor into query context (#7722)
query
- improve in function (#7645)
- push all filters to prewhere and prune columns for it (#7646)
- streaming load use planner v2 (#7756)
new expression
- make unit test goldenfile only display the used columns (#7739)
Thoughtful Bug Fix 🔧
tracing
- fix: Jaeger layer not filtered (#7621)
planner
settings
- fix server hang when concurrent requests http auth (#7733)
query
- fix cast deterministic error (#7686)
cluster
- add statistics receiver runtime (#7679)
News
Let's take a look at what's new at Datafuse Labs & Databend each week.
Designing and Using JSON in Databend
JSON (JavaScript Object Notation) is a commonly used semi-structured data type. With the self-describing schema structure, JSON can hold all data types. The JSON data shared by various platforms through open interfaces, and the public datasets and application logs stored in JSON format.
Databend supports structured data types, as well as JSON. This post dives deeply into the JSON data type in Databend.
Learn more at https://databend.rs/blog/json-datatypes
Changelogs
You can check the changelogs of Databend nightly to learn about our latest developments.
- v0.8.42-nightly
- v0.8.41-nightly
- v0.8.40-nightly
- v0.8.39-nightly
- v0.8.38-nightly
- v0.8.37-nightly
- v0.8.36-nightly
Contributors
Thanks a lot to the contributors for their excellent work this week.
andylokandy | b41sh | BohuTANG | ClSlaid | dantengsky | drmingdrmer |
everpcpc | hanyisong | leiysky | lichuang | mergify[bot] | PsiACE |
RinChanNOWWW | sandflee | soyeric128 | sundy-li | TCeason | Xuanwo |
xudong963 | xychu | youngsofun | zhang2014 | zhyass |
Meet Us
Please join the DatafuseLabs Community if you are interested in Databend.
We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.
You can submit issues for any problems you find. We also highly appreciate any of your pull requests.
- Databend Website
- Weekly (A weekly newsletter about Databend)
- GitHub Discussions (Feature/Bug reports, Contributions)
- Twitter (Get the news fast)
- Slack Channel (For live discussion with the Community)
- I'm feeling lucky (Pick up a good first issue now!)