This week in Databend #61
Databend is an open source elastic and reliable Modern Cloud Data Warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.
What's Changed
Below is a list of some major changes that we don't want you to miss.
Exciting New Features ✨
share
- add share database (#7932)
meta
- add catalog in
TableMeta
(#7835)
planner
index
jsonb
- add jsonb builtin functions build_array and compare (#7802)
query
new expression
- add
try_downcast_builder
forValueType
(#7838) - migrate min/max/any functions (#7787)
- migrate aggregation covariance functions (#7926)
Code Refactor 🎉
index
- split index
Filter
trait to two trait:FilterBuilder
andFilter
(#7937)
interpreter
- try remove
InterceptorInterpreter
(#7796)
query
- use new
InputFormat
- use
InEvaluator
to reuse the hashset (#7814) - rename
Expression
toLegacyExpression
and move out (#7810)
new expression
- manually vectorize
not()
andxor()
(#7801)
Thoughtful Bug Fix 🔧
storage
- fix oom when recluster (#7791)
- warmup segment cache during insertion #7803)
- use shortcut path if filter vector is empty during pruning #7877)
compatibility
- fix mysql pt-archive compatibility #7853)
News
Let's take a look at what's new at Datafuse Labs & Databend each week.
External Location for Fuse Engine
Problems often encountered in the past with cloud services include the fact that data files are often invisible to the user, making it very difficult to migrate back locally. In addition, there is a lack of tools to help exchange data in the Big Data ecosystem and to better exploit the value in the data. In response to this need Databend has proposed an ISSUE: External Location for Fuse Engine.
This is part of the plan for Databend as Lakehouse and once this support is complete, users will be able to use Databend to manage the lifecycle of their data and perform data governance tasks, as well as having access to key features including Data Share and Time Travel.
Learn more:
- External Location for Fuse Engine: https://github.com/datafuselabs/databend/issues/7297
- Databend as Lakehouse: https://github.com/datafuselabs/databend/issues/7592
Databend Automated Testing with SQLancer
Databend Automated Testing with SQLancer is one of the Databend community's projects in the Open Source Promotion Plan 2022. @hanyisong helped us with this important work, which has now been merged into sqlancer/sqlancer repository.
SQLancer (Synthesized Query Lancer) is a tool to automatically test Database Management Systems (DBMS) in order to find logic bugs in their implementation.
Learn more at https://github.com/sqlancer/sqlancer/pull/568
Changelogs
You can check the changelogs of Databend nightly to learn about our latest developments.
- v0.8.53-nightly
- v0.8.52-nightly
- v0.8.51-nightly
- v0.8.50-nightly
- v0.8.49-nightly
- v0.8.48-nightly
- v0.8.47-nightly
- v0.8.46-nightly
- v0.8.45-nightly
- v0.8.44-nightly
- v0.8.43-nightly
Contributors
Thanks a lot to the contributors for their excellent work this week.
andylokandy | b41sh | BohuTANG | ClSlaid | dantengsky | drmingdrmer |
everpcpc | flaneur2020 | hanyisong | leiysky | lichuang | mergify[bot] |
PsiACE | RinChanNOWWW | soyeric128 | sundy-li | TCeason | TennyZhuang |
wubx | Xuanwo | xudong963 | youngsofun | zhang2014 | zhyass |
Meet Us
Please join the DatafuseLabs Community if you are interested in Databend.
We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.
You can submit issues for any problems you find. We also highly appreciate any of your pull requests.
- Databend Website
- Weekly (A weekly newsletter about Databend)
- GitHub Discussions (Feature/Bug reports, Contributions)
- Twitter (Get the news fast)
- Slack Channel (For live discussion with the Community)
- I'm feeling lucky (Pick up a good first issue now!)