Databend is an open source elastic and reliable Modern Cloud Data Warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

What's Changed

Below is a list of some major changes that we don't want you to miss.

Exciting New Features ✨

share

  • add share database (#7932)

meta

  • add catalog in TableMeta (#7835)

planner

  • support full outer join (#7783)
  • support right semi/anti join (#7909)

index

  • add XOR filter (#7860)
  • enable XOR filter index (#7870)

jsonb

  • add jsonb builtin functions build_array and compare (#7802)

query

  • check memory_size() for building data block (#7927)
  • support unload multi files into stage (#7910)

new expression

  • add try_downcast_builder for ValueType (#7838)
  • migrate min/max/any functions (#7787)
  • migrate aggregation covariance functions (#7926)

Code Refactor 🎉

index

  • split index Filter trait to two trait: FilterBuilder and Filter (#7937)

interpreter

  • try remove InterceptorInterpreter (#7796)

query

new expression

  • manually vectorize not() and xor() (#7801)

Thoughtful Bug Fix 🔧

storage

  • fix oom when recluster (#7791)
  • warmup segment cache during insertion #7803)
  • use shortcut path if filter vector is empty during pruning #7877)

compatibility

  • fix mysql pt-archive compatibility #7853)

News

Let's take a look at what's new at Datafuse Labs & Databend each week.

External Location for Fuse Engine

Problems often encountered in the past with cloud services include the fact that data files are often invisible to the user, making it very difficult to migrate back locally. In addition, there is a lack of tools to help exchange data in the Big Data ecosystem and to better exploit the value in the data. In response to this need Databend has proposed an ISSUE: External Location for Fuse Engine.

This is part of the plan for Databend as Lakehouse and once this support is complete, users will be able to use Databend to manage the lifecycle of their data and perform data governance tasks, as well as having access to key features including Data Share and Time Travel.

Learn more:

Databend Automated Testing with SQLancer

Databend Automated Testing with SQLancer is one of the Databend community's projects in the Open Source Promotion Plan 2022. @hanyisong helped us with this important work, which has now been merged into sqlancer/sqlancer repository.

SQLancer (Synthesized Query Lancer) is a tool to automatically test Database Management Systems (DBMS) in order to find logic bugs in their implementation.

Learn more at https://github.com/sqlancer/sqlancer/pull/568

Changelogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Contributors

Thanks a lot to the contributors for their excellent work this week.

andylokandyb41shBohuTANGClSlaiddantengskydrmingdrmer
andylokandyb41shBohuTANGClSlaiddantengskydrmingdrmer
everpcpcflaneur2020hanyisongleiyskylichuangmergify[bot]
everpcpcflaneur2020hanyisongleiyskylichuangmergify[bot]
PsiACERinChanNOWWWsoyeric128sundy-liTCeasonTennyZhuang
PsiACERinChanNOWWWsoyeric128sundy-liTCeasonTennyZhuang
wubxXuanwoxudong963youngsofunzhang2014zhyass
wubxXuanwoxudong963youngsofunzhang2014zhyass

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.