Databend is an open source elastic and reliable Modern Cloud Data Warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don't want you to miss.

Features

  • add StageFileFormatType::Tsv (#6651)

meta

  • add share metasrv ShareApi(create_share,drop_share) (#6582)
  • add share metasrv ShareApi {add|remove}_share_account (#6656)
  • add share id to share name map, add share test suites (#6670)
  • adds cli command to send RPC to a running meta cluster (#6559)

hive catalog

  • support read boolean, float, double, date, array columns (#6629)

new planner

  • support create table as select (#6618)
  • optimize correlated subquery by decorrelation (#6632)

new expression

  • Implement domain calculation (#6649)
  • implement error report (#6661)
  • allow function to return runtime error (#6662)
  • support UInt32, UInt64, Int32, Int64 (#6660)
  • support conversion between arrow (#6674)

Improvement

  • support insert zero date and zero datetime (#6592)
  • Stage Copy use internal InputFormat (#6638)
  • decouple Table from QueryContext (#6665)
  • refactor pipeline builder (#6695)

new planner

  • stage/tables/databases DDL statements defaults to use new planner (#6648)
  • users/roles/grants DDL statements default to use new planner (#6687)

Build/Testing/CI

  • add ydb test cases (#6681)

Bug fixes

  • fix range delete panic and incorrect statistics (of in_memory_size) (#6609)
  • disable null values in join (#6616)
  • COPY shoud be able to run under new planner (#6624)
  • fix InSubquery returns error result (#6641)
  • fix variant map access filter (#6645)
  • adhoc fix session leak (#6672)
  • support read i96 timestamp from parquet file (#6668)
  • check parquet schema mismatch (#6690)

Tips

Let's learn a weekly tip from Databend.

Send & Receive gRPC Metadata

Databend allows you to send and receive gRPC (gRPC Remote Procedure Calls) metadata (key-value pairs) to and from a running meta service cluster with the command-line interface (CLI) commands.

Update and Create a Key-Value Pair

./databend-meta --grpc-api-address "<grpc-api-address>" --cmd kvapi::upsert --key <key> --value <value>

Get Value by a Key

./databend-meta --grpc-api-address "<grpc-api-address>" --cmd kvapi::get --key <key>

Get Values by Multiple Keys

./databend-meta --grpc-api-address "<grpc-api-address>" --cmd kvapi::mget --key <key1> <key2> ...

List Key-Value Pairs by a Prefix

./databend-meta --grpc-api-address "<grpc-api-address>" --cmd kvapi::list --prefix <prefix>

Learn More

Changlogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Contributors

Thanks a lot to the contributors for their excellent work this week.

andylokandyariesdevilb41shBohuTANGdantengskydependabot[bot]
andylokandyariesdevilb41shBohuTANGdantengskydependabot[bot]
drmingdrmereverpcpcjiaoew1991lichuangmergify[bot]PsiACE
drmingdrmereverpcpcjiaoew1991lichuangmergify[bot]PsiACE
RinChanNOWWWsandfleesoyeric128sundy-liXuanwoxudong963
RinChanNOWWWsandfleesoyeric128sundy-liXuanwoxudong963
youngsofunyuuchZeaLoVezhang2014
youngsofunyuuchZeaLoVezhang2014

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.