Databend Weekly

Databend is an open source elastic and reliable Modern Cloud Data Warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don't want you to miss.

Features

add StageFileFormatType::Tsv (#6651)

meta

add share metasrv ShareApi(create_share,drop_share) (#6582)
add share metasrv ShareApi {add|remove}_share_account (#6656)
add share id to share name map, add share test suites (#6670)
adds cli command to send RPC to a running meta cluster (#6559)

hive catalog

support read boolean, float, double, date, array columns (#6629)

new planner

support create table as select (#6618)
optimize correlated subquery by decorrelation (#6632)

new expression

Implement domain calculation (#6649)
implement error report (#6661)
allow function to return runtime error (#6662)
support UInt32, UInt64, Int32, Int64 (#6660)
support conversion between arrow (#6674)

Improvement

support insert zero date and zero datetime (#6592)
Stage Copy use internal InputFormat (#6638)
decouple Table from QueryContext (#6665)
refactor pipeline builder (#6695)

new planner

stage/tables/databases DDL statements defaults to use new planner (#6648)
users/roles/grants DDL statements default to use new planner (#6687)

Build/Testing/CI

add ydb test cases (#6681)

Bug fixes

fix range delete panic and incorrect statistics (of in_memory_size) (#6609)
disable null values in join (#6616)
COPY should be able to run under new planner (#6624)
fix InSubquery returns error result (#6641)
fix variant map access filter (#6645)
adhoc fix session leak (#6672)
support read i96 timestamp from parquet file (#6668)
check parquet schema mismatch (#6690)

Tips

Let's learn a weekly tip from Databend.

Send & Receive gRPC Metadata

Databend allows you to send and receive gRPC (gRPC Remote Procedure Calls) metadata (key-value pairs) to and from a running meta service cluster with the command-line interface (CLI) commands.

Update and Create a Key-Value Pair

./databend-meta --grpc-api-address "<grpc-api-address>" --cmd kvapi::upsert --key <key> --value <value>

Get Value by a Key

./databend-meta --grpc-api-address "<grpc-api-address>" --cmd kvapi::get --key <key>

Get Values by Multiple Keys

./databend-meta --grpc-api-address "<grpc-api-address>" --cmd kvapi::mget --key <key1> <key2> ...

List Key-Value Pairs by a Prefix

./databend-meta --grpc-api-address "<grpc-api-address>" --cmd kvapi::list --prefix <prefix>

Learn More

Changelogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Contributors

Thanks a lot to the contributors for their excellent work this week.


andylokandy	ariesdevil	b41sh	BohuTANG	dantengsky	dependabot[bot]


drmingdrmer	everpcpc	jiaoew1991	lichuang	mergify[bot]	PsiACE


RinChanNOWWW	sandflee	soyeric128	sundy-li	Xuanwo	xudong963


youngsofun	yuuch	ZeaLoVe	zhang2014

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

This week in Databend #51