Databend Weekly

Databend is an open source elastic and reliable Modern Cloud Data Warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don't want you to miss.

Features

cte

support cte in parser #7030

share

add Create/Drop Share sql support (#6975 & #6987)
add Grant and Revoke Share Object sql support (#7009)

parser

add mysql dialect #7071

RBAC

avoid making cycle between roles (#7051)

handlers

deprecate clickhouse's tcp protocol support (#7012)
add tenant tables status api (#7037)

optimizer

implement column pruning for heuristic optimizer (#6478)

planner

support name resolution for alias (#6979)
enable projection pushdown (#6938)
enable new planner by default (#6869)
enhanced case-sensitivity of identifiers (#7026)

storage

generate cluster statistics in deletion (#7041)

new expression

add concat/filter/scatter/take kernel for chunk (#7038)
implement adaptive constant folding (#7054)

Improvement

split query

extract storages into sub crates (#6981)

share

refactor add/remove share accounts API (#7029)

proto conv

pb::S3StorageConfig should be decoded into StorageS3Config, instead of into enum StorageParams (#7047)
trait FromToPB use associated type instead of type parameter (#7048)

meta api

introduce Id for KVApi (#7055)
merge TableIdGen, DatabaseIdGen and ShareIdGen into one id-generator key (#7062)

Build/Testing/CI

enable subquery tests in ydb suit (#6948)
add mini hits dataset 100k to stateful test (#6964)
test fuse-table compatibility (#6990)

Bug fixes

fix hive table read when pushdowns is None (#7008)
fix column prune for COUNT(*) (#7000)
fix prune projection (#7013)
fix clickhouse handler, try catch error before response (#7019)
fix case sensitivity of cluster by expression (#7060)

News

Let's take a look at what's new at Databend each week.

Release proposal: Nightly v0.9

Databend plans to release v0.8 in the coming week, with new parser and planner support.

The call for proposals for the release of v0.9 is now open. See Release proposal: Nightly v0.9 #7052

Benchmarking Databend using TPC-H

Databend has recently enabled the new Planner by default, which means that we have fully enabled support for JOIN queries and correlated subqueries.

Now you can easily run the TPC-H test suite with Databend and perform benchmark tests. See Benchmarking Databend using TPC-H

Deprecate clickhouse's tcp protocol support

As the Clickhouse TCP protocol is almost a black box and requires a lot of effort to ensure compatibility, Databend has removed compatibility with the Clickhouse TCP protocol. See Deprecate clickhouse's tcp protocol support #7012

Databend will focus on Clickhouse HTTP protocol compatibility to ensure compatibility with the existing ecosystem.

Changelogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Contributors

Thanks a lot to the contributors for their excellent work this week.


andylokandy	b41sh	BohuTANG	dantengsky	drmingdrmer	flaneur2020


leiysky	lichuang	mergify[bot]	pymongo	sandflee	soyeric128


sundy-li	Xuanwo	xudong963	youngsofun	ZeaLoVe	zhyass

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

This week in Databend #54