Databend is an open source elastic and reliable Modern Cloud Data Warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don't want you to miss.

Features

share

  • add create database from share SQL (#7288)

meta

  • add admin api: /v1/ctrl/trigger_snapshot let the leader send a snapshot to every follower (#7298)

storage

  • HuaweiCloud OBS as storage backend for databend (#7365)
  • add top-N pruner (#7302)
  • split hive file to small partition and support read more than one rowgroups (#7311)

format

  • add format ndjson (#7328)

planner

  • implement cost-based optimization (#7187)
  • push limit down further (#7273)
  • support explain ast (#7215)

query

  • alter table recluster (#7400)

new expression

  • migrate sign / trigonometric / abs (#7272)
  • implement is_null and is_not_null (#7282)
  • add Timestamp type (#7393)

Improvement

share

  • refactor drop share (#7341)

meta

  • introduce UpserKV to simplify meta command (#7339 & #7345)

storage

  • refactor compact and recluster (#7274)
  • remove Github Engine (#7289)
  • enable file meta data cache (#7386)

async insert

  • eliminate circular references (#7411)

query

  • make args to be consistent of other popular DBMS (#7357)

Build/Testing/CI

  • add part of duckdb logictest suites (#7394)

Bug fixes

meta

  • when expiring a record, leader and followers should use the same now time (#7325)

parser

  • improve parsing speed for large expr (#7279)

planner

  • scalar subquery in function got error (#7293)
  • fix case sensitivity of USING clause (#7304)
  • validate duplicated column name when creating table (#7307)

query

  • fix JSON value incorrect memory size (#7346)

cluster

  • optimize the performance for cluster mode (#7351)
  • fix panic if exchange key is nullable (#7368)

News

Let's take a look at what's new at Datafuse Labs & Databend each week.

Databend Now Supports Gcs and Huawei Obs as Storage Backends

Databend uses opendal as the storage access layer to interface with various storage systems.

Recently, Databend completed support for Google Cloud Storage and Huawei Cloud Object Storage, making it easy to access the data stored on these backends.

Learn more:

Remove Support for GitHub Engine

In the past, Databend has supported the GitHub engine to easily demonstrate, which pulls data from the GitHub API to form a database.

As the FUSE engine matures, we are officially removing support for the GitHub toy engine to reduce unnecessary maintenance work.

Learn more: https://github.com/datafuselabs/databend/discussions/7286

Databend Have Achieved the OpenSSF Best Practice Badge

The Open Source Security Foundation (OpenSSF) Best Practices badge is a way for Free/Libre and Open Source Software (FLOSS) projects to show that they follow best practices.

CII Best Practices

Changelogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Contributors

Thanks a lot to the contributors for their excellent work this week.

andylokandyAngleNetariesdevilb41shBohuTANGClSlaid
andylokandyAngleNetariesdevilb41shBohuTANGClSlaid
dantengskydependabot[bot]drmingdrmereastfishereverpcpcleiysky
dantengskydependabot[bot]drmingdrmereastfishereverpcpcleiysky
lichuangmergify[bot]PsiACERinChanNOWWWsandfleesoyeric128
lichuangmergify[bot]PsiACERinChanNOWWWsandfleesoyeric128
sundy-liTCeasonXuanwoxudong963youngsofunZeaLoVe
sundy-liTCeasonXuanwoxudong963youngsofunZeaLoVe
zhang2014zhyass
zhang2014zhyass

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.