Databend is an open source elastic and reliable Modern Cloud Data Warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don't want you to miss.

Features

  • migrate window function to new pipeline (#6500)
  • add format diagnostic (#6530)
  • add date_trunc function (#6540)
  • support global setting (#6579)
  • add {db,table}_id map to {(tenant,db_name), (db_id, table_name)} in metasrv (#6607)
  • support ALL and SOME subquery, mark join with non-equi condition, and make tpch q20 happy (#6534)

presign statement

  • add presign statement in parser (#6513)
  • implement presign support (#6529)

storage

  • allow COPY FROM/INTO different storage services (#6573)
  • allow create stage for different services (#6602)

new expression

  • add new crate common-expression (#6576)
  • implement pretty print for Chunk (#6597)

Improvement

  • improve performances for group by queries (#6551)
  • try abandon internal parquet2 patches (#6067)
  • refactor interpreter factory for reuse interpreters code (#6566)
  • replace infallible (#6568)
  • remove old processor useless code (#6584)
  • pretty format for explain (#6585)

Build/Testing/CI

Bug fixes

  • big query hang with clickhouse (#6583)
  • catchup planner update in http handler (#6572)
  • fix load json value by csv format (#6548)
  • fix input format CSV (#6524)
  • show query with limit will failed when enable planner v2 (#6381)
  • add watch txn unit test (#6526)
  • fix thread unsafe when processor schedule (#6533)
  • fix database and user related functions in planner v2 (#6473)

Tips

Let's learn a weekly tip from Databend.

Presign Statement

Generates the pre-signed URL for a staged file by the stage name and file path you provide. The pre-signed URL enables you to access the file through a web browser or an API request.

Syntax

PRESIGN [ { DOWNLOAD | UPLOAD }] @<stage_name>/.../<file_name> [ EXPIRE = <expire_in_seconds> ]

Example

This example generates the pre-signed URL for downloading the file books.csv on the stage my-stage:

PRESIGN @my_stage/books.csv
+--------+---------+---------------------------------------------------------------------------------+
| method | headers | url                                                                             |
+--------+---------+---------------------------------------------------------------------------------+
| GET    | {}      | https://example.s3.amazonaws.com/books.csv?X-Amz-Algorithm=AWS4-HMAC-SHA256&... |
+--------+---------+---------------------------------------------------------------------------------+

Learn More

Changelogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Contributors

Thanks a lot to the contributors for their excellent work this week.

andylokandyariesdevilb41shBohuTANGdantengskyDefined2014
andylokandyariesdevilb41shBohuTANGdantengskyDefined2014
everpcpcfkunergaoxingeGrapeBaBajiaoew1991lichuang
everpcpcfkunergaoxingeGrapeBaBajiaoew1991lichuang
mergify[bot]PsiACEsoyeric128sundy-liTCeasonXuanwo
mergify[bot]PsiACEsoyeric128sundy-liTCeasonXuanwo
xudong963youngsofunZeaLoVezhang2014
xudong963youngsofunZeaLoVezhang2014

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.