Databend is an open source elastic and reliable Modern Cloud Data Warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

What's Changed

Below is a list of some major changes that we don't want you to miss.

Exciting New Features ✨

planner

  • support independent right join (#7634)

storage

  • delay start the worker for simple select hive query (#7595)
  • get all parquet file list for fuse engine (#7631)

query

  • unify pipeline for all inputs with format (#7613)
  • add security token support for AWS S3 (#7758)
  • implement copy from ipfs (#7729)
  • add and_filters function (#7712)
  • idempotent-copy file (#7719)
  • support jsonb format (#7522)
  • add select from share db and show tables from share db SQL support (#7640)

cluster

  • auto discover ip when ip is unspecified or loop back (#7617)

new expression

  • migrate regexp func to func-v2 (#7459)

Code Refactor 🎉

meta

planner

  • Old Planner Never See Again (Part 2) (#7767)

interpreter

  • remove sendable stream in interpreter (#7582)

processor

  • save pipeline executor into query context (#7722)

query

  • improve in function (#7645)
  • push all filters to prewhere and prune columns for it (#7646)
  • streaming load use planner v2 (#7756)

new expression

  • make unit test goldenfile only display the used columns (#7739)

Thoughtful Bug Fix 🔧

tracing

  • fix: Jaeger layer not filtered (#7621)

planner

  • fix EXPLAIN AST for invalid query (#7737)
  • fix left join returns wrong answer (#7662)

settings

  • fix server hang when concurrent requests http auth (#7733)

query

  • fix cast deterministic error (#7686)

cluster

  • add statistics receiver runtime (#7679)

News

Let's take a look at what's new at Datafuse Labs & Databend each week.

Designing and Using JSON in Databend

JSON (JavaScript Object Notation) is a commonly used semi-structured data type. With the self-describing schema structure, JSON can hold all data types. The JSON data shared by various platforms through open interfaces, and the public datasets and application logs stored in JSON format.

Databend supports structured data types, as well as JSON. This post dives deeply into the JSON data type in Databend.

Learn more at https://databend.rs/blog/json-datatypes

Changlogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Contributors

Thanks a lot to the contributors for their excellent work this week.

andylokandyb41shBohuTANGClSlaiddantengskydrmingdrmer
andylokandyb41shBohuTANGClSlaiddantengskydrmingdrmer
everpcpchanyisongleiyskylichuangmergify[bot]PsiACE
everpcpchanyisongleiyskylichuangmergify[bot]PsiACE
RinChanNOWWWsandfleesoyeric128sundy-liTCeasonXuanwo
RinChanNOWWWsandfleesoyeric128sundy-liTCeasonXuanwo
xudong963xychuyoungsofunzhang2014zhyass
xudong963xychuyoungsofunzhang2014zhyass

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.