This week in Databend #57
Databend is an open source elastic and reliable Modern Cloud Data Warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.
Below is a list of some major changes that we don't want you to miss.
- add create database from share SQL (#7288)
- add admin api: /v1/ctrl/trigger_snapshot let the leader send a snapshot to every follower (#7298)
- HuaweiCloud OBS as storage backend for databend (#7365)
- add top-N pruner (#7302)
- split hive file to small partition and support read more than one rowgroups (#7311)
- add format ndjson (#7328)
- implement cost-based optimization (#7187)
- push limit down further (#7273)
- support explain ast (#7215)
- alter table recluster (#7400)
- add Timestamp type (#7393)
- refactor drop share (#7341)
- refactor compact and recluster (#7274)
- remove Github Engine (#7289)
- enable file meta data cache (#7386)
- eliminate circular references (#7411)
- make args to be consistent of other popular DBMS (#7357)
- add part of duckdb logictest suites (#7394)
- when expiring a record, leader and followers should use the same now time (#7325)
- improve parsing speed for large expr (#7279)
- scalar subquery in function got error (#7293)
- fix case sensitivity of
- validate duplicated column name when creating table (#7307)
- fix JSON value incorrect memory size (#7346)
Let's take a look at what's new at Datafuse Labs & Databend each week.
Databend Now Supports Gcs and Huawei Obs as Storage Backends
Databend uses opendal as the storage access layer to interface with various storage systems.
Recently, Databend completed support for Google Cloud Storage and Huawei Cloud Object Storage, making it easy to access the data stored on these backends.
Remove Support for GitHub Engine
In the past, Databend has supported the GitHub engine to easily demonstrate, which pulls data from the GitHub API to form a database.
As the FUSE engine matures, we are officially removing support for the GitHub toy engine to reduce unnecessary maintenance work.
Learn more: https://github.com/datafuselabs/databend/discussions/7286
Databend Have Achieved the OpenSSF Best Practice Badge
The Open Source Security Foundation (OpenSSF) Best Practices badge is a way for Free/Libre and Open Source Software (FLOSS) projects to show that they follow best practices.
You can check the changelogs of Databend nightly to learn about our latest developments.
Thanks a lot to the contributors for their excellent work this week.
Please join the DatafuseLabs Community if you are interested in Databend.
We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.
You can submit issues for any problems you find. We also highly appreciate any of your pull requests.
- Databend Website
- Weekly (A weekly newsletter about Databend)
- GitHub Discussions (Feature/Bug reports, Contributions)
- Twitter (Get the news fast)
- Slack Channel (For live discussion with the Community)
- I'm feeling lucky (Pick up a good first issue now!)