This Week in Databend #77

Databend is a powerful cloud data warehouse. Built for elasticity and efficiency. Free and open. Also available in the cloud: https://app.databend.com .

What's New

Check out what we've done this week to make Databend even better for you.

Features & Improvements ✨

Meta

use expression::TableSchema to replace obsolete datavalues::DataSchema (#9506)
iter() iterate every tree and every records in theses trees (#9621)

Expression

add other base geo functions (#9588)

Optimizer

improve cardinality estimation for join based on histogram (#9594)

Planner

improve join reorder algorithm (#9571)

Query

support insert with placeholder (#9575)
set setting support expr (#9574)
add information_schema for sharding-jdbc (#9583)
support named params for table functions (#9630)

Storage

read_parquet page index (#9563)
update interpreter and storage support (#9261)

Code Refactoring 🎉

refine on_error mode (#9473)

Meta

remove unused meta types and conversion util (#9584)

Parser

more strict parser for format_options (#9635)

Expression

rearrange common_expression and common_function (#9585)

Build/Testing/CI Infra Changes 🔌

run sqllogictests with binary (#9603)

Bug Fixes 🔧

Expression

constant folder should run repeatedly until stable (#9572)
check_date() and to_string(boolean) may panic (#9561)

Planner

fix stack overflow when applying RuleFilterPushDownJoin (#9645)

Storage

fix range filter read stat with index (#9619)

Sqllogictest

sqllogic test hangs (cluster mod + clickhouse handler) (#9615)

What's On In Databend

Stay connected with the latest news about Databend.

Upgrade Databend Query from 0.8 to 0.9

Databend-query-0.9 introduces incompatible changes in metadata, these metadata has to be manually migrated. Databend provides a program for this job: databend-meta-upgrade-09, which you can find in a release package or can be built from source.

Upgrade

databend-meta-upgrade-09 --cmd upgrade --raft-dir "<./your/raft-dir/>"

Learn More

Release Proposal: Nightly v1.0

The call for proposals for the release of v1.0 is now open.

The preliminary plan is to release in March, mainly focusing on alter table, update, and group by spill.

Learn More

Release proposal: Nightly v1.0

What's Up Next

We're always open to cutting-edge technologies and innovative ideas. You're more than welcome to join the community and bring them to Databend.

Add Type Checker for Sqllogictest

We can check if each row's each element's type is correct.

databend/tests/sqllogictests/src/client/mysql_client.rs

 // Todo: add types to compare 
 Ok(DBOutput::Rows { 
     types, 
     rows: parsed_rows, 

Issue 9647: Feature: Add type checker for sqllogictest

Please let us know if you're interested in contributing to this issue, or pick up a good first issue at https://link.databend.rs/i-m-feeling-lucky to get started.