Add Keyten native and Parquet benchmarks - #2353
Conversation
|
The run of Logs:
|
|
Results for Logs:
|
|
Results for Logs:
|
|
Results for Logs:
|
|
Results for Logs:
|
|
Results for Logs:
|
|
Results for Logs:
|
|
@singaraiona, this is interesting, and the benchmark was run successfully. Do you mind if we merge? |
…e links Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
To be honest, I pushed it by accident - Keyten isn't quite in the shape I wanted it to be before making it public yet. So I'm actually a bit surprised everything passed :) But sure, feel free to merge it! I'll send an update once Keyten is a bit more presentable. |
|
Results for Logs:
|
Add Keyten 0.1.53 through its Python dataframe API in two configurations: durable native storage (
keyten) and direct scans of the single official Parquet file (keyten-parquet). Both use the shared benchmark driver and the same 43 query expressions.The native load streams Parquet into the engine's native format without sorting or manual indexes. The loopback server opens its source on the first query after restart. The query client measures through receipt of the full JSON result, including planning, execution and serialization. Health checks do not read the dataset. The installer pins the published wheel.
Validation:
k10works/keyten@8a31be1869ef80dd31e6bb2c59da67fbabb2e94d, including aggregate values and valid LIMIT ties. This source build is distinct from the pinned published wheel.validate-results.pypass. The result validator reports only six existing Infobright warnings.The full native load completed with 99,997,497 rows. Native validation passes 42 of 43 queries; Q24 fails because some empty-string payload values return as null. The mismatch reproduces without sorting and on a small Parquet-to-native fixture with both the source build and the pinned 0.1.53 wheel.
Draft blocked on resolving that native round-trip correctness failure, followed by the standard cold/hot run with the pinned release. No local diagnostic timings are submitted as official results.