Resolve Delta MERGE constraints by visible names

[alexy]

Publishes the generic Delta MERGE constraint correction required by Marciana’s refreshed Sail integration baseline.

The change is generic Sail behavior and contains no Marciana-specific logic.

Validated by the live Grust Sail cognition integration gate.

[github-actions]

Gold Data Report

Notes

1. The tables below show the number of true positives (TP), true negatives (TN), false positives (FP), and false negatives (FN) in gold data input processing.
2. A positive input is a valid test case, while a negative input is a test case that is expected to fail.

Commit Information

Commit	Revision	Branch
After	6e91125	refs/pull/18/merge
Before	7da486d	main

Summary

Commit	TP	TN	FP	FN	Total
After	2222	217	50	313	2802
Before	2189	195	51	188	2623

Details

Gold Data Metrics

Group	File	Commit	TP	TN	FP	FN	Total
spark	data_type.json	After	50	11	2	3	66
		Before	48	11	2	3	64
	expression/case.json	After	5	0	0	0	5
		Before	5	0	0	0	5
	expression/cast.json	After	4	0	0	0	4
		Before	4	0	0	0	4
	expression/current.json	After	3	0	0	0	3
		Before	3	0	0	0	3
	expression/date.json	After	4	0	1	0	5
		Before	4	0	1	0	5
	expression/interval.json	After	346	4	1	0	351
		Before	346	4	1	0	351
	expression/large.json	After	2	0	0	0	2
		Before	2	0	0	0	2
	expression/like.json	After	29	10	0	0	39
		Before	29	10	0	0	39
	expression/misc.json	After	111	5	1	1	118
		Before	111	5	1	1	118
	expression/numeric.json	After	31	6	1	0	38
		Before	31	6	1	0	38
	expression/string.json	After	18	1	0	0	19
		Before	18	1	0	0	19
	expression/timestamp.json	After	7	0	3	0	10
		Before	7	0	3	0	10
	expression/window.json	After	73	0	1	0	74
		Before	73	0	1	0	74
	function/agg.json	After	167	0	0	31	198
		Before	164	0	0	22	186
	function/array.json	After	44	0	0	0	44
		Before	44	0	0	0	44
	function/avro.json	After	0	0	0	4	4
	function/bitwise.json	After	15	0	0	0	15
		Before	15	0	0	0	15
	function/collection.json	After	12	0	0	1	13
		Before	12	0	0	0	12
	function/conditional.json	After	15	0	0	0	15
		Before	15	0	0	0	15
	function/conversion.json	After	2	0	0	0	2
		Before	2	0	0	0	2
	function/csv.json	After	5	0	0	0	5
		Before	5	0	0	0	5
	function/datetime.json	After	167	0	0	40	207
		Before	163	0	0	17	180
	function/generator.json	After	13	0	0	0	13
		Before	13	0	0	0	13
	function/hash.json	After	6	0	0	1	7
		Before	6	0	0	1	7
	function/json.json	After	23	0	0	0	23
		Before	22	0	0	0	22
	function/lambda.json	After	21	0	0	10	31
		Before	21	0	0	10	31
	function/map.json	After	11	0	0	0	11
		Before	11	0	0	0	11
	function/math.json	After	124	0	0	0	124
		Before	124	0	0	0	124
	function/misc.json	After	33	0	0	13	46
		Before	39	0	0	35	74
	function/predicate.json	After	72	0	0	7	79
		Before	72	0	0	7	79
	function/protobuf.json	After	0	0	0	2	2
	function/sketch.json	After	6	0	0	35	41
	function/st.json	After	2	0	0	8	10
		Before	2	0	0	5	7
	function/string.json	After	193	0	0	12	205
		Before	193	0	0	12	205
	function/struct.json	After	2	0	0	0	2
		Before	2	0	0	0	2
	function/url.json	After	10	0	0	0	10
		Before	10	0	0	0	10
	function/variant.json	After	28	0	0	2	30
		Before	28	0	0	0	28
	function/vector.json	After	0	0	0	11	11
	function/window.json	After	6	0	0	3	9
		Before	6	0	0	3	9
	function/xml.json	After	15	0	0	2	17
		Before	12	0	0	5	17
	plan/ddl_alter_table.json	After	49	14	3	11	77
		Before	49	14	3	11	77
	plan/ddl_alter_view.json	After	5	1	0	0	6
		Before	5	1	0	0	6
	plan/ddl_analyze_table.json	After	17	6	0	0	23
		Before	17	6	0	0	23
	plan/ddl_cache.json	After	4	0	1	0	5
		Before	4	0	1	0	5
	plan/ddl_create_index.json	After	0	0	0	3	3
		Before	0	0	0	3	3
	plan/ddl_create_table.json	After	60	27	11	7	105
		Before	60	27	11	7	105
	plan/ddl_delete_from.json	After	2	1	0	0	3
		Before	2	1	0	0	3
	plan/ddl_describe.json	After	4	0	0	0	4
		Before	7	0	0	0	7
	plan/ddl_drop_index.json	After	0	0	0	2	2
		Before	0	0	0	2	2
	plan/ddl_drop_view.json	After	5	0	0	0	5
		Before	5	0	0	0	5
	plan/ddl_insert_into.json	After	17	3	1	11	32
		Before	16	1	1	0	18
	plan/ddl_insert_overwrite.json	After	9	0	2	0	11
		Before	9	0	2	0	11
	plan/ddl_load_data.json	After	4	0	0	0	4
		Before	4	0	0	0	4
	plan/ddl_merge_into.json	After	8	5	3	0	16
		Before	8	4	3	0	15
	plan/ddl_misc.json	After	10	0	0	10	20
		Before	10	0	0	0	10
	plan/ddl_replace_table.json	After	56	13	8	7	84
		Before	56	13	8	7	84
	plan/ddl_select.json	After	1	0	0	0	1
		Before	1	0	0	0	1
	plan/ddl_show_views.json	After	7	0	0	0	7
		Before	7	0	0	0	7
	plan/ddl_uncache.json	After	2	0	0	0	2
		Before	2	0	0	0	2
	plan/ddl_update.json	After	2	1	0	0	3
		Before	2	1	0	0	3
	plan/error_alter_table.json	After	0	2	0	0	2
		Before	0	2	0	0	2
	plan/error_analyze_table.json	After	0	1	0	0	1
		Before	0	1	0	0	1
	plan/error_create_table.json	After	0	6	0	0	6
		Before	0	6	0	0	6
	plan/error_describe.json	After	0	1	0	0	1
		Before	0	1	0	0	1
	plan/error_join.json	After	0	2	0	0	2
		Before	0	2	0	0	2
	plan/error_load_data.json	After	0	1	0	0	1
		Before	0	1	0	0	1
	plan/error_misc.json	After	0	14	0	0	14
		Before	0	14	0	0	14
	plan/error_order_by.json	After	1	4	0	0	5
		Before	1	4	0	0	5
	plan/error_select.json	After	0	15	0	0	15
		Before	0	15	0	0	15
	plan/error_with.json	After	0	1	0	0	1
		Before	0	1	0	0	1
	plan/plan_alter_view.json	After	0	2	0	0	2
		Before	0	2	0	0	2
	plan/plan_create_view.json	After	0	2	0	0	2
		Before	0	2	0	0	2
	plan/plan_explain.json	After	0	1	1	0	2
		Before	0	1	1	0	2
	plan/plan_group_by.json	After	9	1	0	1	11
		Before	9	1	0	1	11
	plan/plan_hint.json	After	25	0	3	0	28
		Before	25	0	3	0	28
	plan/plan_insert_into.json	After	3	0	0	0	3
		Before	3	0	0	0	3
	plan/plan_insert_overwrite.json	After	2	0	0	0	2
		Before	2	0	0	0	2
	plan/plan_join.json	After	59	9	1	4	73
		Before	59	2	1	0	62
	plan/plan_misc.json	After	15	4	0	10	29
		Before	15	4	0	10	29
	plan/plan_order_by.json	After	15	5	1	10	31
		Before	15	5	1	10	31
	plan/plan_select.json	After	107	26	3	51	187
		Before	85	14	5	16	120
	plan/plan_set_operation.json	After	17	0	0	0	17
		Before	17	0	0	0	17
	plan/plan_with.json	After	6	0	2	0	8
		Before	6	0	1	0	7
	plan/unpivot_join.json	After	4	0	0	0	4
		Before	4	0	0	0	4
	plan/unpivot_select.json	After	14	6	0	0	20
		Before	14	6	0	0	20
	table_schema.json	After	8	6	0	0	14
		Before	8	6	0	0	14

[github-actions]

Warning

The baseline was not found.

Ibis Test Report

Commit Information

Commit	Revision	Branch
After	6e91125	refs/pull/18/merge
Before	6e91125	refs/pull/18/merge

Test Summary

Suite	Commit	Failed	Passed	Skipped	Warnings	Time (s)
test-ibis	After	31	1538	166	4535	231.77
	Before	31	1538	166	4535	231.77

Test Details

Error Counts

           31 Total
           22 Total Unique
-------- ---- ----------------------------------------------------------------------------------------------------------
            5 IllegalArgumentException: invalid argument: found TRUNCATE at 0:8 expected something else, ';', statement, or end of input
            2 AnalysisException: Internal error: Function 'approx_percentile_cont' failed to match any signature, errors: Error during planning: Function 'approx_percentile_cont' requires Float64, but received List...
            2 AssertionError
            2 AssertionError: Series are different
            2 IllegalArgumentException: invalid argument: found PARTITIONS at 5:15 expected 'DATABASES', 'SCHEMAS', 'NAMESPACES', 'CATALOGS', 'TABLES', 'TABLE', 'CREATE', 'COLUMNS', 'VIEWS', 'ALL', 'USER', 'SYSTEM'...
            2 assert ibis.Schema {... float64\n} == ibis.Schema {... float64\n} Full diff: ibis.Schema { carat float64 cut string color string clarity string depth float64 table float64 - price int32 ? ^^ + price i...
            1 AnalysisException: Catalog not found: local
            1 AssertionError: DataFrame.iloc[:, 0] (column name="id") are different
            1 AssertionError: DataFrame.iloc[:, 0] (column name="playerID") are different
            1 AssertionError: Series NA mask are different
            1 AssertionError: assert 'ibis_cached_77ct5r5m2bglpkb253mhcdf5uy' not in ['array_types', 'astronauts', 'awards_players', 'basic_table', 'batting', 'complicated', ...]
            1 AssertionError: assert nan == 22
            1 SparkRuntimeException: Cast error: Casting from Date32 to Float64 not supported
            1 SparkRuntimeException: Error during planning: expr type Struct("StructColumn({'x': xs, 'y': ys})": non-null Struct("x": non-null Int32, "y": non-null Int32)) can't cast to Struct("x": Int64, metadata:...
            1 TypeError: Cannot convert pyarrow.lib.ChunkedArray to pyarrow.lib.Array
            1 UnsupportedOperationException: CommandNode::AnalyzeTable
            1 UnsupportedOperationException: Physical plan does not support logical expression AggregateFunction(AggregateFunction { func: AggregateUDF { inner: ArrayAgg { signature: Signature { type_signature: Any...
            1 UnsupportedOperationException: Physical plan does not support logical expression InSubquery(InSubquery { expr: Column(Column { relation: Some(Bare { table: "t0" }), name: "#0" }), subquery: <subquery>...
            1 UnsupportedOperationException: Physical plan does not support logical expression InSubquery(InSubquery { expr: Column(Column { relation: Some(Bare { table: "t0" }), name: "#1" }), subquery: <subquery>...
            1 UnsupportedOperationException: unsupported ALTER TABLE operation
            1 assert frozenset({None}) == frozenset({None, 47}) Extra items in the right set: 47 Full diff: frozenset({ None, - 47, })
            1 assert {0.0, 1.0, 2.0, 3.0} == {1, 2, 3} Extra items in the left set: 0.0 Full diff: { + 0.0, - 1, + 1.0, ? ++ - 2, + 2.0, ? ++ - 3, + 3.0, ? ++ }

Passed Tests Diff

(empty)

Failed Tests

ibis/backends/pyspark/tests/test_basic.py::test_group_by
ibis/backends/pyspark/tests/test_client.py::test_catalog_db_args
ibis/backends/pyspark/tests/test_client.py::test_create_table_with_partition_and_catalog
ibis/backends/pyspark/tests/test_client.py::test_create_table_with_partition_no_catalog
ibis/backends/pyspark/tests/test_ddl.py::test_compute_stats
ibis/backends/pyspark/tests/test_ddl.py::test_insert_table
ibis/backends/pyspark/tests/test_ddl.py::test_truncate_table
ibis/backends/tests/test_aggregation.py::test_approx_quantile[pyspark-True-False]
ibis/backends/tests/test_aggregation.py::test_approx_quantile[pyspark-True-True]
ibis/backends/tests/test_aggregation.py::test_date_quantile[pyspark]
ibis/backends/tests/test_aggregation.py::test_group_concat_over_window[pyspark]
ibis/backends/tests/test_client.py::test_insert_overwrite_from_dataframe[pyspark]
ibis/backends/tests/test_client.py::test_insert_overwrite_from_expr[pyspark]
ibis/backends/tests/test_client.py::test_insert_overwrite_from_list[pyspark]
ibis/backends/tests/test_client.py::test_rename_table[pyspark]
ibis/backends/tests/test_export.py::test_table_to_csv[pyspark]
ibis/backends/tests/test_expr_caching.py::test_persist_expression_contextmanager[pyspark]
ibis/backends/tests/test_expr_caching.py::test_persist_expression_release[pyspark]
ibis/backends/tests/test_expr_caching.py::test_persist_expression_repeated_cache[pyspark]
ibis/backends/tests/test_generic.py::test_isin_uncorrelated[pyspark]
ibis/backends/tests/test_generic.py::test_isin_uncorrelated_simple[pyspark]
ibis/backends/tests/test_io.py::test_read_csv[pyspark-default]
ibis/backends/tests/test_io.py::test_read_csv[pyspark-file_name]
ibis/backends/tests/test_join.py::test_join_with_pandas[pyspark]
ibis/backends/tests/test_json.py::test_json_getitem_array[pyspark]
ibis/backends/tests/test_struct.py::test_field_overwrite_always_prefers_unpacked[pyspark]
ibis/backends/tests/test_struct.py::test_isin_struct[pyspark]
ibis/backends/tests/test_struct.py::test_single_field[pyspark-a]
ibis/backends/tests/test_struct.py::test_single_field[pyspark-b]
ibis/backends/tests/test_struct.py::test_single_field[pyspark-c]
ibis/backends/tests/test_temporal.py::test_delta[pyspark-time]