Skip to content

marin-dupekit-native: Add version 0.1.11.dev38062449553 - #3176

Merged
riseproject-dev[bot] merged 2 commits into
mainfrom
marin-dupekit-native
Oct 25, 2026
Merged

riseproject-dev[bot] merged 2 commits into
mainfrom
marin-dupekit-native

Conversation

@luhenry

@luhenry luhenry commented Oct 14, 2026 •

Copy link
Copy Markdown
Member

Compiles the dupekit_native PyO3 abi3 extension (arrow/parquet text-dedup kernels) from lib/dupekit/rust. Upstream publishes no riscv64 wheel.

Mirrors the dupekit Linux leg of upstream's marin-release-libs-wheels.yaml and its unified-unit.yaml test lane.

Differs from upstream

  • Pinned commit instead of a tag - upstream tags no dupekit release; crate tree matches the PyPI sdist.
  • Native maturin build in manylinux_2_39 instead of --zig cross-builds.
  • Root LICENSE copied next to the crate - upstream's wheel ships none.

Matrix: one cp312-abi3 wheel, tested on 3.12/3.13/3.14 - free-threaded CPython cannot load abi3.

Testing

  • same as upstream (lib/dupekit/tests, benchmarks skipped as upstream does)

License: OK

PyO3/maturin abi3 extension (dupekit_native) from marin-community/marin's
lib/dupekit/rust. Upstream tags no dupekit release, so the workflow pins
the commit whose crate tree matches the PyPI sdist and stamps the version
with upstream's own package_release.py helper, as its release job does.
luhenry added a commit that referenced this pull request Oct 14, 2026
… 0.1.11.dev38062449553, py-lib3mf -> ci-running (#3175, #3176, #3177)
@luhenry
luhenry marked this pull request as draft October 14, 2026 11:31
The test job's `uv pip install` asked for "pyarrow>=23.0.0" with no
binary restriction. PyPI ships no riscv64 pyarrow wheel, only an sdist,
so any time the version uv lands on is not served by our registry, uv
builds that sdist and fails ~20 minutes later at CMake's
find_package(Arrow). That is what took down all three test legs.

Pass --only-binary pyarrow (uv has no environment variable for it) so
uv only considers our registry's riscv64 pyarrow wheels.
@github-actions
github-actions Bot marked this pull request as ready for review October 25, 2026 17:49
@riseproject-dev
riseproject-dev Bot merged commit 9abdd50 into main Oct 25, 2026
9 checks passed
@riseproject-dev
riseproject-dev Bot deleted the marin-dupekit-native branch October 25, 2026 18:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant