Bound native OCI command ownership and materialization

toasterson commented

2026-10-08 23:18:05 +00:00

Owner

Native OCI builds now retain command ownership through timeout and cancellation, verify illumos contract emptiness before reaping, and preserve durable journals when cleanup is uncertain. Cleanup uncertainty stays typed through build finalization, including supervisor and reap failures, so an unconfirmed cleanup cannot retire its owner or record a completed build. Layer materialization uses component-ordered subtree traversal to remove quadratic full-image scans while preserving whiteout, directory and link semantics.

The change also includes the existing Darwin memory-detection prerequisite: serialize concurrent sys-info calls on macOS and test detected capacity. Native production behavior is unchanged.

WI-29 candidate: da9d1a4906a28bc73e693bfb845f7dec8a8f06c8.

Validation:

Exact candidate: full local workspace tests passed 503 tests, 0 failures, 2 ignored. The live S3 and external pinned client-go SPDY checks remain unverified by this run. Regression cases exercise initially unmarked cleanup uncertainty after both successful and failed builds, preserving recovery journals and refusing reuse.
Exact candidate: strict workspace all-targets Clippy with warnings denied, workspace formatting and patch whitespace checks passed.
Historical combined source 2f0c5bf4e289cca8ecbfb018a98cb6a88a202f1b passed native ownership and OCI tests on illumos. This supports unchanged components; it is not an exact-candidate native release.

Independent local exact-source review approved supported handback. Canonical exact-head review/CI, including required native workspace and CLI validation, remain pending before merge. Public image delivery and workload migration acceptance remain separate.

Work item: WI-29 (01a11a8b-562e-77f1-b231-691667e1dbe1).

Native OCI builds now retain command ownership through timeout and cancellation, verify illumos contract emptiness before reaping, and preserve durable journals when cleanup is uncertain. Cleanup uncertainty stays typed through build finalization, including supervisor and reap failures, so an unconfirmed cleanup cannot retire its owner or record a completed build. Layer materialization uses component-ordered subtree traversal to remove quadratic full-image scans while preserving whiteout, directory and link semantics. The change also includes the existing Darwin memory-detection prerequisite: serialize concurrent sys-info calls on macOS and test detected capacity. Native production behavior is unchanged. WI-29 candidate: `da9d1a4906a28bc73e693bfb845f7dec8a8f06c8`. Validation: - Exact candidate: full local workspace tests passed **503 tests, 0 failures, 2 ignored**. The live S3 and external pinned client-go SPDY checks remain unverified by this run. Regression cases exercise initially unmarked cleanup uncertainty after both successful and failed builds, preserving recovery journals and refusing reuse. - Exact candidate: strict workspace all-targets Clippy with warnings denied, workspace formatting and patch whitespace checks passed. - Historical combined source `2f0c5bf4e289cca8ecbfb018a98cb6a88a202f1b` passed native ownership and OCI tests on illumos. This supports unchanged components; it is not an exact-candidate native release. Independent local exact-source review approved supported handback. Canonical exact-head review/CI, including required native workspace and CLI validation, remain pending before merge. Public image delivery and workload migration acceptance remain separate. Work item: WI-29 (`01a11a8b-562e-77f1-b231-691667e1dbe1`).

toasterson added 6 commits

2026-10-08 23:18:05 +00:00

Preserve native OCI command ownership through cancellation 475236578f

Keep native ownership test faults local to each supervisor 93e0e7edcc

Open illumos contract templates with required access mode 017ff17b03

fix(oci): use native ctfs close-on-exec descriptor setup a5e39a2e36

Avoid full-image scans when replacing OCI layer paths 1a0b4ae003

(cherry picked from commit 2f0c5bf4e289cca8ecbfb018a98cb6a88a202f1b)

Serialize Darwin memory detection before worker validation ab045c968d

(cherry picked from commit 2f37ae1944f6524b10611854896f8cd652f4d6e0)

toasterson added 1 commit

2026-10-08 23:48:46 +00:00

Preserve native build cleanup uncertainty through finalization da9d1a4906

toasterson merged commit 7f30759a33 into main

2026-10-09 02:38:33 +00:00

toasterson referenced this pull request from a commit

2026-10-09 02:38:34 +00:00

Merge pull request 'Bound native OCI command ownership and materialization' (#15) from codex/node03-wi29-handback-20261009 into main

Rows
Columns

Bound native OCI command ownership and materialization #15