Post Review Review
Updated 2026-06-22T03:44:26.437Z
what do you think the review scope would be now? Give me a summary.
● Good question — the remediation fundamentally changes what a re-review should look for. The original was a mechanical pass hunting enforcement gaps; most of those are now closed, so a new review's center of gravity shifts to operator hardening, operability, and structural debt — and to verifying the gates we added actually bite.
What's now largely OUT of scope (closed by #317–#320)
- D3 / D12 (testing & multi-lang CI): operator+server are CI-gated, portal has a real suite, toolchain unified. The "green but ungated" headline is gone.
- D4 (security/authz): the one live-behavior gap — default-off deploy authz — is now fail-closed, audited (25d, 0 would-deny), and enforcing in prod.
- D5 (reliability): SQLite write hardening, transaction atomicity, reconciler re-poll — the specific findings are fixed.
- Most D2 untyped-seam fragility for the one load-bearing path (env-not-deployed) + codegen now has round-trip armor.
What a re-review SHOULD scope now (prioritized)
- Do the new gates actually bite? The cheapest high-value check: prove a broken operator/server test turns CI red, a malformed generated manifest fails the round-trip test, and enforced authz produces no false-positive 403s in the wild. Enforcement you can't see fire is back to "convention over code."
- Operator hardening — the real remaining risk. Highest privilege, lowest coverage, and we only partially touched it. Still open: the escalate+bind / literal / per-env Role (RBAC opacity), no test for the --bounded-apply=false path, the atlas plan/apply TOCTOU, and distinct startup/first-reconcile conditions (the "missing kilter-envs → 15-min generic Failed" UX). These were Phase 2 items (2.4/2.5) I deliberately didn't ship.
- Operability (D6) — scored F, never touched, and now has live signal. The cluster audit showed ~20 KilterApps with several stuck in Failed (crm-five-nick, kanbana, tsc, beyond-human-staging). That's real evidence for the dimension the original deferred: error visibility, rollback path, runbooks, and why those apps are failing.
- The known stdlib-vuln baseline. No longer hypothetical — govulncheck surfaced reachable Go stdlib vulns. Concrete, actionable: bump the toolchain, clear it, make the gate blocking.
- New, unreviewed surface. The tree moved ~33 commits during the work — ADR-0018 request-based data-source access, the tabbed project page, etc. The original review never saw these.
- Deferred structural debt (judgment call, not a bug). deploy.go (~1,900 LOC) / config.go (~2,770 LOC) size; CLI hardcoding the operator's phase vocabulary as bare strings; the deploy-sequencer extraction. Worth a deliberate "pay down now or not" decision, not a finding.
- The original's own deferred Part III — the running-app UX walk — still never happened.
The shape of it
A fair re-grade moves from F → ~C+/B- on the closed dimensions, so the re-review's value is no longer "find mechanical gaps" — it's recalibrate, then go deep on the two genuinely under-examined areas the first pass skimmed: the operator (privilege) and operability (the failing apps). Less breadth-scanning, more targeted depth — and ideally run against a standing environment rather than a static code sweep, since the most interesting remaining issues (failing deploys, whether enforcement misfires) only show up at runtime.
One caveat on my own read: this is reasoned from what we changed plus the cluster state I observed this session — I haven't re-swept the full tree at its current tip, so a real re-review should re-baseline first.