-
Notifications
You must be signed in to change notification settings - Fork 0
Align project docs with replay validation scope #216
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 1 commit
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| @@ -1,22 +1,22 @@ | ||||||||||||||||||||
| # Project Source: CompText V7 | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Canonical Positioning | ||||||||||||||||||||
| “CompTextv7 is the deterministic replay-integrity layer for compressed operational agent traces.” | ||||||||||||||||||||
| “CompText V7 is a deterministic replay-validation prototype for compact operational agent/MCP traces, with a KVTC-V7 technical-log compression prototype.” | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Strategic Category | ||||||||||||||||||||
| CompTextv7 is a deterministic replay-integrity validation research prototype. | ||||||||||||||||||||
| CompText V7 is a deterministic replay-validation research prototype. | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Core Thesis | ||||||||||||||||||||
| The core project question is: | ||||||||||||||||||||
|
|
||||||||||||||||||||
| “Can a compressed agent state still reproduce a safe operational trajectory?” | ||||||||||||||||||||
| “Can compact operational trace state still reproduce a safe replay trajectory?” | ||||||||||||||||||||
|
|
||||||||||||||||||||
| The governing research direction is: | ||||||||||||||||||||
|
|
||||||||||||||||||||
| “Deterministic Replay Integrity Validation for Compressed Operational Agent Traces” | ||||||||||||||||||||
| “Deterministic replay validation for compact operational agent/MCP traces” | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Research Alignment Principle | ||||||||||||||||||||
| Every accepted change must strengthen deterministic, offline, reproducible replay-integrity validation for compressed operational traces, or be strictly maintenance-only. | ||||||||||||||||||||
| Every accepted change must strengthen deterministic, offline, reproducible replay validation for compact operational traces, or be strictly maintenance-only. | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Current Strategic State | ||||||||||||||||||||
| The project remains: | ||||||||||||||||||||
|
|
@@ -29,6 +29,8 @@ The project remains: | |||||||||||||||||||
| - audit-oriented | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Current Implementation State | ||||||||||||||||||||
| Current implemented surfaces include curated agent trace fixtures in `tests/fixtures/agent_traces/`, the deterministic replay runner in `tests/utils/agent_trace_replay_runner.py`, the MCP replay payload layer in `src/comptext_v7/mcp/`, evidence survival helpers in `src/validation/evidence.py`, replay failure labels in `src/validation/replay_failure_classifier.py`, committed artifacts such as `artifacts/agent_trace_replay_results.json`, and the KVTC-V7 technical-log compression prototype in `src/core/kvtc_v7.py`. | ||||||||||||||||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. This line is extremely long and contains a dense list of file paths. Converting it to a bulleted list would significantly improve readability and align with the formatting used in the 'Strategic State' section above.
Suggested change
|
||||||||||||||||||||
|
|
||||||||||||||||||||
| The `mcp_trace_replay` fixture family is hardened via explicit capability-boundary structures, deterministic degraded variants, and `failure_label_on_violation` handling. | ||||||||||||||||||||
|
|
||||||||||||||||||||
| A deterministic artifact evidence index maps committed evidence artifacts to their generators, evidence categories, fixture-family coverage, manifest alignment, deterministic evaluation status, LLM-free status, and external-API-free status. | ||||||||||||||||||||
|
|
@@ -37,11 +39,11 @@ A deterministic artifact evidence index maps committed evidence artifacts to the | |||||||||||||||||||
| See `NON_GOALS.md` in the repository root for the full list of prohibited expansion paths and the hard scope test. | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Hard Scope Rule | ||||||||||||||||||||
| A proposal is out of scope unless it directly improves deterministic replay-integrity validation for compressed operational traces without introducing probabilistic or platform-expansion behavior. | ||||||||||||||||||||
| A proposal is out of scope unless it directly improves deterministic replay validation for compact operational traces without introducing probabilistic or platform-expansion behavior. | ||||||||||||||||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The 'Hard Scope Rule' should use the full canonical term 'compact operational agent/MCP traces' to avoid ambiguity in governance enforcement.
Suggested change
|
||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Scope Evolution & RFC Process | ||||||||||||||||||||
| Scope-expanding proposals require an RFC before implementation. RFCs must: | ||||||||||||||||||||
| 1. define the exact replay-integrity gain, | ||||||||||||||||||||
| 1. define the exact replay-validation gain, | ||||||||||||||||||||
| 2. prove deterministic and offline reproducibility, | ||||||||||||||||||||
| 3. show no hidden orchestration/platform expansion, | ||||||||||||||||||||
| 4. describe artifact and failure-taxonomy implications, | ||||||||||||||||||||
|
|
@@ -50,21 +52,21 @@ Scope-expanding proposals require an RFC before implementation. RFCs must: | |||||||||||||||||||
| Default decision for scope-expanding proposals is rejection until the RFC is accepted. | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Correct Abstraction Level | ||||||||||||||||||||
| CompTextv7 focuses on replay-integrity contracts, trace-derived artifacts, fixture families, deterministic validators, and auditable evidence outputs. It does not absorb adjacent runtime or product-platform responsibilities. | ||||||||||||||||||||
| CompText V7 focuses on replay contracts, trace-derived artifacts, fixture families, deterministic validators, and auditable evidence outputs. It does not absorb adjacent runtime or product-platform responsibilities. | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Preferred Terminology | ||||||||||||||||||||
| Prefer: | ||||||||||||||||||||
| - deterministic replay-integrity validation | ||||||||||||||||||||
| - compressed operational traces | ||||||||||||||||||||
| - deterministic replay validation | ||||||||||||||||||||
| - compact operational agent/MCP traces | ||||||||||||||||||||
| - artifact evidence | ||||||||||||||||||||
| - failure taxonomy and labels | ||||||||||||||||||||
| - capability boundary | ||||||||||||||||||||
| - offline reproducibility | ||||||||||||||||||||
|
|
||||||||||||||||||||
| Avoid vague or marketing abstractions that hide deterministic constraints. | ||||||||||||||||||||
| Avoid vague or marketing abstractions that hide deterministic constraints. Do not frame the repository as industrial, enterprise-ready, production-ready, certification-grade, showcase-first, or a cognitive fabric. | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Roadmap From Here | ||||||||||||||||||||
| 1. Expand deterministic replay-integrity fixture coverage. | ||||||||||||||||||||
| 1. Expand deterministic replay-validation fixture coverage. | ||||||||||||||||||||
| 2. Strengthen artifact-evidence traceability and reproducibility checks. | ||||||||||||||||||||
| 3. Improve contract-level validation clarity and failure classification precision. | ||||||||||||||||||||
| 4. Add narrowly scoped capabilities only via approved RFC. | ||||||||||||||||||||
|
|
@@ -73,11 +75,11 @@ Avoid vague or marketing abstractions that hide deterministic constraints. | |||||||||||||||||||
| - Documentation-only governance changes should stay small and focused. | ||||||||||||||||||||
| - Core logic changes must include targeted tests. | ||||||||||||||||||||
| - No merge-ready state until CI is green and review threads are resolved/outdated. | ||||||||||||||||||||
| - Keep docs, showcase, and core refactors separated. | ||||||||||||||||||||
| - Keep unrelated docs, demos, and core refactors separated. | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## PR Template Additions | ||||||||||||||||||||
| PR descriptions should explicitly confirm: | ||||||||||||||||||||
| - deterministic replay-integrity alignment, | ||||||||||||||||||||
| - deterministic replay-validation alignment, | ||||||||||||||||||||
| - non-goals preserved, | ||||||||||||||||||||
| - artifact regeneration expectations, | ||||||||||||||||||||
| - evidence-index impact (updated or unchanged), | ||||||||||||||||||||
|
|
@@ -93,10 +95,10 @@ PR descriptions should explicitly confirm: | |||||||||||||||||||
| Governance is conservative, boundary-enforcing, and evidence-led. CompTextv7 accepts incremental improvements over broad platform ambitions. | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## Current Priority Stack | ||||||||||||||||||||
| 1. Deterministic replay-integrity correctness. | ||||||||||||||||||||
| 1. Deterministic replay-validation correctness. | ||||||||||||||||||||
| 2. Artifact evidence traceability. | ||||||||||||||||||||
| 3. Failure-label clarity and consistency. | ||||||||||||||||||||
| 4. Scope-bound documentation and review discipline. | ||||||||||||||||||||
|
|
||||||||||||||||||||
| ## One-Sentence Rule | ||||||||||||||||||||
| If a change does not directly improve deterministic replay-integrity validation for compressed operational traces, it should not merge into core. | ||||||||||||||||||||
| If a change does not directly improve deterministic replay validation for compact operational traces, it should not merge into core. | ||||||||||||||||||||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The 'One-Sentence Rule' is a critical governance boundary and should use the full terminology 'compact operational agent/MCP traces' for precision.
Suggested change
|
||||||||||||||||||||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The scope definition here is missing the 'agent/MCP' qualifier used in the canonical positioning (line 4) and research direction (line 16). For consistency in governance documents, the full term should be used.