$npx -y skills add NeoLabHQ/context-engineering-kit --skill decayManage evidence freshness by identifying stale decisions and providing governance actions
| 1 | # Evidence Freshness Management |
| 2 | |
| 3 | Manages **evidence freshness** by identifying stale decisions and providing governance actions. Implements FPF B.3.4 (Evidence Decay). |
| 4 | |
| 5 | **Key principle:** Evidence is perishable. Decisions built on expired evidence carry hidden risk. |
| 6 | |
| 7 | --- |
| 8 | |
| 9 | ## Quick Concepts |
| 10 | |
| 11 | ### What is "stale" evidence? |
| 12 | |
| 13 | Every piece of evidence has a `valid_until` date. A benchmark from 6 months ago may no longer reflect current system performance. A security audit from before a major dependency update doesn't account for new vulnerabilities. |
| 14 | |
| 15 | When evidence expires, the decision it supports becomes **questionable** - not necessarily wrong, just unverified. |
| 16 | |
| 17 | ### What is "waiving"? |
| 18 | |
| 19 | **Waiving = "I know this evidence is stale, I accept the risk temporarily."** |
| 20 | |
| 21 | Use it when: |
| 22 | - You're about to launch and don't have time to re-run all tests |
| 23 | - The evidence is only slightly expired and probably still valid |
| 24 | - You have a scheduled date to refresh it properly |
| 25 | |
| 26 | A waiver is NOT ignoring the problem - it's **explicitly documenting** that you know about the risk and accept it until a specific date. |
| 27 | |
| 28 | ### The Three Actions |
| 29 | |
| 30 | | Situation | Action | What it does | |
| 31 | |-----------|--------|--------------| |
| 32 | | Evidence is old but decision is still good | **Refresh** | Re-run the test, get fresh evidence | |
| 33 | | Decision is obsolete, needs rethinking | **Deprecate** | Downgrade hypothesis, restart evaluation | |
| 34 | | Accept risk temporarily | **Waive** | Record the risk acceptance with deadline | |
| 35 | |
| 36 | --- |
| 37 | |
| 38 | ## Action (Run-Time) |
| 39 | |
| 40 | ### Step 1: Generate Freshness Report |
| 41 | |
| 42 | 1. List all evidence files in `.fpf/evidence/` |
| 43 | 2. For each evidence file: |
| 44 | - Read `valid_until` from frontmatter |
| 45 | - Compare with current date |
| 46 | - Classify as FRESH, STALE, or EXPIRED |
| 47 | |
| 48 | ### Step 2: Present Report |
| 49 | |
| 50 | ```markdown |
| 51 | ## Evidence Freshness Report |
| 52 | |
| 53 | ### EXPIRED (Requires Action) |
| 54 | |
| 55 | | Evidence | Hypothesis | Expired | Days Overdue | |
| 56 | |----------|------------|---------|--------------| |
| 57 | | ev-benchmark-2024-06-15 | redis-caching | 2024-12-15 | 45 | |
| 58 | | ev-security-2024-07-01 | auth-module | 2025-01-01 | 14 | |
| 59 | |
| 60 | ### STALE (Warning) |
| 61 | |
| 62 | | Evidence | Hypothesis | Expires | Days Left | |
| 63 | |----------|------------|---------|-----------| |
| 64 | | ev-loadtest-2024-10-01 | api-gateway | 2025-01-20 | 5 | |
| 65 | |
| 66 | ### FRESH |
| 67 | |
| 68 | | Evidence | Hypothesis | Expires | |
| 69 | |----------|------------|---------| |
| 70 | | ev-unittest-2025-01-10 | validation-lib | 2025-07-10 | |
| 71 | |
| 72 | ### WAIVED |
| 73 | |
| 74 | | Evidence | Waived Until | Rationale | |
| 75 | |----------|--------------|-----------| |
| 76 | | ev-perf-old | 2025-02-01 | Migration pending | |
| 77 | ``` |
| 78 | |
| 79 | ### Step 3: Handle User Actions |
| 80 | |
| 81 | Based on user response, perform one of: |
| 82 | |
| 83 | #### Refresh |
| 84 | |
| 85 | User: "Refresh the redis caching evidence" |
| 86 | |
| 87 | 1. Navigate to the hypothesis in `.fpf/knowledge/L2/` |
| 88 | 2. Re-run validation to create fresh evidence |
| 89 | |
| 90 | #### Deprecate |
| 91 | |
| 92 | User: "Deprecate the auth module decision" |
| 93 | |
| 94 | 1. Move hypothesis from L2 to L1 (or L1 to L0) |
| 95 | 2. Create deprecation record: |
| 96 | |
| 97 | ```markdown |
| 98 | # In .fpf/evidence/deprecate-auth-module-2025-01-15.md |
| 99 | --- |
| 100 | id: deprecate-auth-module-2025-01-15 |
| 101 | hypothesis_id: auth-module |
| 102 | action: deprecate |
| 103 | from_layer: L2 |
| 104 | to_layer: L1 |
| 105 | created: 2025-01-15T10:00:00Z |
| 106 | --- |
| 107 | |
| 108 | # Deprecation: auth-module |
| 109 | |
| 110 | **Reason**: Evidence expired, technology landscape changed |
| 111 | |
| 112 | **Next Steps**: Run `/fpf:propose-hypotheses` to explore alternatives |
| 113 | ``` |
| 114 | |
| 115 | 3. Move the hypothesis file: |
| 116 | ```bash |
| 117 | mv .fpf/knowledge/L2/auth-module.md .fpf/knowledge/L1/auth-module.md |
| 118 | ``` |
| 119 | |
| 120 | #### Waive |
| 121 | |
| 122 | User: "Waive the benchmark until February" |
| 123 | |
| 124 | 1. Create waiver record: |
| 125 | |
| 126 | ```markdown |
| 127 | # In .fpf/evidence/waiver-benchmark-2025-01-15.md |
| 128 | --- |
| 129 | id: waiver-benchmark-2025-01-15 |
| 130 | evidence_id: ev-benchmark-2024-06-15 |
| 131 | waived_until: 2025-02-01 |
| 132 | created: 2025-01-15T10:00:00Z |
| 133 | --- |
| 134 | |
| 135 | # Waiver: ev-benchmark-2024-06-15 |
| 136 | |
| 137 | **Evidence**: ev-benchmark-2024-06-15 |
| 138 | **Hypothesis**: redis-caching |
| 139 | **Waived Until**: 2025-02-01 |
| 140 | **Rationale**: Migration pending, will re-run after completion |
| 141 | |
| 142 | **Accepted By**: User |
| 143 | **Created**: 2025-01-15 |
| 144 | |
| 145 | **WARNING**: This evidence returns to EXPIRED status after 2025-02-01. |
| 146 | ``` |
| 147 | |
| 148 | --- |
| 149 | |
| 150 | ## Natural Language Usage |
| 151 | |
| 152 | **You don't need to memorize evidence IDs.** Just describe what you want. |
| 153 | |
| 154 | ### Example Workflow |
| 155 | |
| 156 | ``` |
| 157 | User: /fpf:decay |
| 158 | |
| 159 | Agent shows report with stale evidence |
| 160 | |
| 161 | User: Waive the benchmark until February, we'll re-run it after the migration. |
| 162 | |
| 163 | Agent: Creating waiver for ev-benchmark-2024-06-15 until 2025-02-01. |
| 164 | Rationale: "Re-run after migration" |
| 165 | |
| 166 | [Creates .fpf/evidence/waiver-benchmark-2025-01-15.md] |
| 167 | |
| 168 | User: The vendor API is being discontinued. Deprecate that decision. |
| 169 | |
| 170 | Agent: Deprecating hypothesis-vendor-api from L2 to L1. |
| 171 | [Moves file, creates deprecation record] |
| 172 | |
| 173 | Next step: Run /fpf:propose-hypotheses to explore alternatives. |
| 174 | ``` |
| 175 | |
| 176 | --- |
| 177 | |
| 178 | ## WLNK Principle |
| 179 | |
| 180 | A hypothesis is **STALE** if *any* of its evidence is expired (and not waived). |
| 181 | |
| 182 | This is the Weakest Link (WLNK) principle: reliability = min(all evidence). One stale |