Coldfix

Agent lessons that have to pass first.

Coldfix reads agent transcripts, CI test failures and code reviews. It finds the mistakes that someone later corrected, proves the fix with a check, and only then writes the lesson. Your agents get it as a repo rule and a pre-push hook.

See how it works Source coming soon

Check the row count before accepting an import.

example/importer · check row-count
  1. Before the fix FAIL 3f9a2c1 · row-count
  2. After the fix PASS b81e04d
  3. Fix reversed FAIL b81e04d − patch
  4. Lesson written Proven scope: this repo
An invented example. Three runs must agree before Coldfix writes the lesson. Change one and it stays a proposal.

It learns from the places mistakes already show up.

Mistakes surface after an agent's first attempt, when a test, a reviewer or a person corrects them. Coldfix collects those corrections.

CI failures
Failed test runs, grouped when the same error comes back on different commits or in different repos. Flaky failures are dropped.
Code reviews
Review findings that were later fixed in a pull request, paired with the commit that fixed them.
Transcripts
Agent conversations scored for moments where the agent was corrected. A score only flags a lead; it never proves a lesson by itself.

Use it in three commands.

Coldfix is a set of Python scripts that use only the standard library. It needs Python 3.10 or later, Git and a POSIX shell. The source is not public yet.

  1. Save your settings once

    Point Coldfix at a repository and at the failure events it should read. Delivery takes a few more paths (where lessons go and the privacy screen they pass). Until those are set, proven lessons wait as pending.

    python3 coldfix.py init --repo ./my-repo --input events.jsonl

  2. Install the hook and CI step

    Adds a pre-push hook and a CI workflow that run every delivered lesson's check, plus a workflow that asks for a code review on new pull requests. It never overwrites a file it did not write. Commit the files yourself.

    python3 coldfix.py install --repo ./my-repo --dry-run
python3 coldfix.py install --repo ./my-repo

  3. Learn

    Drafts checks for mistakes that keep coming back, replays them against your Git history, and delivers the ones that pass.

    python3 coldfix.py learn

Most agent memory stores notes. Coldfix stores proof.

Why Coldfix