feat(pipeline): the pure pipeline, checked against its goldens

The modules that turn a frozen range into passes and passes into a
verdict: :Schema, :Tools (the DENY, git and base lists, a leaf, so the
config and the pool both read them), :Plan, :Artifact, :Inventory,
:Dispositions, :State, :Normalize, :Stream, :Prompt, :Config, and the URL
half of :PgWire. Units, jobs, results, the config and the claude stream
stay JSON from end to end, so every key keeps its place; :Text gives JSON
values truthiness, get, ==, membership and Str(), and throws Dyn::Error
under a name for each kind of unexpected data.

Exactness where the bytes are seen:
- the stream classifiers are hand-written scanners with case-insensitive
  folds (the Kelvin sign is a k), Unicode \b and \s, and `.` stopping at
  \n; the SQL call detection takes `<exe> sql` with any path before it;
- config problems carry the JSON scanner's and the UTF-8 decoder's own
  texts, positions included;
- a float total is Neumaier's compensated sum, and the build passes
  -ffp-contract=off: -march=native would fuse a*b+c;
- `crafter-review inventory` and `config` print what the goldens record,
  byte for byte (the fixture and 14 configs, broken ones included); a
  message names this binary as the command to run.

tests/Goldens: the recorded answers over the fixtures next to them (the
commits fixture, a rich versioned series with CRLF, a folded subject,
Markdown headings in and out of fences, the code-key rewrites); the suite
compares 2304 results as DumpFile writes them, so a key out of order fails
too. All agree.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Jorijn van der Graaf 2026-10-31 06:48:55 +01:00
commit 741e3a656d
Signed by: jorijnvdgraaf
GPG key ID: 2937E59CDCC1BCFB
70 changed files with 30565 additions and 21 deletions

View file

@ -0,0 +1,40 @@
// SPDX-License-Identifier: AGPL-3.0-only
// SPDX-FileCopyrightText: Copyright (C) 2026 Catcrafts®
export module Crafter.Review:Stream;
import std;
import :Json;
// The claude CLI's stream-json, parsed, and a pass's status classified from
// it. The patterns are hand-written scanners, case-insensitive with Unicode
// folding (the Kelvin sign is a k) and Unicode-aware where \b and \s are.
//
// The stream is split into lines at \n only: the CLI writes U+2028 and \x1c
// raw inside a JSON string, and a line cut there would be lost.
export namespace Crafter::Review::Stream {
// A Bash call of the database helper, alone or in a compound command:
// this binary's `<exe> sql`, with any path before it.
bool IsSqlCall(std::string_view command);
// The helper's ANSWERED line at the start of a line of the result.
bool HasAnsweredLine(std::string_view text);
// LIMIT_RE, AUTH_RE, CREDIT_RE: a rate limit, an authentication failure,
// an organization out of API credit.
bool LimitText(std::string_view text);
bool AuthText(std::string_view text);
bool CreditText(std::string_view text);
// One pass over the NDJSON: the last result line, the last
// rate_limit_event, the first session_id, usage totals, the first turn's
// usage, tool-call forensics, system/init, each under its own key.
Json ParseStream(std::string_view text);
// structured_output, else the result text parsed as JSON, a
// double-encoded string decoded; nullopt without a findings array.
std::optional<Json> StructuredOutput(const Json& result);
// ok | limit | credits | auth | timeout | error, and why.
std::pair<std::string, std::string> Classify(const Json& parsed, std::optional<std::int32_t> exitCode, std::string_view stderrText,
bool timedOut = false);
// {window: {utilization, resetsAt}} from a rate_limit_info: the CLI
// reports a fraction (2026-09-17: five_hour 0.2), the pool thresholds are
// percents.
Json Windows(const Json& rate);
}