Jorijn van der Graaf
dc27c5c204
Vendors toml++ v3.4.0 as lib/toml.hpp and wires it into Crafter.Build-Test to parse a declarative test.toml manifest (target/march/mtune/sysroot/ requires/timeout/args/defines). Test discovery now treats project.cpp and test.toml as mutually exclusive: project.cpp stays the escape hatch for outer-driver tests, test.toml gives downstream test authors a no-boilerplate path. Adds: - TestRunner::Wine() and TestRunner::ForTarget(cfg) — runner is now derived from cfg.target (Local for host, Wine for Windows-on-Linux, wasmtime for WASI, qemu-<arch> with QEMU_LD_PREFIX for non-host Linux). The env-var override CRAFTER_BUILD_RUNNER_<target> still wins as a power-user escape hatch via FromEnv. - Declarative preconditions: tool:<name>, file:<path>, env:<VAR> are evaluated before the build; missing preconditions Skip without paying the compile cost. - Hard-fail-unless-declared: when a derived runner's tool is missing AND the test didn't declare 'tool:<that>' in requires, the missing runner is a Fail instead of a silent Skip. Surfaces broken cross-arch CI config that previously hid as "skipped". - Multi-target sweep: bare `crafter-build test` (no --target=) now iterates every distinct test.toml-declared target plus the host, so cross-arch tests run by default without the user needing to know which targets exist. `--target=X` bypasses the sweep. Test struct gains a `requires_` vector so project.cpp users can declare preconditions too (matching what test.toml writes there). Existing tests, factories (Ssh/SshWin/Wsl/Cmd), and CRAFTER_BUILD_RUNNER_* machinery remain intact — this commit only adds; migration and deletion follow in subsequent commits. Refs issue #8. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
66 lines
2.8 KiB
C++
66 lines
2.8 KiB
C++
/*
|
|
Crafter® Build
|
|
Copyright (C) 2026 Catcrafts®
|
|
Catcrafts.net
|
|
|
|
This library is free software; you can redistribute it and/or
|
|
modify it under the terms of the GNU Lesser General Public
|
|
License version 3.0 as published by the Free Software Foundation;
|
|
|
|
This library is distributed in the hope that it will be useful,
|
|
but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
|
|
Lesser General Public License for more details.
|
|
|
|
You should have received a copy of the GNU Lesser General Public
|
|
License along with this library; if not, write to the Free Software
|
|
Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
|
|
*/
|
|
|
|
module;
|
|
#include "Crafter.Build-Api.h"
|
|
export module Crafter.Build:Test;
|
|
import std;
|
|
import :Clang;
|
|
|
|
export namespace Crafter {
|
|
struct RunTestsOptions {
|
|
std::vector<std::string> globs;
|
|
int jobs = 0;
|
|
std::optional<std::chrono::seconds> timeoutOverride;
|
|
bool listOnly = false;
|
|
// Single-target run: only tests whose Configuration::target matches
|
|
// are included. Empty (default) = run every distinct target declared
|
|
// across discovered tests, plus the host target. Set from --target=...
|
|
// (when omitted, the harness sweeps all declared targets so cross-arch
|
|
// tests run by default without the user having to know which targets
|
|
// exist).
|
|
std::string targetFilter;
|
|
// CLI override for --runner=<spec>: applies to every test in the run.
|
|
// Target scoping is unnecessary because targetFilter ensures the run
|
|
// contains only one target's tests.
|
|
std::optional<std::string> runnerOverride;
|
|
};
|
|
|
|
struct TestSummary {
|
|
int passed = 0;
|
|
int failed = 0;
|
|
int crashed = 0;
|
|
int timedOut = 0;
|
|
int skipped = 0;
|
|
std::vector<TestResult> results;
|
|
bool AllPassed() const { return failed == 0 && crashed == 0 && timedOut == 0; }
|
|
};
|
|
|
|
CRAFTER_API TestSummary RunTests(Configuration& projectCfg, const RunTestsOptions& opts, std::span<const std::string_view> projectArgs = {});
|
|
CRAFTER_API TestResult RunSingleTest(const Test& test, const std::filesystem::path& binary, std::chrono::seconds timeout);
|
|
|
|
// Parent-project access for test fixtures. Run() sets the pointer to the
|
|
// root project's Configuration before discovery; fixtures call ParentLib()
|
|
// to obtain a Configuration* for one of the parent's libraries (or the
|
|
// parent itself) so they can declare it as a dependency without rebuilding
|
|
// the lib config from scratch. Lookup is by Configuration::name and
|
|
// recurses through the parent's dependency graph.
|
|
CRAFTER_API void SetParentProject(Configuration* parent);
|
|
CRAFTER_API Configuration* ParentLib(std::string_view name);
|
|
}
|