justfile with direct CLI calls, using ninja only to prepare
generated build artifacts that the test commands need.
Quick reference
out/coverage/ (gitignored).
Coverage tools and thresholds
| Stack | Test runner | Coverage tool | Minimum |
|---|---|---|---|
| Rust workspace | cargo nextest via cargo-llvm-cov | cargo-llvm-cov | 60% |
Python pylib/anki | pytest pylib/tests | coverage.py | 65% |
Python qt/aqt | pytest qt/tests | coverage.py | 20% |
| TypeScript/Svelte | vitest run | Vitest V8 | 5% |
just test --coverage in CI. macOS and Windows
jobs run just test (no coverage enforcement) for now.
Notes
- Rust —
cargo-llvm-covis installed on demand intoout/bin/to avoid polluting the global cargo install. Coverage runs rebuild the workspace with instrumentation, so they are slower than plainjust test-rust. Windows ARM64 (aarch64-pc-windows-msvc) is not supported: the Rust compiler produces malformed.profrawfiles on that target (rust-lang/rust#150123, cargo-llvm-cov#436).just test-rust --coverageexits with a clear message on ARM64 Windows; usejust test-rust(no coverage) or rely on CI (Linux) for enforcement. - Python — coverage is split across two suites (
pylibandqt) because they have differentPYTHONPATHsetups and test folders. - TypeScript — coverage is measured only over code reachable through Vitest’s module graph. Svelte component rendering behavior is not covered.
Gaps and future improvements
- Raise thresholds gradually as the test suite grows and CI timings stabilise.
- Exclude generated files from coverage denominators where appropriate.
- Publish
out/coverage/as a CI artifact so reviewers can browse HTML reports directly from a PR. - Consider diff/changed-file coverage once baselines are stable — it is a better enforcement mechanism for incremental improvement than whole-repo thresholds.
- Add component or browser tests for Svelte UI surfaces if Svelte coverage is intended to cover rendered component behaviour.