Overview#
AccelerANTgine provides a native C++ inference library, C API bindings, Python bindings (nanobind) and CLI tooling. The API reference is generated from Doxygen XML via Breathe/Exhale (API Reference).
Key Features#
Build system: CMake >= 3.31.6
Performance benchmarks (
Test/perf)Linux and Windows
Clang, GNU and MSVC
Rust in every build:
Src/rusty_code, through Corrosion and cxx
Project Layout#
Src/: core library, CLI entry point, and platform/runtime integration codeTest/commit,Test/compile,Test/fuzz,Test/perf: the four C++ suites (The Suites)Test/common: the helpers the suites share, including the ONNX model writer that keeps test models out of the repositoryBindings/python: thekataglyphis_inferencePython module, tested byTest/pythondocs/source: Sphinx content and generated API integration pointsscripts/linux: Linux CI orchestration scriptsscripts/windows: the Windows build script, its container wrappers and the host-side run script
Dependencies#
Submodules included:
ANTfrastructure — the build hub: every reusable script, CMake module, PowerShell module and CI action this repo runs comes from
third_party/ANTfrastructure, and its gitlink decides what the lanes actually executeONNX Runtime — inference
GStreamer — media pipelines
WebRTC — realtime transport, through GStreamer’s
webrtcsinkabseil — pinned at or above the version FUZZTEST pins (
AGENTS.md§ 3)nanobind — the Python bindings
Optional:
Build Matrix Summary#
CMakePresets.json and the GitHub workflows encode the build matrix; which lane runs when is
in AGENTS.md § 5.
Linux x64 and arm64:
.github/workflows/linux-x64.ymland.github/workflows/linux-arm64.yml, both calling the reusable.github/workflows/reusable-linux.yml, run the wholeci-run-all.shchain (build, tests, coverage, static analysis, docs, benchmarks and release packaging; Linux Build And Test) inside the container imageWindows x64:
.github/workflows/windows-x64.yml, and the arm64 cross build:.github/workflows/windows-arm64-cross.yml, both thin callers of ANTfrastructure’s reusablecontainer-ci-windows.yml. They build inside the container, run on a host through PowerShell (Start-Windows.ps1for x64; the arm64 product runs on GitHub’swindows-11-armrunner) and uploaddist/windows-x64ordist/windows-arm64
What CI builds with, in the family’s container images:
Windows Server 2025 x64: clang-cl (LLVM 23) with the VS 2026 toolset (MSVC 14.51);
cl.exebuilds (msvc-debug, thex64-MSVC-*presets) exist, but no lane runs themclang-cl to compile the Rust crate on Windows
Windows arm64: a clang-cl cross build of the Release and Debug configurations, run on
windows-11-armUbuntu 26.04 x64: Clang 23 and GCC 16.2
Ubuntu 26.04 arm64: Clang 23 and GCC 16.2
Linux riscv64: cross-built on amd64 with the image’s distro clang 22 and tested under QEMU (
AGENTS.md§ 5, The riscv64 lane)
Which suites each build type compiles, and where each lane runs them: The Suites.