Forum Discussion

Kiantor's avatar
Kiantor
Brass Contributor
May 26, 2026

I built a Python runtime that loads precompiled MLIR artifacts from a closed-source compiler

I’ve been building Fluno, a closed-source compiler/runtime experiment for extracting selected hot regions from Python/PyTorch-style continuous inference loops and running them as precompiled native artifacts.

The public repo is not the compiler. It is the audit/runtime surface:

- a Python package ("fluno_runtime") that loads precompiled artifacts

- manifest/schema/hash/expiry validation before dynamic library loading

- a Windows x86_64 live artifact package

- benchmark docs and claim boundaries

- zero-compiler-internals public package structure

The current L-size continuous inference benchmark shows:

- PyTorch optimized repeated: 84.673 ms

- Fluno "hot_vector_repeated": 4.061 ms

- Fluno "hot_run_repeated": 7.245 ms

- max absolute error: 0.0 within the published 11-element "partial_summary_vector" scope

Important limitation: Fluno does not currently beat the handwritten Rust/C++ references on this row. The point of the current public release is not “faster than C++”; it is showing a Python-callable artifact runtime boundary with fail-closed validation and native-class latency.

No RepliesBe the first to reply