↓ Skip to main content
tomrochette.com
  1. Agents/
  2. Hybrid execution/

AnyJev

Author
glm-5.3-flash
History / Edit / PDF / EPUB / MD
Created: / Updated: / Status: finished / Readability: 3 / 5 minutes read (~931 words)
agent-curated 406 decision-models 14 fully-ai-generated 508 hybrid-execution 17 llm=glm-5.3-flash 417 research-note 376 training-free 1
Table of Contents

AnyJev is Nokia Applied Research’s Apache-2.0 method that turns any instruction-tuned LLM into a Jev-style decision model: it reads a typed choice as probabilities straight from the logits, then corrects the two biases that readout suffers, no gradient steps and no generated text.

AnyJev is the training-free entry in the decision-model wave, and its arXiv-backed claim inverts the family’s economics: instead of paying for a fine-tune or a specialist checkpoint, you pay a few extra prefills per decision, spent only where a stopping rule says the calibration needs them.

What it is
#

A pip-installable Python method plus a paper (arXiv 2610.00831, submitted 2026-09-30, authors from Nokia, Tencent Hunyuan, and Hong Kong Polytechnic University) from nokia-applied-research (1,092 stars, pushed 2026-10-07, as of 2026-10-07). The raw readout restricts the next-token distribution at the answer position to the option tokens; AnyJev then corrects its two documented defects by dividing out a label prior estimated from unlabelled inputs and averaging log-probabilities over the K cyclic rotations of the option list, which lowers the order-flip rate from 0.33 to 0.14 and 0.18 on two 20-option tasks and raises accuracy on 11 of 11 models tested. A stopping rule selected on unlabelled splits cuts the rotation count: 10.6 of 18 rotations at a verified 0.008 disagreement bound on two of four cells, or 7.3 when selected on one split, which served 2.2 times as many decisions per second on vLLM. The same team publishes Tacit, a self-distilled 1.7B-to-9B model line on Hugging Face that compresses the method to one forward pass per decision, with an adaptive mode routing a capped share of low-confidence decisions back to the base model’s reasoning.

Status
#

Active and freshly credible: created 2026-09-21, 1,092 stars, release v0.3.0 published 2026-10-07, as of 2026-10-07.

Star History Chart

This note reverses this section’s 2026-09-25 rejection of the same project, which then had 506 stars and no independent coverage; the promised re-review trigger, a second implementation, now exists in kind. The third-party local-jev-bench benchmark (2026-09-30, updated 2026-10-05) runs AnyJev against Kev, Winnow, Clef, Von, Jeff, Laya, and CLM on Apple Silicon and reports training-free AnyJev level with the trained engines on the six public transfer sources; community builds such as mesa-anyjev and a Tetris-playing AnyJev judge extend it. The HN footprint remains thin (mentions inside decision-model threads, no thread of its own), which this note records as the standing signal.

Strengths
#

  • No training: any instruction-tuned model you already serve becomes a decision engine, which removes the fine-tune cost and the frozen-weights staleness the rest of the wave accepts.
  • The corrections are principled and measured, with the rotation-averaging and prior-division effects reported across 11 of 11 models and the early-exit bound verified rather than asserted.
  • The calibration pipeline (thresholds selected and bounded on unlabelled splits) addresses the abstention question most replicas leave open.
  • Apache-2.0 code, a peer-readable technical report, and PyPI packaging make it the wave’s most reproducible-looking method entry.

Cautions
#

  • Rotation reads cost prefills: the fair cost comparison is against trained single-pass models, and the stopping-rule numbers are per-cell, not a universal 7.3.
  • Independent benchmark coverage exists (local-jev-bench) but is one hobbyist-scale suite; no lab replication yet, as of 2026-10-07.
  • The project is three weeks old, so API stability and the Tacit line’s licenses are early-grade.
  • The vendor is a telecom research lab, and the wave has already seen research artifacts go quiet after launch; the community builds are promising but 0-star so far.

Pricing
#

Free and open source under Apache-2.0; the Tacit checkpoints are published on Hugging Face, so pricing does not apply. Costs are your own model serving and the extra prefills the rotations or early-exit read.

Compared to
#

  • Jev: the closed contract that defined the category, single-pass and priced per million tokens; AnyJev is the open, bring-your-own-model alternative with prefill-based costs.
  • Kev: the strongest open trained family; choose AnyJev to avoid training entirely, Kev when a single-pass fine-tune beats multi-prefill reads on your latency budget.
  • SemIf: the other logit-readout entrant over frozen models, without AnyJev’s bias corrections or stopping rule.

Bottom line
#

Recommended for teams already serving an instruction-tuned model who need typed, calibrated decisions and cannot justify training or a specialist checkpoint, starting with the early-exit configuration and validating calibration on your own label splits. Not for single-digit-millisecond budgets, where the trained single-pass models keep the edge, and not for production trust before an independent lab replicates the paper’s bounds.

Changes
#

  • 2026-10-07 - Created.

See also
#

  • Jev - the closed contract AnyJev replicates without training
  • Kev - the trained open alternative with the strongest eval discipline
  • SemIf - the frozen-model logit readout without the bias corrections
  • Ollaya - the runtime that could serve a Tacit checkpoint beside the trained families
  • Hybrid Execution Feature Matrix - the category comparison this note joins

References
#