Seb Labs journal

Notes on decisions.

Research, benchmarks, and engineering notes on building systems that know when to choose.

2 publicationsOpen weights · API · MCP

Every note pairs reported accuracy and latency numbers with exact hardware, evaluation scope, and where the model falls short.

Featured researchNote 01 · October 22, 2026

A 9B decision model that scores every option in a single forward pass. Runs locally in 22 ms on one GPU or 88 ms on an Apple M5 Max, and answers 51% of requests in front of Claude Opus at Opus-level combined accuracy.

  • 0.801Mean accuracy over 17 public suites (ahead of v1 at 0.792 and hosted Jev 1.13 at 0.786).
  • 0.855Combined accuracy as a confidence-thresholded first tier in front of Claude Opus, at 51% lower estimated cost.
  • 32kContext window for text, structured state, and images under Apache-2.0 open weights.
Read research note
Agents · API & MCPNote 02 · October 26, 2026

Typed decisions for agents over API and MCP.

An agent often needs a bounded judgment before its next action: which workflow fits a request, whether a passage supports a claim, or how an item scores under a rubric.

choiceLabel distribution

Route tickets, tools, and workflows across your options.

yes / noProposition check

Screen evidence support and relevance against a rule.

scoreOrdinal rubric

Compute expected score and level probabilities.

Read engineering note
POST /v1/systemone · choiceIllustrative distribution
state

“The parcel arrived damaged. Please replace it.”

instructions

Choose the team to handle this request.

returns · Damaged products and replacements0.9642
billing · Payments and invoices0.0241
escalate · Unclear or outside these teams0.0117
Σ pᵢ = 1.0000 · argmax: returns0 generated tokens
Threshold policy

p(returns) ≥ 0.90 → route directly to returns queue; otherwise escalate for review.

Hosted NVFP4 · API & remote MCP$0.021 / M input tokens · output free
Journal index

All notes, in order.

Chronological archive of Seb Labs releases, benchmark methodology, and agent integration notes.