Image JevBench v0.3.0 · individual system

Gemini 3.1 Flash Lite

Closed APIBase model: undisclosed

Published source

the operator's hosted API

Image JevBench v0.3.0 composite score

6.471

Rank #36 of 55 ranked systems.

From the published full-benchmark aggregate. The composite combines intelligence, calibration, speed and cost.

Published axes

intelligence
45.8
calibration
48.0
speed
74.4
cost
22.1

Cost and speed evidence

Cost per 1,000 decisions
USD 0.394456
Cost basis
OpenRouter usage.cost receipts
Measured latency · p50 / p95
1.608 s / 2.238 s
Adjusted latency · p50 / p95
1.608 s / 2.238 s
Latency adjustment
none (hosted API, measured as is)
Public accuracy
58.7%
Sealed accuracy
67.5%
Measurement note
Official ImageJev v0.3 A300+P300 pass 1 on 7 Oct 2026 via OpenRouter chat completions (google/gemini-3.1-flash-lite, unchanged v0.2 prompt/parser, max_tokens 384, no reasoning setting). Attempt 1 aborted on an over-limit image (public items only, not scored). 599 ok, 1 unparseable answer. Images are sent with their real MIME type; 7 BMP images were re-encoded losslessly as PNG and 5 images over the 6 MiB request limit were downscaled to 2,048 px on the long side. Provider failures (HTTP errors, timeouts, error bodies) count wrong at cost 0; unparseable answers count wrong at their billed cost. No retries.

Published 2026-10-12. Scores and ranks can change in a later release. See the method notes.