deck-31B (krishna765, frozen Gemma-4-31B-it, TorchAO FP8 dynamic)
Data: JevBench v1.6.1, published 2026-10-06
Capability 77.6 · rank #3 of 92 on the open-weights board
Last measured: 2026-10-05 · measurement release: v1.6.1
Licence not stated
intelligence
73.0
calibration
82.2
speed
86.7
cost
49.7
Composite (secondary)
68.7 · Composite rank #8
Cost and measurement conditions
$0.048 per 1,000 decisions (estimated)
ESTIMATE (v1.5-M2 base-model reference; self-hosted open weights, no public tariff): OpenRouter google/gemma-4-31b-it list price $0.09/M input, $0.34/M output (the exact frozen base model google/gemma-4-31B-it; same reference as Quyet-1.0-Large), read 2026-10-04 x the server's own measured usage.input_tokens; letter-mass readout, nothing generated; TorchAO FP8 dynamic on 1x GPU (Lium), deck31b 1.0.0; estimated, not charged
Measured p50 latency: 0.127 s (on-GPU, no network, loopback; not directly comparable with API latency, which we time end to end from our measuring host, network included)
Ranking and cap use: 0.40 s (est. incl. network (2x + 150 ms))
Self-hosted model: measured p50 0.127 s on-GPU, no network (timed on our GPU over loopback). Not directly comparable with API latency, which we time end to end from our measuring host, network included. The ranking and latency cap use the same estimate for every self-hosted row: 2 × measured + 150 ms = 0.40 s. Model authors can ask us to time a hosted endpoint instead (on request).
x2 + 0.15 s (assumption, not measured)
Setup not stated