Decision models: one input read once, hundreds of questions answered as probabilities.
spinf turns open models into decision models. Instead of generating text, the model scores: a piece of content is read once and every question about it is answered in the same pass with a calibrated, batch-invariant probability. The checkpoints here are the ones spinf-serve, our open-source inference engine, serves: quantized and calibrated by us, with the quantization parameters travelling with the weights, so the same model gives the same score on your GPU and on the hosted API at spinf.com.
| model | based on | one card of | reads |
|---|---|---|---|
| spinf/gemma-4-12b-fp8 (default) | Gemma 4 12B, FP8 with static activation scales | 24 GB (RTX 4090 / 5090, L4, L40S, RTX 6000 Ada, H100) | text, images, audio, video frames |
| spinf/gemma-4-31b-fp8 | Gemma 4 31B, FP8 static | 48 GB (RTX 6000 Ada, L40S, RTX PRO 6000) | text, images, video frames |
| spinf/qwen3.8-27b-int4 | Qwen3.8-27B, GPTQ int4 | 24 GB | text, images, video frames |
| spinf/pplx-decider-v1-27b-int4 | pplx-decider-v1-27b, GPTQ int4: a decision model with a readout head | 24 GB | text, with its own packs |
pip install "spinf-serve[server]"
spinf-serve serve spinf/gemma-4-12b-fp8 # downloads the checkpoint on first start; an OpenAI-compatible server on port 8000
# or the image: docker run --gpus all -p 8000:8000 -v spinf-cache:/root/.cache ghcr.io/spinfinc/spinf-serve
Each model card carries its recipe and licence: Gemma 4 under Google's terms, Qwen3.8 and pplx-decider under theirs, the quantization and calibration under Apache 2.0.