spinf

Decision models: one input read once, hundreds of questions answered as probabilities.

spinf turns open models into decision models. Instead of generating text, the model scores: a piece of content is read once and every question about it is answered in the same pass with a calibrated, batch-invariant probability. The checkpoints here are the ones spinf-serve, our open-source inference engine, serves: quantized and calibrated by us, with the quantization parameters travelling with the weights, so the same model gives the same score on your GPU and on the hosted API at spinf.com.

model based on one card of reads
spinf/gemma-4-12b-fp8 (default) Gemma 4 12B, FP8 with static activation scales 24 GB (RTX 4090 / 5090, L4, L40S, RTX 6000 Ada, H100) text, images, audio, video frames
spinf/gemma-4-31b-fp8 Gemma 4 31B, FP8 static 48 GB (RTX 6000 Ada, L40S, RTX PRO 6000) text, images, video frames
spinf/qwen3.8-27b-int4 Qwen3.8-27B, GPTQ int4 24 GB text, images, video frames
spinf/pplx-decider-v1-27b-int4 pplx-decider-v1-27b, GPTQ int4: a decision model with a readout head 24 GB text, with its own packs
pip install "spinf-serve[server]"
spinf-serve serve spinf/gemma-4-12b-fp8     # downloads the checkpoint on first start; an OpenAI-compatible server on port 8000
# or the image: docker run --gpus all -p 8000:8000 -v spinf-cache:/root/.cache ghcr.io/spinfinc/spinf-serve

Each model card carries its recipe and licence: Gemma 4 under Google's terms, Qwen3.8 and pplx-decider under theirs, the quantization and calibration under Apache 2.0.