All runs

Every published run, newest first: 51 runs over 33 subjects. Partial runs are listed and never ranked.

DateSubjectSuiteHardwareHeadline
2026-10-09gev-26b-decidegguf-iq4_xs-mradermacher·llamacpp-cuda-b11515 decision-conformance · coreNVIDIA P100 · 16 GB49/49 checksView →
2026-10-09gev-26b-decidegguf-iq4_xs-mradermacher·llamacpp-cuda-b11515 typed-decisions · coreNVIDIA P100 · 16 GB71.2% accuracyView →
2026-10-09jev-27b-vlgguf-q3_k_m-iammrduncan·llamacpp-cuda-b11370-jev decision-conformance · coreNVIDIA P100 · 16 GB49/49 checksView →
2026-10-09jev-27b-vlgguf-q3_k_m-iammrduncan·llamacpp-cuda-b11370-jev typed-decisions · coreNVIDIA P100 · 16 GB69.7% accuracyView →
2026-10-09clefgguf-q3_k_m-bartowski·llamacpp-cuda-b11515 decision-conformance · coreNVIDIA P100 · 16 GB46/49 checksView →
2026-10-09clefgguf-q3_k_m-bartowski·llamacpp-cuda-b11515 typed-decisions · coreNVIDIA P100 · 16 GB71.3% accuracyView →
2026-10-09embeddinggemma-300mbf16-google·sentence-transformers-torch-mps-st6.1.0-torch2.14.1 embeddings · quickApple M4 Pro · 24 GB68.80 −0.01 losslessView →
2026-10-09embeddinggemma-300mfp32-google·sentence-transformers-torch-mps-st6.1.0-torch2.14.1 embeddings · quickApple M4 Pro · 24 GB68.81 +0.00 losslessView →
2026-10-09lfm2.5-embedding-350mbf16-liquidai·sentence-transformers-torch-mps-st5.1.1-tf4.56.2-torch2.14.1 embeddings · quickApple M4 Pro · 24 GB66.07 +0.02 losslessView →
2026-10-09lfm2.5-embedding-350mfp32-liquidai·sentence-transformers-torch-mps-st5.1.1-tf4.56.2-torch2.14.1 embeddings · quickApple M4 Pro · 24 GB66.06 +0.00 losslessView →
2026-10-08embeddinggemma-300mfp32-google·sentence-transformers-torch-cuda-st6.1.0-torch2.14.1-cu126 embeddings · quickNVIDIA P100 · 16 GB68.81 reference View →
2026-10-08d1-3bfp16-liquidai·decide-server-d1-torch-cuda-tf5.19.0-torch2.14.1-cu126 decision-conformance · coreNVIDIA P100 · 16 GB49/49 checksView →
2026-10-08d1-3bfp16-liquidai·decide-server-d1-torch-cuda-tf5.19.0-torch2.14.1-cu126 typed-decisions · coreNVIDIA P100 · 16 GB64.8% accuracyView →
2026-10-08d1-3bfp32-liquidai·decide-server-d1-torch-cuda-tf5.19.0-torch2.14.1-cu126 decision-conformance · coreNVIDIA P100 · 16 GB49/49 checksView →
2026-10-08d1-3bfp32-liquidai·decide-server-d1-torch-cuda-tf5.19.0-torch2.14.1-cu126 typed-decisions · coreNVIDIA P100 · 16 GB64.8% accuracyView →
2026-10-08d1-omni-600mfp16-liquidai·decide-server-d1-torch-cuda-tf5.19.0-torch2.14.1-cu126 decision-conformance · coreNVIDIA P100 · 16 GB48/49 checksView →
2026-10-08d1-omni-600mfp16-liquidai·decide-server-d1-torch-cuda-tf5.19.0-torch2.14.1-cu126 typed-decisions · coreNVIDIA P100 · 16 GB57.4% accuracyView →
2026-10-08d1-omni-600mfp32-liquidai·decide-server-d1-torch-cuda-tf5.19.0-torch2.14.1-cu126 decision-conformance · coreNVIDIA P100 · 16 GB48/49 checksView →
2026-10-08d1-omni-600mfp32-liquidai·decide-server-d1-torch-cuda-tf5.19.0-torch2.14.1-cu126 typed-decisions · coreNVIDIA P100 · 16 GB57.4% accuracyView →
2026-10-08layaauto-amp-convai·decide-server-laya-torch-cuda-tf5.19.0-torch2.14.1-cu126 decision-conformance · coreNVIDIA P100 · 16 GB49/49 checksView →
2026-10-08layaauto-amp-convai·decide-server-laya-torch-cuda-tf5.19.0-torch2.14.1-cu126 typed-decisions · coreNVIDIA P100 · 16 GB36.0% accuracyView →
2026-10-08clef-flashbnb-nf4-iammrduncan·decide-server-clef-torch-cuda-tf5.19.0-torch2.14.1-cu126 decision-conformance · coreNVIDIA P100 · 16 GB46/49 checksView →
2026-10-08clef-flashbnb-nf4-iammrduncan·decide-server-clef-torch-cuda-tf5.19.0-torch2.14.1-cu126 typed-decisions · coreNVIDIA P100 · 16 GB70.2% accuracyView →
2026-10-08clef-flashmlx-q8-mlx-community·clef-mlx-mlx0.32.3-mlxvlm0.7.4 decision-conformance · coreApple M4 Pro · 24 GB47/49 checksView →
2026-10-08lfm2.5-embedding-350mfp32-liquidai·sentence-transformers-torch-cuda-st5.1.1-tf4.56.2-torch2.14.1-cu126 embeddings · quickNVIDIA P100 · 16 GB66.06 reference View →
2026-10-08clef-flashmlx-q8-mlx-community·clef-mlx-mlx0.32.3-mlxvlm0.7.4 harness had local changestyped-decisions · coreApple M4 Pro · 24 GB70.5% accuracyView →
2026-10-08layafp32-convai·decide-server-laya-torch-cuda-tf5.19.0-torch2.14.1-cu126 decision-conformance · coreNVIDIA P100 · 16 GB49/49 checksView →
2026-10-08layafp32-convai·decide-server-laya-torch-cuda-tf5.19.0-torch2.14.1-cu126 typed-decisions · coreNVIDIA P100 · 16 GB35.9% accuracyView →
2026-10-08d1-3bfp32-liquidai·decide-server-d1-torch-mps-tf5.19.0-torch2.14.1 decision-conformance · coreApple M4 Pro · 24 GB49/49 checksView →
2026-10-08d1-3bfp32-liquidai·decide-server-d1-torch-mps-tf5.19.0-torch2.14.1 typed-decisions · coreApple M4 Pro · 24 GB64.8% accuracyView →
2026-10-08d1-3bbf16-liquidai·decide-server-d1-torch-mps-tf5.19.0-torch2.14.1 decision-conformance · coreApple M4 Pro · 24 GB49/49 checksView →
2026-10-08d1-3bbf16-liquidai·decide-server-d1-torch-mps-tf5.19.0-torch2.14.1 typed-decisions · coreApple M4 Pro · 24 GB64.9% accuracyView →
2026-10-08d1-omni-600mfp16-liquidai·decide-server-d1-torch-mps-tf5.19.0-torch2.14.1 decision-conformance · coreApple M4 Pro · 24 GB48/49 checksView →
2026-10-08d1-omni-600mfp16-liquidai·decide-server-d1-torch-mps-tf5.19.0-torch2.14.1 typed-decisions · coreApple M4 Pro · 24 GB57.4% accuracyView →
2026-10-08d1-omni-600mfp32-liquidai·decide-server-d1-torch-mps-tf5.19.0-torch2.14.1 decision-conformance · coreApple M4 Pro · 24 GB48/49 checksView →
2026-10-08d1-omni-600mfp32-liquidai·decide-server-d1-torch-mps-tf5.19.0-torch2.14.1 typed-decisions · coreApple M4 Pro · 24 GB57.4% accuracyView →
2026-10-08layafp32-convai·decide-server-laya-torch-mps-tf5.19.0-torch2.14.1 decision-conformance · coreApple M4 Pro · 24 GB49/49 checksView →
2026-10-08layafp32-convai·decide-server-laya-torch-mps-tf5.19.0-torch2.14.1 typed-decisions · coreApple M4 Pro · 24 GB35.9% accuracyView →
2026-10-07embeddinggemma-2q4-onnx-community·onnxruntime-cpu-ort1.30.0 embeddings · quickApple M4 Pro · 24 GB66.19 −0.71 degradedView →
2026-10-07embeddinggemma-2q8-onnx-community·onnxruntime-cpu-ort1.30.0 embeddings · quickApple M4 Pro · 24 GB66.80 −0.10 faithfulView →
2026-10-07embeddinggemma-2fp32-onnx-community·onnxruntime-cpu-ort1.30.0 embeddings · quickApple M4 Pro · 24 GB66.90 +0.00 losslessView →
2026-10-07embeddinggemma-2q4-onnx-community·onnxruntime-cuda-ort1.29.0-cuda12 embeddings · quickNVIDIA P100 · 16 GB66.19 −0.71 degradedView →
2026-10-07embeddinggemma-2bf16-google·sentence-transformers-torch-mps-st6.1.0-torch2.14.1 embeddings · quickApple M4 Pro · 24 GB66.93 +0.03 faithfulView →
2026-10-07embeddinggemma-2q8-onnx-community·onnxruntime-cuda-ort1.29.0-cuda12 embeddings · quickNVIDIA P100 · 16 GB66.80 −0.10 faithfulView →
2026-10-07embeddinggemma-2fp32-onnx-community·onnxruntime-cuda-ort1.29.0-cuda12 embeddings · quickNVIDIA P100 · 16 GB66.90 +0.00 losslessView →
2026-10-07embeddinggemma-2fp32-google·sentence-transformers-torch-mps-st6.1.0-torch2.14.1 harness had local changesembeddings · quickApple M4 Pro · 24 GB66.90 +0.00 losslessView →
2026-10-07embeddinggemma-2fp32-google·sentence-transformers-torch-cuda-st6.1.0-torch2.14.1-cu126 harness had local changesembeddings · quickNVIDIA P100 · 16 GB66.90 reference View →
2026-10-06qwen-3.8-27bopaque·cerebras provider-opaqueharness had local changestyped-decisions · quickprovider-hosted72.2% accuracyView →
2026-10-06jev-latestopaque·typesafe provider-opaqueharness had local changestyped-decisions · coreprovider-hosted73.8% accuracyView →
2026-10-06jev-latestopaque·typesafe provider-opaqueharness had local changestyped-decisions · quickprovider-hosted74.8% accuracyView →
2026-10-06jev-latestopaque·typesafe provider-opaqueharness had local changesdecision-conformance · quickprovider-hosted48/49 checksView →