HaluEval · public · hallucination
0.9213
Best artifact AUROC0.9180
Final summary (step 3000)0.9213
G-1 is a non-invasive runtime that wraps your model with vLLM and lifts it to the safety bar of frontier closed models. Constitutional Intelligence aligned to European values. Full EU AI Act compliance with reports generated automatically. Days, not quarters, to production.
Three risks block every regulated AI rollout — and none of them are solved by training another model.
Mid-sized open models confidently fabricate citations, statistics, and clinical advice. In agentic pipelines a single hallucination cascades into irreversible action — and you have no idea which token caused it.
An open 8B model is not a frontier closed model. The frontier safety stack — refusals, jailbreak resilience, prompt-injection containment — is not in the weights. It has to be added at the runtime layer.
Article 27 FRIA. Article 12 audit logging. Article 50 disclosure. Article 14 human oversight. Fines up to 3% of global turnover. Generic LLM observability tools do not produce the documents a regulator asks for.
G-1 mounts on top of your existing open LLM — including fine-tuned checkpoints — via vLLM. Every prompt is intercepted before generation. Every response is scored before delivery. Every inference is signed, logged, and made auditable.
In a standard LLM deployment, a hallucinated response reaches one user. In an agentic AI system — where models orchestrate tools, databases, and other models — that same error becomes the next agent's trusted input.
By the time the error reaches a real-world action — a clinical recommendation, a financial execution, a legal document — it has been re-confirmed multiple times and is irreversible.
Geodesia G-1 mounted on Gemma 4 E2B — a model two orders of magnitude smaller than the closed frontier — matches and beats most frontier models on truthfulness and safety. Tested on HaluEval for hallucination resistance and on our adversarial-safety test set (validation in progress).
Numbers from the most recent training run on Gemma 4 E2B (~2B parameters). HaluEval is the public reference suite for hallucination; Phase 2b is our internal safety evaluation.
| Capability | Geodesia G-1 | Cloud AI API | Raw Open LLM | In-House Build |
|---|---|---|---|---|
| Frontier-grade safety on open models | ✓ | ✓ | ✗ | ~ |
| Data stays on-premise | ✓ | ✗ | ✓ | ✓ |
| Real-time hallucination scoring | ✓ | ✗ | ✗ | ~ |
| European Constitutional AI | ✓ | ✗ | ✗ | ✗ |
| Auto-generated EU AI Act reports | ✓ | ✗ | ✗ | ~ |
| Air-gap capable | ✓ | ✗ | ✓ | ✓ |
| Cryptographic audit chain | ✓ | ✗ | ✗ | ~ |
| Agentic pipeline forensics | ✓ | ~ | ✗ | ~ |
| Time to production | Days | Immediate | Weeks | 12–24 months |