Contact
Send us an environment
Tell us what the environment does, how it’s graded and when it ships. For an audit, a repo link or a short description is enough to start.
Just want to look at the work? Download the runnable public sample (zip, about 95 KB, v0.2.0, Python 3.9+, nothing to install). No form needed. It is for inspection, not a held-out evaluation set.
Got it
Got it, thanks. We’ll reply by email with a few questions about the environment and, for audits, what to send. Nothing you send is shared outside Holdout. We usually reply the same working day.
Meanwhile: how we found a write-off our own grader accepted · download the runnable sample
— Jimmy, Holdout