Ollama - Bespoke Labs

Ollama has the model as bespoke-minicheck. The download is 4.7 GB, and the context window is 32K tokens. For background, see the Ollama blog post. Ollama returns “Yes” or “No” and does not return a support probability.

Download the model

ollama pull bespoke-minicheck

Check a claim

Send the document and the claim in this format:

Document: {document}
Claim: {claim}

This example uses the ollama Python package:

from ollama import chat

document = "A group of students gather in the school library to study for their upcoming final exams."
claim = "The students are preparing for an examination."

response = chat(
    model="bespoke-minicheck",
    messages=[{"role": "user", "content": f"Document: {document}\nClaim: {claim}"}],
)
print(response.message.content)  # Yes

Check one sentence at a time. Split a longer claim into sentences first.