Welcome to Vizpy

Vizpy automatically optimizes your LLM prompts by learning from failures. One API call, dramatically better results.

import vizpy
 
result = vizpy.optimize(
    prompt="You are a helpful assistant...",
    examples=my_dataset,
    metric="accuracy",
)
 
# 73% → 91% accuracy. One API call.
print(result.optimized_prompt)

Why Vizpy?

The Problem

Prompt engineering is tedious:

Manual trial and error
Hard to systematically improve
No understanding of why prompts fail
Improvements on one case break others

The Solution

Vizpy uses contrastive learning to understand failure patterns and generate targeted improvement rules:

Run your examples through the prompt
Identify failures and successful retries
Extract rules from bad→good transitions
Validate each rule (reject rules that hurt)
Synthesize into clear, actionable instructions

The result: prompts that work better and improvements you can understand.

Key Features

One API Call

No complex setup. Pass examples, get optimized prompt.

Learns from Failures

Contrastive learning extracts rules from what went wrong.

Validates Rules

Each rule is tested. Harmful rules are rejected.

Interpretable

See exactly what rules improved your prompt.

Works with DSPy

Native integration with DSPy modules and signatures.

Production Ready

Metered billing, usage tracking, enterprise support.

Quick Example

import dspy
import vizpy
 
# Your task
class QA(dspy.Signature):
    """Answer questions accurately."""
    question: str = dspy.InputField()
    answer: str = dspy.OutputField()
 
module = dspy.Predict(QA)
 
# Your metric
def metric(example, prediction):
    correct = example["answer"].lower() in prediction.answer.lower()
    return vizpy.Score(
        value=1.0 if correct else 0.0,
        is_success=correct,
        feedback=f"Expected: {example['answer']}" if not correct else ""
    )
 
# Optimize
optimizer = vizpy.ContraPromptOptimizer(metric=metric)
optimized = optimizer.optimize(module, train_examples)
 
# Use it
result = optimized(question="What is the capital of France?")