stampr_ai is currently in v0.1.0 alpha - Features may be incomplete or subject to change
$ pip install stampr-ai --pre
Loading models...
Please wait
Status: Loading model data

Provider Tracking

Track fingerprint changes over time across different providers for each model.

Fingerprint History

Loading history data...

Please select a model

Model Cards

Track updates and changes to model and system card documentation.

Model Card History

Loading model card data...

Please select a model

Usage

Getting Started

Learn how to use stampr_ai to verify AI model identities in your applications. This guide covers installation, basic usage, and advanced features.

Installation

Install the stampr_ai package using pip:

pip install stampr-ai --pre

Basic Usage

Basic Model Verification

Verify that a model is what it claims to be:

from stampr_ai import verify_model

# Verify a model is what it claims to be
result = verify_model("gpt-4o", "OpenAI", api_key)

print(f"Model verified: {result['verified']}")
print(f"Fingerprint: {result.get('matched_hash', 'N/A')}")
print(f"Mode: {result['mode']}")

Verify Against Specific Fingerprint

Check if a model matches a specific fingerprint:

# Verify model matches a specific fingerprint hash
result = verify_model("gpt-4o:bede20", "OpenAI", api_key)

if result['verified']:
    print("Fingerprint Verified.")
else:
    print("Fingerprint mismatch!")

Latest Fingerprint Check

Verify against only the most recent fingerprint:

# Check against the most recent fingerprint only
result = verify_model("gpt-4o:latest", "OpenAI", api_key)

print(f"Latest fingerprint verified: {result['verified']}")
print(f"Fingerprint: {result.get('matched_hash')}")

Command Line Usage

You can also use stampr_ai directly from the command line:

Setup Your API Key

# Set your API key as an environment variable
export OPENAI_API_KEY=your_key_here

Command Examples

# Basic verification
stampr gpt-4o OpenAI

# Verify latest fingerprint only
stampr gpt-4o:latest OpenAI

# Verify specific fingerprint with verbose output
stampr "gpt-4o:bede20" OpenAI --verbose

Understanding Results

The verification result contains several important fields:

  • verified: Boolean indicating if the model fingerprint was verified
  • matched_hash: The fingerprint that was matched (if verification succeeded)
  • mode: The verification mode used (e.g., "latest", "specific", or "any")
  • timestamp: When the matched fingerprint was collected

About stampr_ai

What is stampr_ai?

stampr_ai is a tool for extracting and tracking AI model fingerprints in a blackbox manner. It monitors model behavior, detects changes, and ensures consistency across different providers.

The tool consists of two main components: a web-based tracker for monitoring model fingerprints over time, and a Python package for verifying model identities in your applications.

How It Works

  1. Fingerprint Generation: Our private collector generates unique fingerprints for AI models by analyzing their output patterns
  2. Public Verification: The pip package compares your models against our verified fingerprints to confirm their identity
  3. Change Detection: The website tracks and displays model changes over time, helping you stay informed about updates

Components

Web Tracker

This tracker page provides:

  • Visualization of current model fingerprints
  • Historical tracking of model changes
  • Change detection and notifications (soon!)

Python Package

The pip package allows you to:

  • Verify model identities programmatically
  • Integrate model verification into your workflows
  • Check against specific fingerprint versions
pip install stampr-ai --pre

Contact

Questions? Collaboration ideas? We'd love to hear from you.

Resources