Skip to content

Conversation

@steven10a
Copy link
Collaborator

  • Removed nano from the benchmark results
  • Updated graphs to not include nano models
  • Removed from any examples or code snippets in the docs

CopilotAI review requested due to automatic review settings November 4, 2025 16:29
Copy link

CopilotAI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR removes references to deprecated "nano" model variants (gpt-4.1-nano and gpt-5-nano) throughout the codebase, replacing them with "mini" variants where appropriate. This appears to be a cleanup effort to deprecate support for these model versions.

  • Removed gpt-4.1-nano and gpt-5-nano from the default benchmark models list
  • Updated all example code and tests to use gpt-4.1-mini instead of gpt-4.1-nano
  • Cleaned up documentation tables to remove nano model benchmark results

Reviewed Changes

Copilot reviewed 19 out of 23 changed files in this pull request and generated no comments.

Show a summary per file
FileDescription
src/guardrails/evals/guardrail_evals.pyRemoved nano variants from DEFAULT_BENCHMARK_MODELS list and updated help text
src/guardrails/evals/README.mdRemoved gpt-5-nano from example commands
src/guardrails/checks/text/jailbreak.pyUpdated documentation example to use gpt-4.1-mini instead of gpt-4.1-nano
tests/integration/test_suite.pyReplaced all gpt-4.1-nano references with gpt-4.1-mini in test configurations
examples/implementation_code/streaming/*.pyUpdated streaming examples to use gpt-4.1-mini
examples/implementation_code/blocking/*.pyUpdated blocking examples to use gpt-4.1-mini
examples/basic/*.pyUpdated all basic examples to use gpt-4.1-mini
docs/ref/checks/*.mdRemoved nano model entries from performance benchmark tables and updated formatting
docs/evals.mdRemoved gpt-5-nano from example command

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copy link
Collaborator

@gabor-openaigabor-openai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TY!

@gabor-openaigabor-openai merged commit 0a65199 into mainNov 4, 2025
9 checks passed
@gabor-openaigabor-openai deleted the dev/steven/remove_nano branch November 4, 2025 18:47
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@steven10a@gabor-openai