Skip to content

Release Notes v0.10.0

Release Date: May 2026

Highlights

  • Breaking: integrations/sevaluation package updated for structured-evaluation v0.5.0 categorical scoring API

Breaking Changes

sevaluation Package API Changes

The integrations/sevaluation package has been updated to work with structured-evaluation v0.5.0, which introduced categorical scoring (pass/partial/fail) instead of purely numeric scores.

Import changes:

Before (v0.9.0) After (v0.10.0)
CategoryScore CategoryResult
cat.Score (float64) cat.Score (ScoreValue) + cat.NumericScore (*float64)
cat.Justification cat.Reasoning
AddCategory() AddCategoryResult()
report.WeightedScore Computed from categories

Function signature changes:

// Before
func MetricScoreToCategory(score llmops.MetricScore, weight float64) evaluation.CategoryScore

// After
func MetricScoreToCategory(score llmops.MetricScore) evaluation.CategoryResult

Score conversion:

The package now converts between numeric and categorical scores:

  • Score >= 7.0 → ScorePass
  • Score >= 5.0 → ScorePartial
  • Score < 5.0 → ScoreFail

Export behavior:

When exporting to observability platforms, the package:

  • Uses NumericScore when available for feedback scores
  • Falls back to categorical-to-numeric conversion (pass=10, partial=5, fail=0)
  • Computes overall score as average of category numeric scores

Migration Guide

If you use the sevaluation integration, update your code:

// Before
cat := sevaluation.MetricScoreToCategory(score, 0.5)
fmt.Println(cat.Score)        // float64
fmt.Println(cat.Justification)

// After
cat := sevaluation.MetricScoreToCategory(score)
fmt.Println(cat.Score)         // evaluation.ScoreValue (pass/partial/fail)
fmt.Println(*cat.NumericScore) // float64 (optional)
fmt.Println(cat.Reasoning)

Changed

  • BREAKING: integrations/sevaluation updated for structured-evaluation v0.5.0 API (7293774)

Dependencies

  • github.com/plexusone/omnillm v0.15.4 (was v0.15.3) (3305fb3)
  • github.com/plexusone/omni-anthropic v0.2.1 (was v0.2.0)
  • github.com/plexusone/omni-aws v0.8.1 (was v0.8.0)
  • github.com/plexusone/omni-google v0.4.1 (was v0.4.0)
  • github.com/plexusone/omni-openai v0.2.2 (was v0.2.1)