Issues

• 🔒 [IBM OSPO Security Notification] — IBM/eval-assist

  security
  IBM/eval-assist#151 · Filter by author security-ops-bot opened on Sep 29, 2026
  7

• Ability to simultaneously evaluate LLM responses against multiple criteria

  IBM/eval-assist#105 · Filter by author jweisz opened on Aug 29, 2025
  3

• Synthetic generation option are not stored correctly

  Bug

  IBM/eval-assist#54 · Filter by author martinscooper opened on Jul 7, 2025
  

• Llama 3.1-70b not supported anymore on watsonx

  bug
  IBM/eval-assist#20 · Filter by author wernergeyer opened on Jun 16, 2025

• sqlite3.OperationalError: no such column: "size" - should this be a string literal in single-quotes?

  IBM/eval-assist#16 · Filter by author martinscooper opened on Jun 10, 2025

• The use of the word response and variables

  enhancement
  Feature

  IBM/eval-assist#13 · Filter by author wernergeyer opened on Jun 5, 2025
  4

• Generation of test data failed

  IBM/eval-assist#10 · Filter by author wernergeyer opened on Jun 3, 2025
  2

• All expected results are "poor"

  enhancement
  Task

  IBM/eval-assist#9 · Filter by author wernergeyer opened on Jun 3, 2025
  3

  

• Error Unitxt related to rate limit

  IBM/eval-assist#7 · Filter by author wernergeyer opened on Jun 3, 2025
  3

• 4.1 mini and Azure provider not supported?

  IBM/eval-assist#6 · Filter by author wernergeyer opened on Jun 3, 2025
  1