chore(multi-turn): remove checkTokenProgression from multi-turn LLM test and update README

[constantinius]

Closes #101

[cursor]

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Bugbot Autofix prepared a fix for the issue found in the latest run.

• ✅ Fixed: Unused imports left after removing checkTokenProgression
  • I removed the now-unused imports from multi-turn.ts and confirmed the project still builds successfully.

Or push these changes by commenting:

@cursor push ea4e951dca

Preview (ea4e951dca)

diff --git a/src/test-cases/llm/multi-turn.ts b/src/test-cases/llm/multi-turn.ts
--- a/src/test-cases/llm/multi-turn.ts
+++ b/src/test-cases/llm/multi-turn.ts
@@ -5,7 +5,7 @@
  * Validates that Sentry captures multiple gen_ai spans correctly.
  */
 
-import { TestDefinition, Check, ErrorLocation } from "../../types.js";
+import { TestDefinition } from "../../types.js";
 import {
   checkAISpanCount,
   checkChatSpanAttributes,
@@ -15,10 +15,7 @@
   checkInputMessagesSchema,
   checkResponseModel,
 } from "../checks.js";
-import { extractGenAISpans, skipIf } from "../utils.js";
-import { CheckError } from "../../validator.js";
 
-
 export const multiTurnLLMTest: TestDefinition = {
   name: "Multi-Turn LLM Test",
   description: "Multi-turn conversation with back-and-forth exchanges",
@@ -61,15 +58,9 @@
     },
   ],
 
-  criticalChecks: [
-    checkAISpanCount(3),
-    checkChatSpanAttributes,
-  ],
+  criticalChecks: [checkAISpanCount(3), checkChatSpanAttributes],
 
-  checks: [
-    checkValidTokenUsage,
-    checkInputMessagesSchema,
-  ],
+  checks: [checkValidTokenUsage, checkInputMessagesSchema],
 
   warningChecks: [
     checkResponseModel,

_{This Bugbot Autofix run was free. To enable autofix for future PRs, go to the Cursor dashboard.}

[cursor]

Unused imports left after removing checkTokenProgression

Low Severity

After removing checkTokenProgression, the imports Check, ErrorLocation (from ../../types.js), extractGenAISpans, skipIf (from ../utils.js), and CheckError (from ../../validator.js) are no longer used anywhere in the file. These are leftover artifacts of the deleted function.

Additional Locations (2)

• src/test-cases/llm/multi-turn.ts#L17-L18
• src/test-cases/llm/multi-turn.ts#L18-L19

 

[github-actions]

🔴 AI SDK Integration Test Results

Status: 2 regressions detected

Summary

Metric	main	PR	Change
Total Tests	576	576	—
Passed	400	402	+2 ✅
Failed	148	146	-2 ✅

🔴 Regressions

These tests were passing on main but are now failing:

browser/openai :: Multi-Turn LLM Test (blocking)

Error: Browser test timed out (60s)

Browser test timed out (60s)

cloudflare/google-genai :: Vision LLM Test (blocking)

Error: 3 check(s) failed:

3 check(s) failed:
Should have at least one chat/completion span
Should have at least one chat or agent span
Should have at least one chat or agent span

✅ Fixed

These tests were failing on main but are now passing:

• python/google-genai :: Multi-Turn LLM Test (sync, streaming)
• python/google-genai :: Multi-Turn LLM Test (sync, blocking)
• python/google-genai :: Multi-Turn LLM Test (async, streaming)
• python/google-genai :: Multi-Turn LLM Test (async, blocking)

Test Matrix

Agent Tests

SDK	Basic Agent Test	Conversation ID Agent Test	Long Input Agent Test	Tool Call Agent Test	Tool Error Agent Test	Vision Agent Test
browser/langgraph	❌blk, combined ❌blk, compiled ❌blk, custom-state ❌blk, graph ❌blk, langchain ❌str, combined ❌str, compiled ❌str, custom-state ❌str, graph ❌str, langchain	❌blk, combined ❌blk, compiled ❌blk, custom-state ❌blk, graph ❌blk, langchain ❌str, combined ❌str, compiled ❌str, custom-state ❌str, graph ❌str, langchain	❌blk, combined ❌blk, compiled ❌blk, custom-state ❌blk, graph ❌blk, langchain ❌str, combined ❌str, compiled ❌str, custom-state ❌str, graph ❌str, langchain	❌blk, combined ❌blk, compiled ❌blk, custom-state ❌blk, graph ❌blk, langchain ❌str, combined ❌str, compiled ❌str, custom-state ❌str, graph ❌str, langchain	❌blk, combined ❌blk, compiled ❌blk, custom-state ❌blk, graph ❌blk, langchain ❌str, combined ❌str, compiled ❌str, custom-state ❌str, graph ❌str, langchain	❌blk, combined ❌blk, compiled ❌blk, custom-state ❌blk, graph ❌blk, langchain ❌str, combined ❌str, compiled ❌str, custom-state ❌str, graph ❌str, langchain
cloudflare/langgraph	❌	❌	❌	❌	❌	❌
cloudflare/vercel	✅	❌	❌	✅	❌	✅
nextjs/mastra	✅	❌	—	✅	✅	✅
nextjs/vercel	✅blk ✅str	❌blk ❌str	❌blk ❌str	✅blk ✅str	✅blk ✅str	✅blk ✅str
node/langgraph	❌	❌	❌	❌	❌	❌
node/manual	✅	✅	✅	✅	✅	✅
node/mastra	✅	❌	❌	❌	❌	❌
node/vercel	✅	❌	❌	✅	✅	✅
php/laravel	❌blk ❌str	❌blk ❌str	❌blk ❌str	❌blk ❌str	❌blk ❌str	❌blk ❌str
python/langgraph	❌a ❌s	❌a ❌s	❌a ❌s	❌a ❌s	❌a ❌s	❌a ❌s
python/manual	✅a ✅s	✅a ✅s	✅a ✅s	✅a ✅s	✅a ✅s	✅a ✅s
python/openai-agents	✅	✅	✅	✅	✅	❌
python/pydantic-ai	✅a, fallback ✅a, single	✅a, fallback ✅a, single	✅a, fallback ✅a, single	✅a, fallback ✅a, single	✅a, fallback ✅a, single	✅a, fallback ✅a, single

Embedding Tests

SDK	Basic Embeddings Test
browser/google-genai	❌
browser/langchain	❌
browser/openai	✅
cloudflare/google-genai	❌
cloudflare/langchain	❌
cloudflare/openai	✅
cloudflare/vercel	✅
nextjs/google-genai	❌
nextjs/langchain	❌
nextjs/openai	✅
nextjs/vercel	✅
node/google-genai	❌
node/langchain	❌
node/openai	✅
node/vercel	✅
php/laravel	❌
python/google-genai	✅a, blk ✅s, blk
python/langchain	❌a, blk ❌s, blk
python/litellm	❌a, blk ✅s, blk
python/manual	✅a, blk ✅s, blk
python/openai	✅a, blk ✅s, blk

LLM Tests

SDK	Basic Error LLM Test	Basic LLM Test	Conversation ID LLM Test	Long Input LLM Test	Multi-Turn LLM Test	Vision LLM Test
browser/anthropic	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
browser/google-genai	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
browser/langchain	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
browser/openai	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	❌📉blk ✅str	✅blk ✅str
cloudflare/anthropic	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
cloudflare/google-genai	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	❌📉blk ✅str
cloudflare/langchain	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
cloudflare/openai	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
nextjs/anthropic	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
nextjs/google-genai	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
nextjs/langchain	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
nextjs/openai	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
node/anthropic	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
node/google-genai	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
node/langchain	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
node/manual	—	✅	✅	✅	✅	✅
node/openai	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str	✅blk ✅str
python/anthropic	✅a, blk ❌a, str ✅s, blk ❌s, str	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str
python/cohere	❌s, blk, v1 ❌s, blk, v2 ❌s, str, v1 ❌s, str, v2	❌s, blk, v1 ❌s, blk, v2 ❌s, str, v1 ❌s, str, v2	❌s, blk, v1 ❌s, blk, v2 ❌s, str, v1 ❌s, str, v2	—	❌s, blk, v1 ❌s, blk, v2 ❌s, str, v1 ❌s, str, v2	—
python/google-genai	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str	✅🔧a, blk ✅🔧a, str ✅🔧s, blk ✅🔧s, str	❌a, blk ❌a, str ❌s, blk ❌s, str
python/langchain	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ✅a, str ✅s, blk ✅s, str
python/litellm	❌a, blk ❌a, str ❌s, blk ❌s, str	❌a, blk ❌a, str ✅s, blk ✅s, str	❌a, blk ❌a, str ✅s, blk ✅s, str	❌a, blk ❌a, str ✅s, blk ✅s, str	❌a, blk ❌a, str ✅s, blk ✅s, str	❌a, blk ❌a, str ✅s, blk ✅s, str
python/manual	—	✅a, blk ✅s, blk	✅a, blk ✅s, blk	✅a, blk ✅s, blk	✅a, blk ✅s, blk	✅a, blk ✅s, blk
python/openai	✅a, blk ✅a, str ✅s, blk ✅s, str	✅a, blk ❌a, str ✅s, blk ❌s, str	✅a, blk ❌a, str ✅s, blk ❌s, str	✅a, blk ❌a, str ✅s, blk ❌s, str	✅a, blk ❌a, str ✅s, blk ❌s, str	❌a, blk ❌a, str ❌s, blk ❌s, str

MCP Tests

SDK	Basic MCP Tool Call Test	MCP Multiple Tool Calls Test	MCP Prompt Get Test	MCP Resource Read Test	MCP Tool Error Test
node/mcp	✅sse ✅io	✅sse ✅io	✅sse ✅io	✅sse ✅io	✅sse ✅io
python/fastmcp	✅a, blk, sse ✅a, blk, io	✅a, blk, sse ✅a, blk, io	✅a, blk, sse ✅a, blk, io	✅a, blk, sse ✅a, blk, io	✅a, blk, sse ✅a, blk, io
python/mcp	✅a, blk, sse, hi ✅a, blk, sse, lo ✅a, blk, io, hi ✅a, blk, io, lo	✅a, blk, sse, hi ✅a, blk, sse, lo ✅a, blk, io, hi ✅a, blk, io, lo	✅a, blk, sse, hi ✅a, blk, sse, lo ✅a, blk, io, hi ✅a, blk, io, lo	✅a, blk, sse, hi ✅a, blk, sse, lo ✅a, blk, io, hi ✅a, blk, io, lo	✅a, blk, sse, hi ✅a, blk, sse, lo ✅a, blk, io, hi ✅a, blk, io, lo

Legend: ✅ Pass | ❌ Fail | ✅🔧 Fixed | ❌📉 Regressed | ✅🆕 New (pass) | ❌🆕 New (fail) | 🗑️ Removed | _str=streaming _blk=blocking _a=async _s=sync _io=stdio _sse=sse _hi=highlevel _lo=lowlevel

---

Generated by AI SDK Integration Tests