Skip to content

Add SKILL for xunit.v3 migration#383

Closed
Youssef1313 wants to merge 2 commits intodotnet:mainfrom
Youssef1313:dev/ygerges/xunitv3-migration
Closed

Add SKILL for xunit.v3 migration#383
Youssef1313 wants to merge 2 commits intodotnet:mainfrom
Youssef1313:dev/ygerges/xunitv3-migration

Conversation

@Youssef1313
Copy link
Copy Markdown
Member

No description provided.

@Youssef1313
Copy link
Copy Markdown
Member Author

/evaluate

@Youssef1313 Youssef1313 force-pushed the dev/ygerges/xunitv3-migration branch from 5a85515 to 9fcc06e Compare March 18, 2026 09:19
@Youssef1313
Copy link
Copy Markdown
Member Author

/evaluate

@github-actions
Copy link
Copy Markdown
Contributor

Skill Validation Results

Skill Scenario Quality (Isolated) Quality (Plugin) Skills Loaded Overfit Verdict
migrate-xunit-to-xunit-v3 Migrate basic xUnit.net v2 project to v3 3.0/5 → 4.7/5 🟢 3.0/5 → 5.0/5 🟢 ✅ migrate-xunit-to-xunit-v3; tools: skill, glob, read_bash, create, web_fetch / ✅ migrate-xunit-to-xunit-v3; tools: skill, web_fetch, read_bash ✅ 0.05
migrate-xunit-to-xunit-v3 Detect incompatible target framework and stop migration 1.0/5 → 5.0/5 🟢 1.0/5 → 5.0/5 🟢 ✅ migrate-xunit-to-xunit-v3; tools: skill, glob / ✅ migrate-xunit-to-xunit-v3; tools: skill ✅ 0.05
migrate-xunit-to-xunit-v3 Convert async void test methods to async Task 5.0/5 → 4.0/5 🔴 5.0/5 → 3.7/5 ⏰ 🔴 ✅ migrate-xunit-to-xunit-v3; tools: skill, glob / ✅ migrate-xunit-to-xunit-v3; tools: skill, glob ✅ 0.05
migrate-xunit-to-xunit-v3 Convert string-based attribute constructors to typeof syntax 4.3/5 ⏰ → 3.3/5 ⏰ 🔴 4.3/5 ⏰ → 3.7/5 ⏰ 🔴 ✅ migrate-xunit-to-xunit-v3; tools: skill, create / ✅ migrate-xunit-to-xunit-v3; tools: skill, web_fetch, create ✅ 0.05
migrate-xunit-to-xunit-v3 Update custom FactAttribute to include source information parameters 2.0/5 → 5.0/5 🟢 2.0/5 → 4.3/5 ⏰ 🟢 ✅ migrate-xunit-to-xunit-v3; tools: skill, read_bash, glob, create / ✅ migrate-xunit-to-xunit-v3; tools: skill, web_fetch ✅ 0.05
migrate-xunit-to-xunit-v3 Update BeforeAfterTestAttribute overrides with IXunitTest parameter 5.0/5 → 5.0/5 5.0/5 → 4.3/5 ⏰ 🔴 ✅ migrate-xunit-to-xunit-v3; tools: skill, glob, create / ✅ migrate-xunit-to-xunit-v3; tools: skill ✅ 0.05
migrate-xunit-to-xunit-v3 Migrate project with YTest.MTP.XUnit2 to xUnit.net v3 preserving MTP 3.0/5 → 5.0/5 🟢 3.0/5 → 5.0/5 🟢 ✅ migrate-xunit-to-xunit-v3; tools: skill / ✅ migrate-xunit-to-xunit-v3; tools: skill ✅ 0.05
migrate-xunit-to-xunit-v3 Migrate Xunit.SkippableFact to xUnit.net v3 built-in skip APIs 5.0/5 → 5.0/5 5.0/5 → 5.0/5 ✅ migrate-xunit-to-xunit-v3; tools: skill, web_fetch, glob / ✅ migrate-xunit-to-xunit-v3; tools: skill ✅ 0.05 [1]
migrate-xunit-to-xunit-v3 Migrate xUnit v2 packages managed via Central Package Management 4.3/5 → 5.0/5 🟢 4.3/5 → 4.7/5 🟢 ✅ migrate-xunit-to-xunit-v3; tools: skill, web_fetch, create / ✅ migrate-xunit-to-xunit-v3; tools: skill, create ✅ 0.05
migrate-xunit-to-xunit-v3 Recognize project already on xUnit.net v3 — no migration needed 1.7/5 → 3.3/5 🟢 1.7/5 → 4.3/5 🟢 ✅ migrate-xunit-to-xunit-v3; tools: skill, glob / ✅ migrate-xunit-to-xunit-v3; tools: skill ✅ 0.05
migrate-xunit-to-xunit-v3 Consolidate xunit.extensibility packages and remove xunit.abstractions 4.0/5 → 4.3/5 🟢 4.0/5 → 3.3/5 🔴 ✅ migrate-xunit-to-xunit-v3; tools: skill, glob, web_fetch / ✅ migrate-xunit-to-xunit-v3; tools: skill, web_fetch ✅ 0.05
migrate-xunit-to-xunit-v3 Update Xunit.Combinatorial and Xunit.StaFact companion packages 4.7/5 → 5.0/5 🟢 4.7/5 → 5.0/5 🟢 ✅ migrate-xunit-to-xunit-v3; tools: skill, glob, web_fetch, create / ✅ migrate-xunit-to-xunit-v3; tools: skill, glob, web_fetch ✅ 0.05

[1] (Isolated) Quality unchanged but weighted score is -8.7% due to: tokens (145558 → 364668), tool calls (13 → 27), time (164.1s → 243.8s)

timeout — run hit the scenario timeout limit; scoring may be impacted by aborting model execution before it could produce its full output

Model: claude-opus-4.6 | Judge: claude-opus-4.6

Full results

@Youssef1313 Youssef1313 force-pushed the dev/ygerges/xunitv3-migration branch from 9fcc06e to 4c91054 Compare March 26, 2026 12:59
@Youssef1313
Copy link
Copy Markdown
Member Author

@copilot Can you update eval.yaml to use the new run_command_and_assert assertion? You should assert that running dotnet test works.

@Youssef1313 Youssef1313 deleted the dev/ygerges/xunitv3-migration branch March 31, 2026 11:21
@Youssef1313
Copy link
Copy Markdown
Member Author

Created new PR, 484.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant