Skip to content

Commit bb57287

Browse files
christsoclaude
andcommitted
fix(ci): use GH_MODELS_TOKEN with default OpenAI target
Replace .env-only credentials with a proper .agentv/targets.yaml that sets GitHub Models as the default target via OpenAI provider. Remove Copilot CLI dependency — evals use the LLM target directly. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent 25a8abd commit bb57287

1 file changed

Lines changed: 15 additions & 12 deletions

File tree

.github/workflows/evals.yml

Lines changed: 15 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -23,16 +23,22 @@ jobs:
2323
- name: Build
2424
run: bun run build
2525

26-
- name: Install GitHub Copilot CLI
27-
run: curl -fsSL https://gh.io/copilot-install | bash
28-
29-
- name: Configure credentials
26+
- name: Configure targets
3027
run: |
31-
{
32-
echo "GITHUB_MODELS_TOKEN=${{ secrets.GITHUB_MODELS_TOKEN || secrets.GITHUB_TOKEN }}"
33-
echo "GITHUB_MODELS_MODEL=${{ vars.GITHUB_MODELS_MODEL || 'openai/gpt-5-mini' }}"
34-
echo "GITHUB_MODELS_GRADER_MODEL=${{ vars.GITHUB_MODELS_GRADER_MODEL || 'openai/gpt-5-mini' }}"
35-
} > .env
28+
mkdir -p .agentv
29+
cat > .agentv/targets.yaml <<'TARGETS'
30+
targets:
31+
- name: default
32+
provider: openai
33+
base_url: https://models.github.ai/inference
34+
api_key: ${{ GH_MODELS_TOKEN }}
35+
model: ${{ GH_MODELS_MODEL }}
36+
TARGETS
37+
38+
cat > .env <<ENV
39+
GH_MODELS_TOKEN=${{ secrets.GH_MODELS_TOKEN || secrets.GITHUB_TOKEN }}
40+
GH_MODELS_MODEL=${{ vars.GH_MODELS_MODEL || 'openai/gpt-5-mini' }}
41+
ENV
3642
3743
- name: Resolve filter and threshold
3844
id: filter
@@ -42,9 +48,6 @@ jobs:
4248
4349
- name: Run AgentV evals
4450
id: run-evals
45-
env:
46-
COPILOT_GITHUB_TOKEN: ${{ secrets.COPILOT_PAT }}
47-
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
4851
run: |
4952
mkdir -p .agentv/ci-results
5053

0 commit comments

Comments
 (0)