Skip to main content

Matrix Strategy

Run multiple skills in parallel using GitHub Actions matrix.

name: Skill Eval
on:
pull_request:
paths:
- 'skills/**'

permissions:
contents: read
pull-requests: write

jobs:
eval:
runs-on: ubuntu-latest
timeout-minutes: 30
strategy:
fail-fast: false
matrix:
skill:
- tf-guide
- k8s-operator-sdk
- secure-gh-workflow
- generate-dockerfile
steps:
- uses: actions/checkout@v6

- uses: skill-bench/skill-eval-action@v1
with:
skill-name: ${{ matrix.skill }}
skill-path: skills/${{ matrix.skill }}
anthropic-api-key: ${{ secrets.ANTHROPIC_API_KEY }}
pass-threshold: '80'

Each skill gets its own job, running in parallel. GitHub supports up to 256 matrix entries per workflow.

Set fail-fast: false so one skill's failure doesn't cancel the others.