Commit e131e19
authored
Add skill trigger eval harness and improve skill descriptions (#275)
* skill update
* Add skill trigger eval harness, improve skill descriptions, and add trigger evals
- Add eval harness (skills/eval/) based on skill-creator: run_eval.py for
multi-skill evaluation, run_loop.py for iterative description optimization,
and eval_lib.py with shared utilities including HTML report generation
- Add trigger evals (5 queries each) for all 37 skills in ./skills
- Improve skill descriptions for better trigger accuracy (b2c-localization,
b2c-metadata, b2c-forms, b2c-slas-auth-patterns, b2c-content, b2c-ecdn,
b2c-sites, testing)
- Extract long skill sections to references/ (eCDN security/advanced,
SLAS passkeys, testing command patterns)
- Create b2c-am skill for Account Manager topic
- Add skills:eval and skills:eval:optimize package.json scripts1 parent 5a6ab56 commit e131e19
58 files changed
Lines changed: 2388 additions & 1119 deletions
File tree
- .claude
- skills
- skill-authoring
- references
- testing
- references
- skills
- b2c-cli/skills
- b2c-am
- evals
- b2c-cip/evals
- b2c-code/evals
- b2c-config/evals
- b2c-content
- evals
- b2c-docs/evals
- b2c-ecdn
- evals
- references
- b2c-job/evals
- b2c-logs/evals
- b2c-mrt/evals
- b2c-sandbox/evals
- b2c-scapi-custom/evals
- b2c-scapi-schemas/evals
- b2c-site-import-export/evals
- b2c-sites
- evals
- b2c-slas/evals
- b2c-webdav/evals
- b2c-experimental/skills/b2c-scaffold/evals
- b2c/skills
- b2c-business-manager-extensions/evals
- b2c-controllers/evals
- b2c-custom-api-development/evals
- b2c-custom-caches/evals
- b2c-custom-job-steps/evals
- b2c-custom-objects/evals
- b2c-forms
- evals
- b2c-hooks/evals
- b2c-isml/evals
- b2c-localization
- evals
- b2c-logging/evals
- b2c-metadata
- evals
- b2c-ordering/evals
- b2c-page-designer/evals
- b2c-querying-data/evals
- b2c-scapi-admin/evals
- b2c-scapi-shopper/evals
- b2c-slas-auth-patterns
- evals
- references
- b2c-webservices/evals
- eval
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
This file was deleted.
0 commit comments