Definition
VLoc Bench is cisco Foundation AI’s 500-task agentic benchmark for repository-level vulnerability-localization — measuring how accurately models identify vulnerable files given CWE/advisory-style descriptions.
Key Points
- Vendor-authored evaluation; treat leaderboard claims as Cisco-evaluated unless independently reproduced
- Metrics include File F1 among others
- Released alongside cisco-antares open-weight models (Apache 2.0 per secondary coverage)
Warning
Benchmark wins are on Cisco’s own VLoc Bench — attribute as vendor-evaluated.