feat: benchmarking generated and manual assessments #166

Merged
phbaer merged 17 commits from assessment-benchmarking into main 2026-07-13 03:35:18 +00:00
Owner
No description provided.
Initial benchmarking of generated and manual assessments
Some checks failed
Build and Publish Docker Images / test-backend (pull_request) Failing after 24s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 27s
Build and Publish Docker Images / test-agentyzer (pull_request) Failing after 23s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 15s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Has been skipped
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
56102facf8
phbaer force-pushed assessment-benchmarking from 56102facf8
Some checks failed
Build and Publish Docker Images / test-backend (pull_request) Failing after 24s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 27s
Build and Publish Docker Images / test-agentyzer (pull_request) Failing after 23s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 15s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Has been skipped
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
to 5089c45875
Some checks failed
Build and Publish Docker Images / test-backend (pull_request) Successful in 37s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 28s
Build and Publish Docker Images / test-agentyzer (pull_request) Failing after 23s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 15s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Has been skipped
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
2026-07-09 10:44:07 +00:00
Compare
phbaer force-pushed assessment-benchmarking from 5089c45875
Some checks failed
Build and Publish Docker Images / test-backend (pull_request) Successful in 37s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 28s
Build and Publish Docker Images / test-agentyzer (pull_request) Failing after 23s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 15s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Has been skipped
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
to e358cb4a67
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 40s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 28s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 23s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m29s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
2026-07-09 11:00:15 +00:00
Compare
Implement context window management
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 38s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 27s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 23s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m32s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
355b0d8f08
Restore missing rescored CVSS vectors
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 37s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 28s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 24s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 16s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m27s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
19efa486d1
Refresh vulnerability details after assessment updates
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 38s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 32s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 24s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 16s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m32s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
afabe095eb
Add final verdict sanity guard
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 32s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 28s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 24s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 16s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m24s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
ebde5d58cb
Validate final verdict claims
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 38s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 28s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 23s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 15s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m29s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
3cbd06f341
Make the inconsistencies filter more fine-granular
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 39s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 29s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 24s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 16s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m39s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
ffb1ce4412
phbaer force-pushed assessment-benchmarking from ffb1ce4412
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 39s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 29s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 24s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 16s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m39s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
to a67f5b579d
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 38s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 28s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 23s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 16s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m26s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
2026-07-10 06:38:58 +00:00
Compare
Improve final verdict guardrails
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 34s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 26s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 22s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m14s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
b53d6f95af
Improve assessment panel
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 36s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 27s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 22s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m18s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
5701dafcd4
phbaer force-pushed assessment-benchmarking from 5701dafcd4
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 36s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 27s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 22s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m18s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
to 2ce197aaf1
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 36s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 26s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 22s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m14s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
2026-07-10 10:02:58 +00:00
Compare
Unify analysis and benchmark actions
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 36s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 27s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 22s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m21s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
dfd658b11d
Clarify benchmark comparison states
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 31s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 26s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 21s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m17s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
1931ad028d
Show CVSS restore progress and failures
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 36s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 27s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 21s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m17s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
4b1bae0a0c
Make threat-model workspace scrollable
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 36s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 26s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 22s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m19s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
3088e6b94b
Update TMRescore for current vscorer API
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 36s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 26s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 22s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m14s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
0a7f6522d6
Use provider-neutral LLM enrichment label
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 36s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 27s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 22s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m19s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
4609f5e7b7
Let vscorer select the TMRescore model
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Successful in 36s
Build and Publish Docker Images / test-frontend (pull_request) Successful in 26s
Build and Publish Docker Images / test-agentyzer (pull_request) Successful in 22s
Build and Publish Docker Images / test-e2e (pull_request) Successful in 14s
Build and Publish Docker Images / delete-pr-images (pull_request) Has been skipped
Build and Publish Docker Images / build-push-images (pull_request) Successful in 2m16s
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
bc5cddc387
Refresh documentation screenshots
All checks were successful
Build and Publish Docker Images / test-backend (pull_request) Has been skipped
Build and Publish Docker Images / test-frontend (pull_request) Has been skipped
Build and Publish Docker Images / test-agentyzer (pull_request) Has been skipped
Build and Publish Docker Images / test-e2e (pull_request) Has been skipped
Build and Publish Docker Images / delete-pr-images (pull_request) Successful in 1s
Build and Publish Docker Images / build-push-images (pull_request) Has been skipped
Build and Publish Docker Images / check-version (pull_request) Has been skipped
Build and Publish Docker Images / release (pull_request) Has been skipped
Build and Publish Docker Images / create-tag (pull_request) Has been skipped
4aa967243d
phbaer merged commit 8649d4378b into main 2026-07-13 03:35:18 +00:00
phbaer deleted branch assessment-benchmarking 2026-07-13 03:35:18 +00:00
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
phbaer/dtvp!166
No description provided.