Real CVE fixes as Maven Central artifacts (jvm): Keryn Forge
For advisories of Maven Central packages, does Forge report a flow of the advisory’s CWE in the last vulnerable release and no longer report it in the first patched release?
| Evaluation detail | Description |
|---|---|
| Keryn engine | keryn-forge at 6b98539c6472: Keryn Forge (crates/keryn-forge) examples/forge_scan, models/jvm.json; binary sha256 55b9846b5fdf5957510209747a7a65e170581eb58aee885b237a17412ab8f4fc. |
| Reference | GitHub Advisory Database (via vulnfix-mine evidence db) + registry release history . Ground truth: the advisory says the vulnerable release has the weakness of the listed CWE and the first patched release does not. |
| Corpus | jvm bytecode pairs |
| Comparison | Per advisory package (one vulnerable release, one patched release, both scanned with forge_scan –accept-missing-deps all). identical (outcome found-and-fixed): the vulnerable release has a flow of the advisory CWE family whose key (rule, source function, sink function) is absent as a flow in the patched release. differs: flow-persists (flow in both), or a miss (outcome = the miss class: no-sink-model, sink-bound-no-source, bound-no-flow, unknown-only, producer-gap). unsupported: no shipped Forge rule judges the advisory CWE. error/timeout: a scan failed. Failures stay in the denominator. |
| Receipt | forge-cve-jvm.json, sha256 6cc09eb2df9d94e7 |
Results
Section titled “Results”| Measure | Value | Count | Denominator |
|---|---|---|---|
| Advisories where the vulnerable release has the CWE flow and the patched release no longer does | 0% | 0 / 50 | advisory packages with both releases scanned or failed |
| Of the advisories whose CWE Forge judges, those with a flow in the vulnerable release | 5.3% | 1 / 19 | cases whose CWE some shipped Forge rule judges and whose scans completed |
| Of the advisories whose CWE Forge judges, those where the flow disappears in the patched release | 0% | 0 / 19 | cases whose CWE some shipped Forge rule judges and whose scans completed |
| Of the flows found in vulnerable releases, those with none of the same flows in the patched release | 0% | 0 / 1 | cases with a CWE flow in the vulnerable release |
| Of the judged advisories with a known fix commit, those whose flow touches a class the fix changed | 0% | 0 / 19 | judged cases with a known fix commit |
| Advisories whose CWE some shipped Forge rule judges | 38.0% | 19 / 50 | advisory packages in the batch |
| Judged advisories where a sink is bound but no source exists (library entry points unmodelled) | 0% | 0 / 19 | cases whose CWE some shipped Forge rule judges and whose scans completed |
Cases by status: 19 differs, 31 unsupported.
What this does and does not measure
Section titled “What this does and does not measure”- Advisories with a known fixed version whose vulnerable and fixed releases are both on the registry; Jenkins/other-registry packages, pom-only packages and artifacts over 25 MB are dropped before scoring (counts in the pairs dropped.json, not cases).
- Libraries have no HTTP request source: unless a framework entry model applies, a library flow can only start at a modelled source, so most misses are
sink-bound-no-source. That is a measured gap, not a data error. - Artifacts over 1.5 MB are scanned as a slice (packages of the classes the fix changed, same list for both releases); the case records
mode. - Pair selection is deterministic but biased to advisories with a known fix commit and a CWE label; at most 2 pairs per package.
Differences and unassessed cases (50)
Section titled “Differences and unassessed cases (50)”| Case | Status | Analysis outcome |
|---|---|---|
maven:com.epam.reportportal:service-api@5.1.0..5.1.1 |
differs | No sink model |
maven:com.fasterxml.jackson.core:jackson-databind@2.6.7.3..2.6.7.4 |
differs | No sink model |
maven:com.h2database:h2@2.1.214..2.2.220 |
unsupported | Weakness not modelled |
maven:com.liferay.portal:com.liferay.portal.impl@109.0.0..109.1.0 |
differs | Unknown only |
maven:com.liferay.portal:com.liferay.portal.impl@95.0.0..96.0.0 |
differs | Unknown only |
maven:com.liferay:com.liferay.change.tracking.web@2.0.121..2.0.122 |
unsupported | Weakness not modelled |
maven:com.liferay:com.liferay.item.selector.web@7.0.51..7.0.52 |
differs | No sink model |
maven:com.sap.scimono:scimono-server@0.0.18..0.0.19 |
differs | No sink model |
maven:io.appium:java-client@10.1.0..10.1.1 |
differs | Unknown only |
maven:io.gitlab.arturbosch.detekt:detekt-core@1.19.0..1.20.0 |
differs | No sink model |
maven:io.quarkus:quarkus-resteasy-reactive-common-deployment@3.7.0..3.7.1 |
unsupported | Weakness not modelled |
maven:io.quarkus:quarkus-resteasy-reactive-common@3.7.0..3.7.1 |
unsupported | Weakness not modelled |
maven:junit:junit@4.13..4.13.1 |
unsupported | Weakness not modelled |
maven:org.apache.cxf:cxf-rt-rs-security-sso-saml@3.1.2..3.1.3 |
unsupported | Weakness not modelled |
maven:org.apache.flink:flink-table-api-java@2.2.0..2.2.1 |
unsupported | Weakness not modelled |
maven:org.apache.flink:flink-table-planner_2.12@2.2.0..2.2.1 |
unsupported | Weakness not modelled |
maven:org.apache.flink:flink-table-runtime@2.2.0..2.2.1 |
unsupported | Weakness not modelled |
maven:org.apache.hugegraph:hugegraph-api@1.2.0..1.3.0 |
differs | Unknown only |
maven:org.apache.hugegraph:hugegraph-core@1.2.0..1.3.0 |
differs | Bound, no flow |
maven:org.apache.ivy:ivy@2.5.1..2.5.2 |
differs | Unknown only |
maven:org.apache.maven.plugins:maven-archetype-plugin@3.2.1..3.3.0 |
unsupported | Weakness not modelled |
maven:org.apache.nifi:nifi-dbcp-base@1.23.0..1.23.1 |
unsupported | Weakness not modelled |
maven:org.apache.nifi:nifi-dbcp-service-api@1.23.0..1.23.1 |
unsupported | Weakness not modelled |
maven:org.apache.nifi:nifi-jms-processors@1.23.0..1.23.1 |
unsupported | Weakness not modelled |
maven:org.apache.solr:solr-core@9.4.0..9.4.1 |
unsupported | Weakness not modelled |
maven:org.apache.struts:struts2-core@2.3.24.3..2.3.28 |
differs | Flow persists |
maven:org.apache.struts:struts2-rest-plugin@2.5.14.1..2.5.16 |
unsupported | Weakness not modelled |
maven:org.apache.tapestry:tapestry-core@5.8.1..5.8.2 |
unsupported | Weakness not modelled |
maven:org.apache.tomcat.embed:tomcat-embed-core@7.0.106..7.0.107 |
unsupported | Weakness not modelled |
maven:org.apache.tomcat.embed:tomcat-embed-core@9.0.105..9.0.106 |
unsupported | Weakness not modelled |
maven:org.apache.tomcat:tomcat-catalina@7.0.103..7.0.104 |
differs | Unknown only |
maven:org.apache.tomcat:tomcat-catalina@9.0.105..9.0.106 |
unsupported | Weakness not modelled |
maven:org.apache.tomcat:tomcat-coyote-ffm@11.0.20..11.0.21 |
unsupported | Weakness not modelled |
maven:org.apache.xmlgraphics:batik-script@1.16..1.17 |
differs | No sink model |
maven:org.apache.xmlgraphics:batik-svgbrowser@1.13..1.14 |
differs | Unknown only |
maven:org.gaul:s3proxy@2.5.0..2.6.0 |
differs | No sink model |
maven:org.javadelight:delight-nashorn-sandbox@0.3.0..0.3.1 |
unsupported | Weakness not modelled |
maven:org.jdom:jdom2@2.0.6..2.0.6.1 |
differs | No sink model |
maven:org.keycloak:keycloak-services@1.0.1.Final..1.0.2.Final |
unsupported | Weakness not modelled |
maven:org.keycloak:keycloak-services@24.0.4..24.0.5 |
unsupported | Weakness not modelled |
maven:org.picketlink:picketlink-common@2.6.1.Final..2.7.0.Final |
differs | Unknown only |
maven:org.postgresql:postgresql@42.7.1..42.7.2 |
differs | Unknown only |
maven:org.springframework:spring-beans@5.2.19.RELEASE..5.2.20.RELEASE |
unsupported | Weakness not modelled |
maven:org.springframework:spring-web@6.1.11..6.1.12 |
unsupported | Weakness not modelled |
maven:org.springframework:spring-webflux@5.2.19.RELEASE..5.2.20.RELEASE |
unsupported | Weakness not modelled |
maven:org.springframework:spring-webmvc@5.2.19.RELEASE..5.2.20.RELEASE |
unsupported | Weakness not modelled |
maven:org.wildfly.core:wildfly-controller@21.1.1.Final..22.0.0.Final |
unsupported | Weakness not modelled |
maven:org.xwiki.rendering:xwiki-rendering-transformation-macro@14.9..14.10 |
unsupported | Weakness not modelled |
maven:org.xwiki.rendering:xwiki-rendering-xml@14.10.1..14.10.2 |
unsupported | Weakness not modelled |
maven:us.springett:alpine@1.10.3..1.10.4 |
unsupported | Weakness not modelled |
All cases (50)
Section titled “All cases (50)”Show every case
| Case | Status | Analysis outcome |
|---|---|---|
maven:com.epam.reportportal:service-api@5.1.0..5.1.1 |
differs | No sink model |
maven:com.fasterxml.jackson.core:jackson-databind@2.6.7.3..2.6.7.4 |
differs | No sink model |
maven:com.h2database:h2@2.1.214..2.2.220 |
unsupported | Weakness not modelled |
maven:com.liferay.portal:com.liferay.portal.impl@109.0.0..109.1.0 |
differs | Unknown only |
maven:com.liferay.portal:com.liferay.portal.impl@95.0.0..96.0.0 |
differs | Unknown only |
maven:com.liferay:com.liferay.change.tracking.web@2.0.121..2.0.122 |
unsupported | Weakness not modelled |
maven:com.liferay:com.liferay.item.selector.web@7.0.51..7.0.52 |
differs | No sink model |
maven:com.sap.scimono:scimono-server@0.0.18..0.0.19 |
differs | No sink model |
maven:io.appium:java-client@10.1.0..10.1.1 |
differs | Unknown only |
maven:io.gitlab.arturbosch.detekt:detekt-core@1.19.0..1.20.0 |
differs | No sink model |
maven:io.quarkus:quarkus-resteasy-reactive-common-deployment@3.7.0..3.7.1 |
unsupported | Weakness not modelled |
maven:io.quarkus:quarkus-resteasy-reactive-common@3.7.0..3.7.1 |
unsupported | Weakness not modelled |
maven:junit:junit@4.13..4.13.1 |
unsupported | Weakness not modelled |
maven:org.apache.cxf:cxf-rt-rs-security-sso-saml@3.1.2..3.1.3 |
unsupported | Weakness not modelled |
maven:org.apache.flink:flink-table-api-java@2.2.0..2.2.1 |
unsupported | Weakness not modelled |
maven:org.apache.flink:flink-table-planner_2.12@2.2.0..2.2.1 |
unsupported | Weakness not modelled |
maven:org.apache.flink:flink-table-runtime@2.2.0..2.2.1 |
unsupported | Weakness not modelled |
maven:org.apache.hugegraph:hugegraph-api@1.2.0..1.3.0 |
differs | Unknown only |
maven:org.apache.hugegraph:hugegraph-core@1.2.0..1.3.0 |
differs | Bound, no flow |
maven:org.apache.ivy:ivy@2.5.1..2.5.2 |
differs | Unknown only |
maven:org.apache.maven.plugins:maven-archetype-plugin@3.2.1..3.3.0 |
unsupported | Weakness not modelled |
maven:org.apache.nifi:nifi-dbcp-base@1.23.0..1.23.1 |
unsupported | Weakness not modelled |
maven:org.apache.nifi:nifi-dbcp-service-api@1.23.0..1.23.1 |
unsupported | Weakness not modelled |
maven:org.apache.nifi:nifi-jms-processors@1.23.0..1.23.1 |
unsupported | Weakness not modelled |
maven:org.apache.solr:solr-core@9.4.0..9.4.1 |
unsupported | Weakness not modelled |
maven:org.apache.struts:struts2-core@2.3.24.3..2.3.28 |
differs | Flow persists |
maven:org.apache.struts:struts2-rest-plugin@2.5.14.1..2.5.16 |
unsupported | Weakness not modelled |
maven:org.apache.tapestry:tapestry-core@5.8.1..5.8.2 |
unsupported | Weakness not modelled |
maven:org.apache.tomcat.embed:tomcat-embed-core@7.0.106..7.0.107 |
unsupported | Weakness not modelled |
maven:org.apache.tomcat.embed:tomcat-embed-core@9.0.105..9.0.106 |
unsupported | Weakness not modelled |
maven:org.apache.tomcat:tomcat-catalina@7.0.103..7.0.104 |
differs | Unknown only |
maven:org.apache.tomcat:tomcat-catalina@9.0.105..9.0.106 |
unsupported | Weakness not modelled |
maven:org.apache.tomcat:tomcat-coyote-ffm@11.0.20..11.0.21 |
unsupported | Weakness not modelled |
maven:org.apache.xmlgraphics:batik-script@1.16..1.17 |
differs | No sink model |
maven:org.apache.xmlgraphics:batik-svgbrowser@1.13..1.14 |
differs | Unknown only |
maven:org.gaul:s3proxy@2.5.0..2.6.0 |
differs | No sink model |
maven:org.javadelight:delight-nashorn-sandbox@0.3.0..0.3.1 |
unsupported | Weakness not modelled |
maven:org.jdom:jdom2@2.0.6..2.0.6.1 |
differs | No sink model |
maven:org.keycloak:keycloak-services@1.0.1.Final..1.0.2.Final |
unsupported | Weakness not modelled |
maven:org.keycloak:keycloak-services@24.0.4..24.0.5 |
unsupported | Weakness not modelled |
maven:org.picketlink:picketlink-common@2.6.1.Final..2.7.0.Final |
differs | Unknown only |
maven:org.postgresql:postgresql@42.7.1..42.7.2 |
differs | Unknown only |
maven:org.springframework:spring-beans@5.2.19.RELEASE..5.2.20.RELEASE |
unsupported | Weakness not modelled |
maven:org.springframework:spring-web@6.1.11..6.1.12 |
unsupported | Weakness not modelled |
maven:org.springframework:spring-webflux@5.2.19.RELEASE..5.2.20.RELEASE |
unsupported | Weakness not modelled |
maven:org.springframework:spring-webmvc@5.2.19.RELEASE..5.2.20.RELEASE |
unsupported | Weakness not modelled |
maven:org.wildfly.core:wildfly-controller@21.1.1.Final..22.0.0.Final |
unsupported | Weakness not modelled |
maven:org.xwiki.rendering:xwiki-rendering-transformation-macro@14.9..14.10 |
unsupported | Weakness not modelled |
maven:org.xwiki.rendering:xwiki-rendering-xml@14.10.1..14.10.2 |
unsupported | Weakness not modelled |
maven:us.springett:alpine@1.10.3..1.10.4 |
unsupported | Weakness not modelled |