# Real CVE fixes as Maven Central artifacts (jvm): Keryn Forge

> For advisories of Maven Central packages, does Forge report a flow of the advisory's CWE in the last vulnerable release and no longer report it in the first patched release?

Source: https://keryn.dev/evals/forge-cve-jvm/

For advisories of Maven Central packages, does Forge report a flow of the advisory's CWE in the last vulnerable release and no longer report it in the first patched release?

| Evaluation detail | Description |
|---|---|
| Keryn engine | keryn-forge at `6b98539c6472`: Keryn Forge (crates/keryn-forge) examples/forge_scan, models/jvm.json; binary sha256 55b9846b5fdf5957510209747a7a65e170581eb58aee885b237a17412ab8f4fc. |
| Reference | GitHub Advisory Database (via vulnfix-mine evidence db) + registry release history . Ground truth: the advisory says the vulnerable release has the weakness of the listed CWE and the first patched release does not. |
| Corpus | jvm bytecode pairs |
| Comparison | Per advisory package (one vulnerable release, one patched release, both scanned with forge_scan --accept-missing-deps all). `identical` (outcome `found-and-fixed`): the vulnerable release has a `flow` of the advisory CWE family whose key (rule, source function, sink function) is absent as a flow in the patched release. `differs`: `flow-persists` (flow in both), or a miss (outcome = the miss class: no-sink-model, sink-bound-no-source, bound-no-flow, unknown-only, producer-gap). `unsupported`: no shipped Forge rule judges the advisory CWE. `error`/`timeout`: a scan failed. Failures stay in the denominator. |
| Receipt | [`forge-cve-jvm.json`](https://keryn.dev/evals/forge-cve-jvm.json), sha256 `6cc09eb2df9d94e7` |

## Results

| Measure | Value | Count | Denominator |
|---|---|---|---|
| Advisories where the vulnerable release has the CWE flow and the patched release no longer does | **0%** | 0 / 50 | advisory packages with both releases scanned or failed |
| Of the advisories whose CWE Forge judges, those with a flow in the vulnerable release | **5.3%** | 1 / 19 | cases whose CWE some shipped Forge rule judges and whose scans completed |
| Of the advisories whose CWE Forge judges, those where the flow disappears in the patched release | **0%** | 0 / 19 | cases whose CWE some shipped Forge rule judges and whose scans completed |
| Of the flows found in vulnerable releases, those with none of the same flows in the patched release | **0%** | 0 / 1 | cases with a CWE flow in the vulnerable release |
| Of the judged advisories with a known fix commit, those whose flow touches a class the fix changed | **0%** | 0 / 19 | judged cases with a known fix commit |
| Advisories whose CWE some shipped Forge rule judges | **38.0%** | 19 / 50 | advisory packages in the batch |
| Judged advisories where a sink is bound but no source exists (library entry points unmodelled) | **0%** | 0 / 19 | cases whose CWE some shipped Forge rule judges and whose scans completed |

Cases by status: 19 differs, 31 unsupported.

## What this does and does not measure

- Advisories with a known fixed version whose vulnerable and fixed releases are both on the registry; Jenkins/other-registry packages, pom-only packages and artifacts over 25 MB are dropped before scoring (counts in the pairs dropped.json, not cases).
- Libraries have no HTTP request source: unless a framework entry model applies, a library flow can only start at a modelled source, so most misses are `sink-bound-no-source`. That is a measured gap, not a data error.
- Artifacts over 1.5 MB are scanned as a slice (packages of the classes the fix changed, same list for both releases); the case records `mode`.
- Pair selection is deterministic but biased to advisories with a known fix commit and a CWE label; at most 2 pairs per package.

## Differences and unassessed cases (50)

| Case | Status | Analysis outcome |
|---|---|---|
| `maven:com.epam.reportportal:service-api@5.1.0..5.1.1` | differs | No sink model |
| `maven:com.fasterxml.jackson.core:jackson-databind@2.6.7.3..2.6.7.4` | differs | No sink model |
| `maven:com.h2database:h2@2.1.214..2.2.220` | unsupported | Weakness not modelled |
| `maven:com.liferay.portal:com.liferay.portal.impl@109.0.0..109.1.0` | differs | Unknown only |
| `maven:com.liferay.portal:com.liferay.portal.impl@95.0.0..96.0.0` | differs | Unknown only |
| `maven:com.liferay:com.liferay.change.tracking.web@2.0.121..2.0.122` | unsupported | Weakness not modelled |
| `maven:com.liferay:com.liferay.item.selector.web@7.0.51..7.0.52` | differs | No sink model |
| `maven:com.sap.scimono:scimono-server@0.0.18..0.0.19` | differs | No sink model |
| `maven:io.appium:java-client@10.1.0..10.1.1` | differs | Unknown only |
| `maven:io.gitlab.arturbosch.detekt:detekt-core@1.19.0..1.20.0` | differs | No sink model |
| `maven:io.quarkus:quarkus-resteasy-reactive-common-deployment@3.7.0..3.7.1` | unsupported | Weakness not modelled |
| `maven:io.quarkus:quarkus-resteasy-reactive-common@3.7.0..3.7.1` | unsupported | Weakness not modelled |
| `maven:junit:junit@4.13..4.13.1` | unsupported | Weakness not modelled |
| `maven:org.apache.cxf:cxf-rt-rs-security-sso-saml@3.1.2..3.1.3` | unsupported | Weakness not modelled |
| `maven:org.apache.flink:flink-table-api-java@2.2.0..2.2.1` | unsupported | Weakness not modelled |
| `maven:org.apache.flink:flink-table-planner_2.12@2.2.0..2.2.1` | unsupported | Weakness not modelled |
| `maven:org.apache.flink:flink-table-runtime@2.2.0..2.2.1` | unsupported | Weakness not modelled |
| `maven:org.apache.hugegraph:hugegraph-api@1.2.0..1.3.0` | differs | Unknown only |
| `maven:org.apache.hugegraph:hugegraph-core@1.2.0..1.3.0` | differs | Bound, no flow |
| `maven:org.apache.ivy:ivy@2.5.1..2.5.2` | differs | Unknown only |
| `maven:org.apache.maven.plugins:maven-archetype-plugin@3.2.1..3.3.0` | unsupported | Weakness not modelled |
| `maven:org.apache.nifi:nifi-dbcp-base@1.23.0..1.23.1` | unsupported | Weakness not modelled |
| `maven:org.apache.nifi:nifi-dbcp-service-api@1.23.0..1.23.1` | unsupported | Weakness not modelled |
| `maven:org.apache.nifi:nifi-jms-processors@1.23.0..1.23.1` | unsupported | Weakness not modelled |
| `maven:org.apache.solr:solr-core@9.4.0..9.4.1` | unsupported | Weakness not modelled |
| `maven:org.apache.struts:struts2-core@2.3.24.3..2.3.28` | differs | Flow persists |
| `maven:org.apache.struts:struts2-rest-plugin@2.5.14.1..2.5.16` | unsupported | Weakness not modelled |
| `maven:org.apache.tapestry:tapestry-core@5.8.1..5.8.2` | unsupported | Weakness not modelled |
| `maven:org.apache.tomcat.embed:tomcat-embed-core@7.0.106..7.0.107` | unsupported | Weakness not modelled |
| `maven:org.apache.tomcat.embed:tomcat-embed-core@9.0.105..9.0.106` | unsupported | Weakness not modelled |
| `maven:org.apache.tomcat:tomcat-catalina@7.0.103..7.0.104` | differs | Unknown only |
| `maven:org.apache.tomcat:tomcat-catalina@9.0.105..9.0.106` | unsupported | Weakness not modelled |
| `maven:org.apache.tomcat:tomcat-coyote-ffm@11.0.20..11.0.21` | unsupported | Weakness not modelled |
| `maven:org.apache.xmlgraphics:batik-script@1.16..1.17` | differs | No sink model |
| `maven:org.apache.xmlgraphics:batik-svgbrowser@1.13..1.14` | differs | Unknown only |
| `maven:org.gaul:s3proxy@2.5.0..2.6.0` | differs | No sink model |
| `maven:org.javadelight:delight-nashorn-sandbox@0.3.0..0.3.1` | unsupported | Weakness not modelled |
| `maven:org.jdom:jdom2@2.0.6..2.0.6.1` | differs | No sink model |
| `maven:org.keycloak:keycloak-services@1.0.1.Final..1.0.2.Final` | unsupported | Weakness not modelled |
| `maven:org.keycloak:keycloak-services@24.0.4..24.0.5` | unsupported | Weakness not modelled |
| `maven:org.picketlink:picketlink-common@2.6.1.Final..2.7.0.Final` | differs | Unknown only |
| `maven:org.postgresql:postgresql@42.7.1..42.7.2` | differs | Unknown only |
| `maven:org.springframework:spring-beans@5.2.19.RELEASE..5.2.20.RELEASE` | unsupported | Weakness not modelled |
| `maven:org.springframework:spring-web@6.1.11..6.1.12` | unsupported | Weakness not modelled |
| `maven:org.springframework:spring-webflux@5.2.19.RELEASE..5.2.20.RELEASE` | unsupported | Weakness not modelled |
| `maven:org.springframework:spring-webmvc@5.2.19.RELEASE..5.2.20.RELEASE` | unsupported | Weakness not modelled |
| `maven:org.wildfly.core:wildfly-controller@21.1.1.Final..22.0.0.Final` | unsupported | Weakness not modelled |
| `maven:org.xwiki.rendering:xwiki-rendering-transformation-macro@14.9..14.10` | unsupported | Weakness not modelled |
| `maven:org.xwiki.rendering:xwiki-rendering-xml@14.10.1..14.10.2` | unsupported | Weakness not modelled |
| `maven:us.springett:alpine@1.10.3..1.10.4` | unsupported | Weakness not modelled |

## All cases (50)

**Show every case**

| Case | Status | Analysis outcome |
|---|---|---|
| `maven:com.epam.reportportal:service-api@5.1.0..5.1.1` | differs | No sink model |
| `maven:com.fasterxml.jackson.core:jackson-databind@2.6.7.3..2.6.7.4` | differs | No sink model |
| `maven:com.h2database:h2@2.1.214..2.2.220` | unsupported | Weakness not modelled |
| `maven:com.liferay.portal:com.liferay.portal.impl@109.0.0..109.1.0` | differs | Unknown only |
| `maven:com.liferay.portal:com.liferay.portal.impl@95.0.0..96.0.0` | differs | Unknown only |
| `maven:com.liferay:com.liferay.change.tracking.web@2.0.121..2.0.122` | unsupported | Weakness not modelled |
| `maven:com.liferay:com.liferay.item.selector.web@7.0.51..7.0.52` | differs | No sink model |
| `maven:com.sap.scimono:scimono-server@0.0.18..0.0.19` | differs | No sink model |
| `maven:io.appium:java-client@10.1.0..10.1.1` | differs | Unknown only |
| `maven:io.gitlab.arturbosch.detekt:detekt-core@1.19.0..1.20.0` | differs | No sink model |
| `maven:io.quarkus:quarkus-resteasy-reactive-common-deployment@3.7.0..3.7.1` | unsupported | Weakness not modelled |
| `maven:io.quarkus:quarkus-resteasy-reactive-common@3.7.0..3.7.1` | unsupported | Weakness not modelled |
| `maven:junit:junit@4.13..4.13.1` | unsupported | Weakness not modelled |
| `maven:org.apache.cxf:cxf-rt-rs-security-sso-saml@3.1.2..3.1.3` | unsupported | Weakness not modelled |
| `maven:org.apache.flink:flink-table-api-java@2.2.0..2.2.1` | unsupported | Weakness not modelled |
| `maven:org.apache.flink:flink-table-planner_2.12@2.2.0..2.2.1` | unsupported | Weakness not modelled |
| `maven:org.apache.flink:flink-table-runtime@2.2.0..2.2.1` | unsupported | Weakness not modelled |
| `maven:org.apache.hugegraph:hugegraph-api@1.2.0..1.3.0` | differs | Unknown only |
| `maven:org.apache.hugegraph:hugegraph-core@1.2.0..1.3.0` | differs | Bound, no flow |
| `maven:org.apache.ivy:ivy@2.5.1..2.5.2` | differs | Unknown only |
| `maven:org.apache.maven.plugins:maven-archetype-plugin@3.2.1..3.3.0` | unsupported | Weakness not modelled |
| `maven:org.apache.nifi:nifi-dbcp-base@1.23.0..1.23.1` | unsupported | Weakness not modelled |
| `maven:org.apache.nifi:nifi-dbcp-service-api@1.23.0..1.23.1` | unsupported | Weakness not modelled |
| `maven:org.apache.nifi:nifi-jms-processors@1.23.0..1.23.1` | unsupported | Weakness not modelled |
| `maven:org.apache.solr:solr-core@9.4.0..9.4.1` | unsupported | Weakness not modelled |
| `maven:org.apache.struts:struts2-core@2.3.24.3..2.3.28` | differs | Flow persists |
| `maven:org.apache.struts:struts2-rest-plugin@2.5.14.1..2.5.16` | unsupported | Weakness not modelled |
| `maven:org.apache.tapestry:tapestry-core@5.8.1..5.8.2` | unsupported | Weakness not modelled |
| `maven:org.apache.tomcat.embed:tomcat-embed-core@7.0.106..7.0.107` | unsupported | Weakness not modelled |
| `maven:org.apache.tomcat.embed:tomcat-embed-core@9.0.105..9.0.106` | unsupported | Weakness not modelled |
| `maven:org.apache.tomcat:tomcat-catalina@7.0.103..7.0.104` | differs | Unknown only |
| `maven:org.apache.tomcat:tomcat-catalina@9.0.105..9.0.106` | unsupported | Weakness not modelled |
| `maven:org.apache.tomcat:tomcat-coyote-ffm@11.0.20..11.0.21` | unsupported | Weakness not modelled |
| `maven:org.apache.xmlgraphics:batik-script@1.16..1.17` | differs | No sink model |
| `maven:org.apache.xmlgraphics:batik-svgbrowser@1.13..1.14` | differs | Unknown only |
| `maven:org.gaul:s3proxy@2.5.0..2.6.0` | differs | No sink model |
| `maven:org.javadelight:delight-nashorn-sandbox@0.3.0..0.3.1` | unsupported | Weakness not modelled |
| `maven:org.jdom:jdom2@2.0.6..2.0.6.1` | differs | No sink model |
| `maven:org.keycloak:keycloak-services@1.0.1.Final..1.0.2.Final` | unsupported | Weakness not modelled |
| `maven:org.keycloak:keycloak-services@24.0.4..24.0.5` | unsupported | Weakness not modelled |
| `maven:org.picketlink:picketlink-common@2.6.1.Final..2.7.0.Final` | differs | Unknown only |
| `maven:org.postgresql:postgresql@42.7.1..42.7.2` | differs | Unknown only |
| `maven:org.springframework:spring-beans@5.2.19.RELEASE..5.2.20.RELEASE` | unsupported | Weakness not modelled |
| `maven:org.springframework:spring-web@6.1.11..6.1.12` | unsupported | Weakness not modelled |
| `maven:org.springframework:spring-webflux@5.2.19.RELEASE..5.2.20.RELEASE` | unsupported | Weakness not modelled |
| `maven:org.springframework:spring-webmvc@5.2.19.RELEASE..5.2.20.RELEASE` | unsupported | Weakness not modelled |
| `maven:org.wildfly.core:wildfly-controller@21.1.1.Final..22.0.0.Final` | unsupported | Weakness not modelled |
| `maven:org.xwiki.rendering:xwiki-rendering-transformation-macro@14.9..14.10` | unsupported | Weakness not modelled |
| `maven:org.xwiki.rendering:xwiki-rendering-xml@14.10.1..14.10.2` | unsupported | Weakness not modelled |
| `maven:us.springett:alpine@1.10.3..1.10.4` | unsupported | Weakness not modelled |
