Skip to content

    Type a page, a command such as keryn scan, or a rule id.

    Real CVE fixes as Maven Central artifacts (jvm): Keryn Forge

    View as Markdown

    For advisories of Maven Central packages, does Forge report a flow of the advisory’s CWE in the last vulnerable release and no longer report it in the first patched release?

    Evaluation detail Description
    Keryn engine keryn-forge at 6b98539c6472: Keryn Forge (crates/keryn-forge) examples/forge_scan, models/jvm.json; binary sha256 55b9846b5fdf5957510209747a7a65e170581eb58aee885b237a17412ab8f4fc.
    Reference GitHub Advisory Database (via vulnfix-mine evidence db) + registry release history . Ground truth: the advisory says the vulnerable release has the weakness of the listed CWE and the first patched release does not.
    Corpus jvm bytecode pairs
    Comparison Per advisory package (one vulnerable release, one patched release, both scanned with forge_scan –accept-missing-deps all). identical (outcome found-and-fixed): the vulnerable release has a flow of the advisory CWE family whose key (rule, source function, sink function) is absent as a flow in the patched release. differs: flow-persists (flow in both), or a miss (outcome = the miss class: no-sink-model, sink-bound-no-source, bound-no-flow, unknown-only, producer-gap). unsupported: no shipped Forge rule judges the advisory CWE. error/timeout: a scan failed. Failures stay in the denominator.
    Receipt forge-cve-jvm.json, sha256 6cc09eb2df9d94e7
    Measure Value Count Denominator
    Advisories where the vulnerable release has the CWE flow and the patched release no longer does 0% 0 / 50 advisory packages with both releases scanned or failed
    Of the advisories whose CWE Forge judges, those with a flow in the vulnerable release 5.3% 1 / 19 cases whose CWE some shipped Forge rule judges and whose scans completed
    Of the advisories whose CWE Forge judges, those where the flow disappears in the patched release 0% 0 / 19 cases whose CWE some shipped Forge rule judges and whose scans completed
    Of the flows found in vulnerable releases, those with none of the same flows in the patched release 0% 0 / 1 cases with a CWE flow in the vulnerable release
    Of the judged advisories with a known fix commit, those whose flow touches a class the fix changed 0% 0 / 19 judged cases with a known fix commit
    Advisories whose CWE some shipped Forge rule judges 38.0% 19 / 50 advisory packages in the batch
    Judged advisories where a sink is bound but no source exists (library entry points unmodelled) 0% 0 / 19 cases whose CWE some shipped Forge rule judges and whose scans completed

    Cases by status: 19 differs, 31 unsupported.

    • Advisories with a known fixed version whose vulnerable and fixed releases are both on the registry; Jenkins/other-registry packages, pom-only packages and artifacts over 25 MB are dropped before scoring (counts in the pairs dropped.json, not cases).
    • Libraries have no HTTP request source: unless a framework entry model applies, a library flow can only start at a modelled source, so most misses are sink-bound-no-source. That is a measured gap, not a data error.
    • Artifacts over 1.5 MB are scanned as a slice (packages of the classes the fix changed, same list for both releases); the case records mode.
    • Pair selection is deterministic but biased to advisories with a known fix commit and a CWE label; at most 2 pairs per package.
    Case Status Analysis outcome
    maven:com.epam.reportportal:service-api@5.1.0..5.1.1 differs No sink model
    maven:com.fasterxml.jackson.core:jackson-databind@2.6.7.3..2.6.7.4 differs No sink model
    maven:com.h2database:h2@2.1.214..2.2.220 unsupported Weakness not modelled
    maven:com.liferay.portal:com.liferay.portal.impl@109.0.0..109.1.0 differs Unknown only
    maven:com.liferay.portal:com.liferay.portal.impl@95.0.0..96.0.0 differs Unknown only
    maven:com.liferay:com.liferay.change.tracking.web@2.0.121..2.0.122 unsupported Weakness not modelled
    maven:com.liferay:com.liferay.item.selector.web@7.0.51..7.0.52 differs No sink model
    maven:com.sap.scimono:scimono-server@0.0.18..0.0.19 differs No sink model
    maven:io.appium:java-client@10.1.0..10.1.1 differs Unknown only
    maven:io.gitlab.arturbosch.detekt:detekt-core@1.19.0..1.20.0 differs No sink model
    maven:io.quarkus:quarkus-resteasy-reactive-common-deployment@3.7.0..3.7.1 unsupported Weakness not modelled
    maven:io.quarkus:quarkus-resteasy-reactive-common@3.7.0..3.7.1 unsupported Weakness not modelled
    maven:junit:junit@4.13..4.13.1 unsupported Weakness not modelled
    maven:org.apache.cxf:cxf-rt-rs-security-sso-saml@3.1.2..3.1.3 unsupported Weakness not modelled
    maven:org.apache.flink:flink-table-api-java@2.2.0..2.2.1 unsupported Weakness not modelled
    maven:org.apache.flink:flink-table-planner_2.12@2.2.0..2.2.1 unsupported Weakness not modelled
    maven:org.apache.flink:flink-table-runtime@2.2.0..2.2.1 unsupported Weakness not modelled
    maven:org.apache.hugegraph:hugegraph-api@1.2.0..1.3.0 differs Unknown only
    maven:org.apache.hugegraph:hugegraph-core@1.2.0..1.3.0 differs Bound, no flow
    maven:org.apache.ivy:ivy@2.5.1..2.5.2 differs Unknown only
    maven:org.apache.maven.plugins:maven-archetype-plugin@3.2.1..3.3.0 unsupported Weakness not modelled
    maven:org.apache.nifi:nifi-dbcp-base@1.23.0..1.23.1 unsupported Weakness not modelled
    maven:org.apache.nifi:nifi-dbcp-service-api@1.23.0..1.23.1 unsupported Weakness not modelled
    maven:org.apache.nifi:nifi-jms-processors@1.23.0..1.23.1 unsupported Weakness not modelled
    maven:org.apache.solr:solr-core@9.4.0..9.4.1 unsupported Weakness not modelled
    maven:org.apache.struts:struts2-core@2.3.24.3..2.3.28 differs Flow persists
    maven:org.apache.struts:struts2-rest-plugin@2.5.14.1..2.5.16 unsupported Weakness not modelled
    maven:org.apache.tapestry:tapestry-core@5.8.1..5.8.2 unsupported Weakness not modelled
    maven:org.apache.tomcat.embed:tomcat-embed-core@7.0.106..7.0.107 unsupported Weakness not modelled
    maven:org.apache.tomcat.embed:tomcat-embed-core@9.0.105..9.0.106 unsupported Weakness not modelled
    maven:org.apache.tomcat:tomcat-catalina@7.0.103..7.0.104 differs Unknown only
    maven:org.apache.tomcat:tomcat-catalina@9.0.105..9.0.106 unsupported Weakness not modelled
    maven:org.apache.tomcat:tomcat-coyote-ffm@11.0.20..11.0.21 unsupported Weakness not modelled
    maven:org.apache.xmlgraphics:batik-script@1.16..1.17 differs No sink model
    maven:org.apache.xmlgraphics:batik-svgbrowser@1.13..1.14 differs Unknown only
    maven:org.gaul:s3proxy@2.5.0..2.6.0 differs No sink model
    maven:org.javadelight:delight-nashorn-sandbox@0.3.0..0.3.1 unsupported Weakness not modelled
    maven:org.jdom:jdom2@2.0.6..2.0.6.1 differs No sink model
    maven:org.keycloak:keycloak-services@1.0.1.Final..1.0.2.Final unsupported Weakness not modelled
    maven:org.keycloak:keycloak-services@24.0.4..24.0.5 unsupported Weakness not modelled
    maven:org.picketlink:picketlink-common@2.6.1.Final..2.7.0.Final differs Unknown only
    maven:org.postgresql:postgresql@42.7.1..42.7.2 differs Unknown only
    maven:org.springframework:spring-beans@5.2.19.RELEASE..5.2.20.RELEASE unsupported Weakness not modelled
    maven:org.springframework:spring-web@6.1.11..6.1.12 unsupported Weakness not modelled
    maven:org.springframework:spring-webflux@5.2.19.RELEASE..5.2.20.RELEASE unsupported Weakness not modelled
    maven:org.springframework:spring-webmvc@5.2.19.RELEASE..5.2.20.RELEASE unsupported Weakness not modelled
    maven:org.wildfly.core:wildfly-controller@21.1.1.Final..22.0.0.Final unsupported Weakness not modelled
    maven:org.xwiki.rendering:xwiki-rendering-transformation-macro@14.9..14.10 unsupported Weakness not modelled
    maven:org.xwiki.rendering:xwiki-rendering-xml@14.10.1..14.10.2 unsupported Weakness not modelled
    maven:us.springett:alpine@1.10.3..1.10.4 unsupported Weakness not modelled
    Show every case
    Case Status Analysis outcome
    maven:com.epam.reportportal:service-api@5.1.0..5.1.1 differs No sink model
    maven:com.fasterxml.jackson.core:jackson-databind@2.6.7.3..2.6.7.4 differs No sink model
    maven:com.h2database:h2@2.1.214..2.2.220 unsupported Weakness not modelled
    maven:com.liferay.portal:com.liferay.portal.impl@109.0.0..109.1.0 differs Unknown only
    maven:com.liferay.portal:com.liferay.portal.impl@95.0.0..96.0.0 differs Unknown only
    maven:com.liferay:com.liferay.change.tracking.web@2.0.121..2.0.122 unsupported Weakness not modelled
    maven:com.liferay:com.liferay.item.selector.web@7.0.51..7.0.52 differs No sink model
    maven:com.sap.scimono:scimono-server@0.0.18..0.0.19 differs No sink model
    maven:io.appium:java-client@10.1.0..10.1.1 differs Unknown only
    maven:io.gitlab.arturbosch.detekt:detekt-core@1.19.0..1.20.0 differs No sink model
    maven:io.quarkus:quarkus-resteasy-reactive-common-deployment@3.7.0..3.7.1 unsupported Weakness not modelled
    maven:io.quarkus:quarkus-resteasy-reactive-common@3.7.0..3.7.1 unsupported Weakness not modelled
    maven:junit:junit@4.13..4.13.1 unsupported Weakness not modelled
    maven:org.apache.cxf:cxf-rt-rs-security-sso-saml@3.1.2..3.1.3 unsupported Weakness not modelled
    maven:org.apache.flink:flink-table-api-java@2.2.0..2.2.1 unsupported Weakness not modelled
    maven:org.apache.flink:flink-table-planner_2.12@2.2.0..2.2.1 unsupported Weakness not modelled
    maven:org.apache.flink:flink-table-runtime@2.2.0..2.2.1 unsupported Weakness not modelled
    maven:org.apache.hugegraph:hugegraph-api@1.2.0..1.3.0 differs Unknown only
    maven:org.apache.hugegraph:hugegraph-core@1.2.0..1.3.0 differs Bound, no flow
    maven:org.apache.ivy:ivy@2.5.1..2.5.2 differs Unknown only
    maven:org.apache.maven.plugins:maven-archetype-plugin@3.2.1..3.3.0 unsupported Weakness not modelled
    maven:org.apache.nifi:nifi-dbcp-base@1.23.0..1.23.1 unsupported Weakness not modelled
    maven:org.apache.nifi:nifi-dbcp-service-api@1.23.0..1.23.1 unsupported Weakness not modelled
    maven:org.apache.nifi:nifi-jms-processors@1.23.0..1.23.1 unsupported Weakness not modelled
    maven:org.apache.solr:solr-core@9.4.0..9.4.1 unsupported Weakness not modelled
    maven:org.apache.struts:struts2-core@2.3.24.3..2.3.28 differs Flow persists
    maven:org.apache.struts:struts2-rest-plugin@2.5.14.1..2.5.16 unsupported Weakness not modelled
    maven:org.apache.tapestry:tapestry-core@5.8.1..5.8.2 unsupported Weakness not modelled
    maven:org.apache.tomcat.embed:tomcat-embed-core@7.0.106..7.0.107 unsupported Weakness not modelled
    maven:org.apache.tomcat.embed:tomcat-embed-core@9.0.105..9.0.106 unsupported Weakness not modelled
    maven:org.apache.tomcat:tomcat-catalina@7.0.103..7.0.104 differs Unknown only
    maven:org.apache.tomcat:tomcat-catalina@9.0.105..9.0.106 unsupported Weakness not modelled
    maven:org.apache.tomcat:tomcat-coyote-ffm@11.0.20..11.0.21 unsupported Weakness not modelled
    maven:org.apache.xmlgraphics:batik-script@1.16..1.17 differs No sink model
    maven:org.apache.xmlgraphics:batik-svgbrowser@1.13..1.14 differs Unknown only
    maven:org.gaul:s3proxy@2.5.0..2.6.0 differs No sink model
    maven:org.javadelight:delight-nashorn-sandbox@0.3.0..0.3.1 unsupported Weakness not modelled
    maven:org.jdom:jdom2@2.0.6..2.0.6.1 differs No sink model
    maven:org.keycloak:keycloak-services@1.0.1.Final..1.0.2.Final unsupported Weakness not modelled
    maven:org.keycloak:keycloak-services@24.0.4..24.0.5 unsupported Weakness not modelled
    maven:org.picketlink:picketlink-common@2.6.1.Final..2.7.0.Final differs Unknown only
    maven:org.postgresql:postgresql@42.7.1..42.7.2 differs Unknown only
    maven:org.springframework:spring-beans@5.2.19.RELEASE..5.2.20.RELEASE unsupported Weakness not modelled
    maven:org.springframework:spring-web@6.1.11..6.1.12 unsupported Weakness not modelled
    maven:org.springframework:spring-webflux@5.2.19.RELEASE..5.2.20.RELEASE unsupported Weakness not modelled
    maven:org.springframework:spring-webmvc@5.2.19.RELEASE..5.2.20.RELEASE unsupported Weakness not modelled
    maven:org.wildfly.core:wildfly-controller@21.1.1.Final..22.0.0.Final unsupported Weakness not modelled
    maven:org.xwiki.rendering:xwiki-rendering-transformation-macro@14.9..14.10 unsupported Weakness not modelled
    maven:org.xwiki.rendering:xwiki-rendering-xml@14.10.1..14.10.2 unsupported Weakness not modelled
    maven:us.springett:alpine@1.10.3..1.10.4 unsupported Weakness not modelled