Skip to content

    Type a page, a command such as keryn scan, or a rule id.

    OWASP WebGoat lesson endpoints (Spring Boot, JVM bytecode): Keryn Forge

    View as Markdown

    On the WebGoat 2026.5 lesson endpoints whose flaw (or deliberate safety) is a taint class Forge has a rule for, does Forge report a flow from the vulnerable endpoint and stay quiet on the safe one, when framework entry points (Spring MVC parameters) are modelled?

    Evaluation detail Description
    Keryn engine keryn-forge at 8b92598ef154: Keryn Forge (crates/keryn-forge) via examples/forge_scan --accept-missing-deps all --partition-prefix org/owasp/webgoat/lessons/ --partition-depth 1: JVM producer on BOOT-INF/classes of the WebGoat jar, Spring MVC / JAX-RS entry-point models (applies_to annotated_parameter).
    Reference Hand labels from the WebGoat source at the pinned commit (suites/forge-webgoat/reference.json) . Ground truth: whether the endpoint’s own code lets request data reach a sink of the CWE (vulnerable) or cannot (safe). Labels follow what the code does, not what the lesson text says, and were written by reading the source, not by running any analyser.
    Corpus OWASP WebGoat 2026.5 lesson packages (org.owasp.webgoat.lessons.*), application classes of the released Spring Boot jar, WebGoat/WebGoat at 7e198f39189f
    Comparison Per labelled endpoint class, over findings of the case’s CWE whose source lies in that class (or its inner classes): vulnerable endpoint: identical (outcome found) when some finding is a flow; safe endpoint: identical (outcome clean) when there is no flow and no unknown. An unknown verdict is an abstention: the case is differs with outcome abstained and is counted in its own metric, never as found or clean. A vulnerable endpoint with neither is missed, a safe endpoint with a flow is a false-alarm. unsupported when Forge ships no rule for the CWE (outcome no-rule). Raw finding counts are never used.
    Receipt forge-webgoat.json, sha256 29315a82b9d55ae9
    Measure Value Count Denominator
    Cases where the vulnerable endpoint is flagged or the safe endpoint is left alone 83.7% 41 / 49 labelled WebGoat endpoint classes
    Of the cases whose CWE Forge has a rule for, those handled correctly 87.2% 41 / 47 labelled endpoints with a Forge rule for their CWE
    Vulnerable endpoints with a flow finding from the endpoint 100% 31 / 31 labelled vulnerable endpoints with a Forge rule
    Vulnerable endpoints where Forge only says unknown 0% 0 / 31 labelled vulnerable endpoints with a Forge rule
    Vulnerable endpoints with no finding at all 0% 0 / 31 labelled vulnerable endpoints with a Forge rule
    Safe endpoints with no flow and no unknown 62.5% 10 / 16 labelled safe endpoints with a Forge rule
    Safe endpoints with a flow finding 0% 0 / 16 labelled safe endpoints with a Forge rule
    Safe endpoints where Forge only says unknown 37.5% 6 / 16 labelled safe endpoints with a Forge rule
    Safe endpoints whose only unknown findings have no data path (an Unknown record on a shared sink function) 31.3% 5 / 16 labelled safe endpoints with a Forge rule
    WebGoat lesson packages with at least one labelled endpoint 31.4% 11 / 35 lesson packages (org/owasp/webgoat/lessons/*) in the analysed classes

    Cases by status: 6 differs, 41 identical, 2 unsupported.

    • 49 endpoint classes in 11 of WebGoat’s lesson packages: SQL injection (CWE-89), command injection (CWE-78), path traversal (CWE-22), XXE (CWE-611), insecure deserialization (CWE-502), SSRF (CWE-918), XSS (CWE-79) and open redirect (CWE-601, no Forge rule: counted unsupported). A subset of the lessons’ endpoints, not WebGoat’s full set of flaws; client-side lessons, authentication and crypto lessons are out of scope.
    • A finding belongs to a case when its source (a request parameter, header or body) is in the case’s class; the sink may be in a helper elsewhere in the lesson package.
    • Lessons are analysed one package at a time (shared container classes are analysed with each): taint cannot cross lessons, but can cross classes of one lesson.
    • No WebGoat instance is started; nothing is executed.
    Case Status Expected label Keryn verdict
    commandinjection/CommandInjectionTask1 differs safe Unknown
    openredirect/OpenRedirectRealRedirect unsupported vulnerable No rule
    openredirect/OpenRedirectSecureController unsupported safe No rule
    sqlinjection/SqlInjectionChallengeLogin differs safe Unknown
    sqlinjection/SqlInjectionLesson10a differs safe Unknown
    sqlinjection/SqlInjectionLesson13 differs safe Unknown
    sqlinjection/SqlInjectionLesson6b differs safe Unknown
    sqlinjection/SqlInjectionQuiz differs safe Unknown
    Show every case
    Case Status Expected label Keryn verdict
    challenges/Assignment5 identical vulnerable Flow found
    commandinjection/CommandInjectionSafetyGate identical safe Clean
    commandinjection/CommandInjectionTask1 differs safe Unknown
    commandinjection/CommandInjectionTask2 identical vulnerable Flow found
    commandinjection/CommandInjectionTask3Flag identical safe Clean
    commandinjection/CommandInjectionTask3Search identical vulnerable Flow found
    commandinjection/CommandInjectionTask4Key identical safe Clean
    commandinjection/CommandInjectionTask4Search identical vulnerable Flow found
    commandinjection/CommandInjectionTask5Evaluation identical safe Clean
    deserialization/InsecureDeserializationTask identical vulnerable Flow found
    jwt/JWTHeaderJKUEndpoint identical vulnerable Flow found
    jwt/JWTHeaderKIDEndpoint identical vulnerable Flow found
    openredirect/OpenRedirectRealRedirect unsupported vulnerable No rule
    openredirect/OpenRedirectSecureController unsupported safe No rule
    pathtraversal/ProfileUpload identical vulnerable Flow found
    pathtraversal/ProfileUploadFix identical vulnerable Flow found
    pathtraversal/ProfileUploadRemoveUserInput identical vulnerable Flow found
    pathtraversal/ProfileUploadRetrieval identical vulnerable Flow found
    pathtraversal/ProfileZipSlip identical vulnerable Flow found
    sqlinjection/Servers identical vulnerable Flow found
    sqlinjection/SqlInjectionChallenge identical vulnerable Flow found
    sqlinjection/SqlInjectionChallengeLogin differs safe Unknown
    sqlinjection/SqlInjectionLesson10 identical vulnerable Flow found
    sqlinjection/SqlInjectionLesson10a differs safe Unknown
    sqlinjection/SqlInjectionLesson13 differs safe Unknown
    sqlinjection/SqlInjectionLesson2 identical vulnerable Flow found
    sqlinjection/SqlInjectionLesson3 identical vulnerable Flow found
    sqlinjection/SqlInjectionLesson4 identical vulnerable Flow found
    sqlinjection/SqlInjectionLesson5 identical vulnerable Flow found
    sqlinjection/SqlInjectionLesson5a identical vulnerable Flow found
    sqlinjection/SqlInjectionLesson5b identical vulnerable Flow found
    sqlinjection/SqlInjectionLesson6a identical vulnerable Flow found
    sqlinjection/SqlInjectionLesson6b differs safe Unknown
    sqlinjection/SqlInjectionLesson8 identical vulnerable Flow found
    sqlinjection/SqlInjectionLesson9 identical vulnerable Flow found
    sqlinjection/SqlInjectionQuiz differs safe Unknown
    sqlinjection/SqlOnlyInputValidation identical vulnerable Flow found
    sqlinjection/SqlOnlyInputValidationOnKeywords identical vulnerable Flow found
    ssrf/SSRFTask1 identical safe Clean
    ssrf/SSRFTask2 identical safe Clean
    vulnerablecomponents/VulnerableComponentsLesson identical vulnerable Flow found
    xss/CrossSiteScriptingLesson1 identical safe Clean
    xss/CrossSiteScriptingLesson5a identical vulnerable Flow found
    xss/CrossSiteScriptingLesson6a identical safe Clean
    xss/DOMCrossSiteScriptingVerifier identical safe Clean
    xss/StoredCrossSiteScriptingVerifier identical safe Clean
    xxe/BlindSendFileAssignment identical vulnerable Flow found
    xxe/ContentTypeAssignment identical vulnerable Flow found
    xxe/SimpleXXE identical vulnerable Flow found