+SA-11 Developer Testing and Evaluation
---+SA-11(01) Static Code Analysis
---+SA-11(02) Threat Modeling and Vulnerability Analyses
---+SA-11(03) Independent Verification of Assessment Plans and Evidence
---+SA-11(04) Manual Code Reviews
---+SA-11(05) Penetration Testing
---+SA-11(06) Attack Surface Reviews
---+SA-11(07) Verify Scope of Testing and Evaluation
---+SA-11(08) Dynamic Code Analysis
---+SA-11(09) Interactive Application Security Testing

SA-11 Developer Testing and Evaluation

Control

Require the developer of the system, system component, or system service, at all post-design stages of the system development life cycle, to:
  1. Develop and implement a plan for ongoing security and privacy control assessments;
  2. Perform [Selection(one-or-more): unit; integration; system; regression] testing/evaluation [Assignement: frequency to conduct] at [Assignement: depth and coverage];
  3. Produce evidence of the execution of the assessment plan and the results of the testing and evaluation;
  4. Implement a verifiable flaw remediation process; and
  5. Correct flaws identified during testing and evaluation.

Discussion

Developmental testing and evaluation confirms that the required controls are implemented correctly, operating as intended, enforcing the desired security and privacy policies, and meeting established security and privacy requirements. Security properties of systems and the privacy of individuals may be affected by the interconnection of system components or changes to those components. The interconnections or changes—including upgrading or replacing applications, operating systems, and firmware—may adversely affect previously implemented controls. Ongoing assessment during development allows for additional types of testing and evaluation that developers can conduct to reduce or eliminate potential flaws. Testing custom software applications may require approaches such as manual code review, security architecture review, and penetration testing, as well as and static analysis, dynamic analysis, binary analysis, or a hybrid of the three analysis approaches. Developers can use the analysis approaches, along with security instrumentation and fuzzing, in a variety of tools and in source code reviews. The security and privacy assessment plans include the specific activities that developers plan to carry out, including the types of analyses, testing, evaluation, and reviews of software and firmware components; the degree of rigor to be applied; the frequency of the ongoing testing and evaluation; and the types of artifacts produced during those processes. The depth of testing and evaluation refers to the rigor and level of detail associated with the assessment process. The coverage of testing and evaluation refers to the scope (i.e., number and type) of the artifacts included in the assessment process. Contracts specify the acceptance criteria for security and privacy assessment plans, flaw remediation processes, and the evidence that the plans and processes have been diligently applied. Methods for reviewing and protecting assessment plans, evidence, and documentation are commensurate with the security category or classification level of the system. Contracts may specify protection requirements for documentation.

Assessment Objective

    1. the developer of the system, system component, or system service is required at all post-design stages of the system development life cycle to develop a plan for ongoing security assessments;
    2. the developer of the system, system component, or system service is required at all post-design stages of the system development life cycle to implement a plan for ongoing security assessments;
    3. the developer of the system, system component, or system service is required at all post-design stages of the system development life cycle to develop a plan for privacy assessments;
    4. the developer of the system, system component, or system service is required at all post-design stages of the system development life cycle to implement a plan for ongoing privacy assessments;
  2. the developer of the system, system component, or system service is required at all post-design stages of the system development life cycle to perform [Selection(one-or-more): unit; integration; system; regression] testing/evaluation [Assignement: frequency to conduct] at [Assignement: depth and coverage];
    1. the developer of the system, system component, or system service is required at all post-design stages of the system development life cycle to produce evidence of the execution of the assessment plan;
    2. the developer of the system, system component, or system service is required at all post-design stages of the system development life cycle to produce the results of the testing and evaluation;
  4. the developer of the system, system component, or system service is required at all post-design stages of the system development life cycle to implement a verifiable flaw remediation process;
  5. the developer of the system, system component, or system service is required at all post-design stages of the system development life cycle to correct flaws identified during testing and evaluation.

Assessment Method

Examine

System and services acquisition policy system and services acquisition procedures procedures addressing system developer security and privacy testing procedures addressing flaw remediation solicitation documentation acquisition documentation service level agreements acquisition contracts for the system, system component, or system service security and privacy architecture system design documentation system developer security and privacy assessment plans results of developer security and privacy assessments for the system, system component, or system service security and privacy flaw and remediation tracking records system security plan privacy plan privacy impact assessment privacy risk assessment documentation other relevant documents or records

Interview

Organizational personnel with system and service acquisition responsibilities organizational personnel with information security and privacy responsibilities organizational personnel with developer security and privacy testing responsibilities system developers

1. Přehled

SA-11(01) Static Code Analysis

Control

Require the developer of the system, system component, or system service to employ static code analysis tools to identify common flaws and document the results of the analysis.

Discussion

Static code analysis provides a technology and methodology for security reviews and includes checking for weaknesses in the code as well as for the incorporation of libraries or other included code with known vulnerabilities or that are out-of-date and not supported. Static code analysis can be used to identify vulnerabilities and enforce secure coding practices. It is most effective when used early in the development process, when each code change can automatically be scanned for potential weaknesses. Static code analysis can provide clear remediation guidance and identify defects for developers to fix. Evidence of the correct implementation of static analysis can include aggregate defect density for critical defect types, evidence that defects were inspected by developers or security professionals, and evidence that defects were remediated. A high density of ignored findings, commonly referred to as false positives, indicates a potential problem with the analysis process or the analysis tool. In such cases, organizations weigh the validity of the evidence against evidence from other sources.

Assessment Objective

  1. the developer of the system, system component, or system service is required to employ static code analysis tools to identify common flaws;
  2. the developer of the system, system component, or system service is required to employ static code analysis tools to document the results of the analysis.

Assessment Method

Examine

System and services acquisition policy system and services acquisition procedures procedures addressing system developer security testing procedures addressing flaw remediation solicitation documentation acquisition documentation service level agreements acquisition contracts for the system, system component, or system service security and privacy architecture system design documentation system developer security and privacy assessment plans results of system developer security and privacy assessments security flaw and remediation tracking records system security plan privacy plan privacy impact assessment privacy risk assessment documentation other relevant documents or records

Interview

Organizational personnel with system and service acquisition responsibilities organizational personnel with information security responsibilities organizational personnel with developer security and privacy testing responsibilities organizational personnel with configuration management responsibilities system developers
SA-11(02) Threat Modeling and Vulnerability Analyses

Control

Require the developer of the system, system component, or system service to perform threat modeling and vulnerability analyses during development and the subsequent testing and evaluation of the system, component, or service that:
  1. Uses the following contextual information: [Assignement: information];
  2. Employs the following tools and methods: [Assignement: tools and methods];
  3. Conducts the modeling and analyses at the following level of rigor: [Assignement: organization-defined breadth and depth of modeling and analyses] ; and
  4. Produces evidence that meets the following acceptance criteria: [Assignement: organization-defined acceptance criteria].

Discussion

Systems, system components, and system services may deviate significantly from the functional and design specifications created during the requirements and design stages of the system development life cycle. Therefore, updates to threat modeling and vulnerability analyses of those systems, system components, and system services during development and prior to delivery are critical to the effective operation of those systems, components, and services. Threat modeling and vulnerability analyses at this stage of the system development life cycle ensure that design and implementation changes have been accounted for and that vulnerabilities created because of those changes have been reviewed and mitigated.

Assessment Objective

    1. the developer of the system, system component, or system service is required to perform threat modeling during development of the system, component, or service that uses [Assignement: information];
    2. the developer of the system, system component, or system service is required to perform vulnerability analyses during development of the system, component, or service that uses [Assignement: information];
    3. the developer of the system, system component, or system service is required to perform threat modeling during the subsequent testing and evaluation of the system, component, or service that uses [Assignement: information];
    4. the developer of the system, system component, or system service is required to perform vulnerability analyses during the subsequent testing and evaluation of the system, component, or service that uses [Assignement: information];
    1. the developer of the system, system component, or system service is required to perform threat modeling during development of the system, component, or service that employs [Assignement: tools and methods];
    2. the developer of the system, system component, or system service is required to perform threat modeling during the subsequent testing and evaluation of the system, component, or service that employs [Assignement: tools and methods];
    3. the developer of the system, system component, or system service is required to perform vulnerability analyses during development of the system, component, or service that employs [Assignement: tools and methods];
    4. the developer of the system, system component, or system service is required to perform vulnerability analyses during the subsequent testing and evaluation of the system, component, or service that employs [Assignement: tools and methods];
    1. the developer of the system, system component, or system service is required to perform threat modeling at [Assignement: breadth and depth] during development of the system, component, or service;
    2. the developer of the system, system component, or system service is required to perform vulnerability analyses during the subsequent testing and evaluation of the system, component, or service that conducts modeling and analyses at [Assignement: breadth and depth];
    1. the developer of the system, system component, or system service is required to perform threat modeling during development of the system, component, or service that produces evidence that meets [Assignement: acceptance criteria];
    2. the developer of the system, system component, or system service is required to perform threat modeling during the subsequent testing and evaluation of the system, component, or service that produces evidence that meets [Assignement: acceptance criteria];
    3. the developer of the system, system component, or system service is required to perform vulnerability analyses during development of the system, component, or service that produces evidence that meets [Assignement: acceptance criteria];
    4. the developer of the system, system component, or system service is required to perform vulnerability analyses during the subsequent testing and evaluation of the system, component, or service that produces evidence that meets [Assignement: acceptance criteria].

Assessment Method

Examine

System and services acquisition policy procedures addressing system developer security testing solicitation documentation acquisition documentation service level agreements acquisition contracts for the system, system component, or system service system developer security test plans records of developer security testing results for the system, system component, or system service vulnerability scanning results system risk assessment reports threat and vulnerability analysis reports system security plan supply chain risk management plan other relevant documents or records

Interview

Organizational personnel with system and service acquisition responsibilities organizational personnel with information security responsibilities organizational personnel with developer security testing responsibilities system developers organizational personnel with supply chain risk management responsibilities
SA-11(03) Independent Verification of Assessment Plans and Evidence

Control

  1. Require an independent agent satisfying [Assignement: independence criteria] to verify the correct implementation of the developer security and privacy assessment plans and the evidence produced during testing and evaluation; and
  2. Verify that the independent agent is provided with sufficient information to complete the verification process or granted the authority to obtain such information.

Discussion

Independent agents have the qualifications—including the expertise, skills, training, certifications, and experience—to verify the correct implementation of developer security and privacy assessment plans.

Assessment Objective

    1. an independent agent is required to satisfy [Assignement: independence criteria] to verify the correct implementation of the developer security assessment plan and the evidence produced during testing and evaluation;
    2. an independent agent is required to satisfy [Assignement: independence criteria] to verify the correct implementation of the developer privacy assessment plan and the evidence produced during testing and evaluation;
  2. the independent agent is provided with sufficient information to complete the verification process or granted the authority to obtain such information.

Assessment Method

Examine

System and services acquisition policy system and services acquisition procedures procedures addressing system developer security testing solicitation documentation acquisition documentation service level agreements acquisition contracts for the system, system component, or system service independent verification and validation reports security and privacy assessment plans results of security and privacy assessments for the system, system component, or system service system security plan privacy plan privacy program plan other relevant documents or records

Interview

Organizational personnel with system and service acquisition responsibilities organizational personnel with information security and privacy responsibilities organizational personnel with developer security testing responsibilities system developers independent verification agent
SA-11(04) Manual Code Reviews

Control

Require the developer of the system, system component, or system service to perform a manual code review of [Assignement: specific code] using the following processes, procedures, and/or techniques: [Assignement: processes, procedures, and/or techniques].

Discussion

Manual code reviews are usually reserved for the critical software and firmware components of systems. Manual code reviews are effective at identifying weaknesses that require knowledge of the application’s requirements or context that, in most cases, is unavailable to automated analytic tools and techniques, such as static and dynamic analysis. The benefits of manual code review include the ability to verify access control matrices against application controls and review detailed aspects of cryptographic implementations and controls.

Assessment Objective

the developer of the system, system component, or system service is required to perform a manual code review of [Assignement: specific code] using [Assignement: processes, procedures, and/or techniques].

Assessment Method

Examine

System and services acquisition policy procedures addressing system developer security testing processes, procedures, and/or techniques for performing manual code reviews solicitation documentation acquisition documentation service level agreements acquisition contracts for the system, system component, or system service system developer security testing and evaluation plans system developer security testing and evaluation results list of code requiring manual reviews records of manual code reviews system security plan other relevant documents or records

Interview

Organizational personnel with system and service acquisition responsibilities organizational personnel with information security responsibilities organizational personnel with developer security testing responsibilities system developers independent verification agent
SA-11(05) Penetration Testing

Control

Require the developer of the system, system component, or system service to perform penetration testing:
  1. At the following level of rigor: [Assignement: organization-defined breadth and depth of testing] ; and
  2. Under the following constraints: [Assignement: constraints].

Discussion

Penetration testing is an assessment methodology in which assessors, using all available information technology product or system documentation and working under specific constraints, attempt to circumvent the implemented security and privacy features of information technology products and systems. Useful information for assessors who conduct penetration testing includes product and system design specifications, source code, and administrator and operator manuals. Penetration testing can include white-box, gray-box, or black-box testing with analyses performed by skilled professionals who simulate adversary actions. The objective of penetration testing is to discover vulnerabilities in systems, system components, and services that result from implementation errors, configuration faults, or other operational weaknesses or deficiencies. Penetration tests can be performed in conjunction with automated and manual code reviews to provide a greater level of analysis than would ordinarily be possible. When user session information and other personally identifiable information is captured or recorded during penetration testing, such information is handled appropriately to protect privacy.

Assessment Objective

    1. the developer of the system, system component, or system service is required to perform penetration testing at the following level of rigor: [Assignement: breadth];
    2. the developer of the system, system component, or system service is required to perform penetration testing at the following level of rigor: [Assignement: depth];
  2. the developer of the system, system component, or system service is required to perform penetration testing under [Assignement: constraints].

Assessment Method

Examine

System and services acquisition policy system and services acquisition procedures procedures addressing system developer security testing solicitation documentation acquisition documentation service level agreements acquisition contracts for the system, system component, or system service system developer penetration testing and evaluation plans system developer penetration testing and evaluation results system security plan privacy plan personally identifiable information processing policy other relevant documents or records

Interview

Organizational personnel with system and service acquisition responsibilities organizational personnel with information security and privacy responsibilities organizational personnel with developer security testing responsibilities system developers independent verification agent
SA-11(06) Attack Surface Reviews

Control

Require the developer of the system, system component, or system service to perform attack surface reviews.

Discussion

Attack surfaces of systems and system components are exposed areas that make those systems more vulnerable to attacks. Attack surfaces include any accessible areas where weaknesses or deficiencies in the hardware, software, and firmware components provide opportunities for adversaries to exploit vulnerabilities. Attack surface reviews ensure that developers analyze the design and implementation changes to systems and mitigate attack vectors generated as a result of the changes. The correction of identified flaws includes deprecation of unsafe functions.

Assessment Objective

the developer of the system, system component, or system service is required to perform attack surface reviews.

Assessment Method

Examine

System and services acquisition policy procedures addressing system developer security testing solicitation documentation acquisition documentation service level agreements acquisition contracts for the system, system component, or system service system developer security testing and evaluation plans system developer security testing and evaluation results records of attack surface reviews system security plan other relevant documents or records

Interview

Organizational personnel with system and service acquisition responsibilities organizational personnel with information security responsibilities organizational personnel with developer security testing responsibilities organizational personnel with configuration management responsibilities system developers
SA-11(07) Verify Scope of Testing and Evaluation

Control

Require the developer of the system, system component, or system service to verify that the scope of testing and evaluation provides complete coverage of the required controls at the following level of rigor: [Assignement: organization-defined breadth and depth of testing and evaluation].

Discussion

Verifying that testing and evaluation provides complete coverage of required controls can be accomplished by a variety of analytic techniques ranging from informal to formal. Each of these techniques provides an increasing level of assurance that corresponds to the degree of formality of the analysis. Rigorously demonstrating control coverage at the highest levels of assurance can be achieved using formal modeling and analysis techniques, including correlation between control implementation and corresponding test cases.

Assessment Objective

  1. the developer of the system, system component, or system service is required to verify that the scope of testing and evaluation provides complete coverage of the required controls at [Assignement: breadth];
  2. the developer of the system, system component, or system service is required to verify that the scope of testing and evaluation provides complete coverage of the required controls at [Assignement: depth].

Assessment Method

Examine

System and services acquisition policy procedures addressing system developer security testing solicitation documentation acquisition documentation service level agreements acquisition contracts for the system, system component, or system service system developer security testing and evaluation plans system developer security testing and evaluation results system security plan other relevant documents or records

Interview

Organizational personnel with system and service acquisition responsibilities organizational personnel with information security responsibilities organizational personnel with developer security testing responsibilities system developers independent verification agent
SA-11(08) Dynamic Code Analysis

Control

Require the developer of the system, system component, or system service to employ dynamic code analysis tools to identify common flaws and document the results of the analysis.

Discussion

Dynamic code analysis provides runtime verification of software programs using tools capable of monitoring programs for memory corruption, user privilege issues, and other potential security problems. Dynamic code analysis employs runtime tools to ensure that security functionality performs in the way it was designed. A type of dynamic analysis, known as fuzz testing, induces program failures by deliberately introducing malformed or random data into software programs. Fuzz testing strategies are derived from the intended use of applications and the functional and design specifications for the applications. To understand the scope of dynamic code analysis and the assurance provided, organizations may also consider conducting code coverage analysis (i.e., checking the degree to which the code has been tested using metrics such as percent of subroutines tested or percent of program statements called during execution of the test suite) and/or concordance analysis (i.e., checking for words that are out of place in software code, such as non-English language words or derogatory terms).

Assessment Objective

  1. the developer of the system, system component, or system service is required to employ dynamic code analysis tools to identify common flaws;
  2. the developer of the system, system component, or system service is required to document the results of the analysis.

Assessment Method

Examine

System and services acquisition policy procedures addressing system developer security testing procedures addressing flaw remediation solicitation documentation acquisition documentation service level agreements acquisition contracts for the system, system component, or system service system developer security test and evaluation plans security test and evaluation results security flaw and remediation tracking reports system security plan other relevant documents or records

Interview

Organizational personnel with system and service acquisition responsibilities organizational personnel with information security responsibilities organizational personnel with developer security testing responsibilities organizational personnel with configuration management responsibilities system developers
SA-11(09) Interactive Application Security Testing

Control

Require the developer of the system, system component, or system service to employ interactive application security testing tools to identify flaws and document the results.

Discussion

Interactive (also known as instrumentation-based) application security testing is a method of detecting vulnerabilities by observing applications as they run during testing. The use of instrumentation relies on direct measurements of the actual running applications and uses access to the code, user interaction, libraries, frameworks, backend connections, and configurations to directly measure control effectiveness. When combined with analysis techniques, interactive application security testing can identify a broad range of potential vulnerabilities and confirm control effectiveness. Instrumentation-based testing works in real time and can be used continuously throughout the system development life cycle.

Assessment Objective

  1. the developer of the system, system component, or system service is required to employ interactive application security testing tools to identify flaws;
  2. the developer of the system, system component, or system service is required to document the results of flaw identification.

Assessment Method

Examine

System and services acquisition policy procedures addressing system developer security testing procedures addressing interactive application security testing solicitation documentation acquisition documentation service level agreements acquisition contracts for the system, system component, or system service system developer security test and evaluation plans security test and evaluation results security flaw and remediation tracking reports system security plan other relevant documents or records

Interview

Organizational personnel with system and service acquisition responsibilities organizational personnel with information security responsibilities organizational personnel with developer security testing responsibilities organizational personnel with configuration management responsibilities system developers

1.1 Odkazy

1.2 Identifikované požadavky

1.3 Související regulace

2. Identifikované požadavky

Požadavky

3. Související regulace

Regulace

Propojené úkoly

Vazby
is blocked by SA-11 Developer Testing and Evaluation – Assessment Procedure
is blocked by Security, Compliance & Resilience Testing Throughout Development