NIST, Develop Evaluations And Benchmarks For Assessing Chemical And Biological Capabilities Of AI Models, Request for Information (RFI), Due: Nov 13, 2024

[opencode4good]

NIST, Develop Evaluations And Benchmarks For Assessing Chemical And Biological Capabilities Of AI Modelsl, Request for Information (RFI)

• Posted: Oct 25, 2024
• Deadline: Nov 13, 2024
• Funding Institution: U.S. Department of Commerce, National Institute of Standards and Technology (NIST)
• Description: The U.S. AI Safety Institute (AISI), housed within the National Institute of Standards and Technology, was created to respond to the priorities assigned to NIST under the Executive Order. AISI is advancing the science, practice, and adoption of AI safety across the spectrum of risks. As part of this mandate, AISI is conducting pre-deployment testing, evaluation, validation, and verification (TEVV) on frontier models of chemical and biological capabilities and risks.3 In doing so, AISI seeks to ensure that its projects, evaluations, and tools reflect the best available science, and to coordinate closely with a diverse set of Al stakeholders who are developing and conducting evaluations to assess chemical or biological capabilities and risks.
  • NIST is performing market research to identify qualified Contractors for an anticipated contract to assist in developing evaluations and benchmarks of AI models' relevant chemical and biological capabilities and risks.
  • The Contractor must provide or develop resources for various aspects of assessing frontier Al model chemical and biological capabilities and risks.
• Link: https://sam.gov/opp/03797b011bbb4a75ac925ac96a43f926/view