최신자료
Toward Comprehensive Benchmarking of the Biological Knowledge of Frontier Large Language Models
Artificial intelligence (AI) systems demonstrate deep knowledge across a broad variety of scientific domains, including biology and chemistry, and bad actors could misuse some of these systems to develop biological or chemical weapons.
The constant development of more-capable models necessitates rapid evaluation mechanisms for governments to respond to emerging security risks in a timely manner. Policymakers, industry experts, and third-party evaluators lack a cohesive standard for testing AI systems‘ safety levels. These challenges complicate efforts to determine the degree to which frontier AI systems pose biological or chemical risks.
The authors evaluate the utility of misusing frontier AI systems to these ends. The authors focus on custom-tuned versions of open-weight AI models that can be modified to remove safety guardrails and/or potentially increase biological capabilities. For this report, the authors evaluated 39 of the most-capable models (as of May 2025) against six public biological and chemical knowledge benchmarks and two refusal benchmarks relevant to biological and chemical threats.
The constant development of more-capable models necessitates rapid evaluation mechanisms for governments to respond to emerging security risks in a timely manner. Policymakers, industry experts, and third-party evaluators lack a cohesive standard for testing AI systems‘ safety levels. These challenges complicate efforts to determine the degree to which frontier AI systems pose biological or chemical risks.
The authors evaluate the utility of misusing frontier AI systems to these ends. The authors focus on custom-tuned versions of open-weight AI models that can be modified to remove safety guardrails and/or potentially increase biological capabilities. For this report, the authors evaluated 39 of the most-capable models (as of May 2025) against six public biological and chemical knowledge benchmarks and two refusal benchmarks relevant to biological and chemical threats.
많이 본 자료
![[2025.07] 대출규제](/userdata/main/incContent/sideLink/23/aaaqQGcnBTcOc8zW9uLNz20251015165742zqfnw.png)
![[사람이 되고 싶어요2] 환율의 변화](/userdata/main/incContent/sideLink/22/aaaqQGcnBTcOc8zW9uLNz20251015165408vtzoa.jpg)
