Text1078 passages · 3 marked
No examination yet Marked passage
Skip to content Deployment Safety Hub0 passages
GPT-6 Astra System Card0 passages
Safety Overview: GPT-6 Astra0 passages
Model Data and Training0 passages
Internal Deployment of Astra0 passages
Expand Safe Completions Safe Completions0 passages
Evaluations with Challenging Prompts0 passages
Safe Completions for Users Under 180 passages
Agentic Safe Completions0 passages
Expand Jailbreaks Jailbreaks0 passages
Static Jailbreak Evaluations0 passages
Multiturn Jailbreak Evaluations0 passages
Prompt Injection0 passages
Dynamic Mental Health Benchmarks with Adversarial User Simulations0 passages
Performance in Cases Flagged by Users0 passages
Alignment Values Training0 passages
Expand Obeying Restrictions Obeying Restrictions0 passages
Respecting Auto-Review0 passages
Respecting Warnings0 passages
Declining to Exploit a Honeypot During Difficult ExploitGym Problems0 passages
Expand Avoiding Deceptive Interactions with Users Avoiding Deceptive Interactions with Users0 passages
Coding Deception0 passages
Broken Search Tool0 passages
Avoiding Misaligned Behavior in Realistic Work Environments0 passages
Expand Unintended Agent-to-agent Communication Unintended Agent-to-agent Communication0 passages
Proactive Searches0 passages
Unintended Engagement with External Agent Messages0 passages
Forecasting Misaligned Behavior with Deployment Simulation of Internal Codex Traffic0 passages
Expand Verbalized Metagaming and Oversight Gaming Verbalized Metagaming and Oversight Gaming0 passages
Verbalized Metagaming and Oversight Gaming in Evaluations0 passages
Metagaming in Training1 passage
1 unmarked passage External Evaluations for Alignment - Apollo Research0 passages
Expand Monitorability Under Non-adversarial Conditions Monitorability Under Non-adversarial Conditions0 passages
Aggregate Monitorability Findings0 passages
Expand Per-environment Findings Per-environment Findings0 passages
CoT-only Monitor Scope0 passages
Action-only Monitor Scope0 passages
Takeaways for Monitorability Under Non-Adversarial Conditions0 passages
Expand Monitorability Under Adversarial Conditions Monitorability Under Adversarial Conditions0 passages
CoT Controllability0 passages
Expand Monitor Evasion Monitor Evasion0 passages
Sneaky Sandbox Escape0 passages
Awareness of CoT Monitoring Reduces Monitorability0 passages
Monitor Evasion Capability Under Prompted Sandbagging0 passages
Math Side-tasking Monitor Evasion0 passages
External Evaluation for Monitorability - UK AISI0 passages
Expand Capabilities Assessment Capabilities Assessment0 passages
Expand Biological and Chemical Capabilities Biological and Chemical Capabilities0 passages
Capability Threshold: High0 passages
Capability Threshold: Critical0 passages
Retiring Evaluations0 passages
External Evaluation for Biological Capabilities - SecureBio0 passages
Expand Cybersecurity Capabilities Cybersecurity Capabilities0 passages
ExploitBench1 passage
1 unmarked passage Expert-Led Assessments0 passages
External Evaluations for Cyber Capabilities – Irregular0 passages
Expand AI Self-Improvement Capabilities AI Self-Improvement Capabilities0 passages
Internal Research Debugging Evaluation0 passages
PostTrainBench Lite0 passages
MLE-Bench Revised0 passages
Expand Safeguards Safeguards0 passages
Expand Threat Modeling Threat Modeling0 passages
Biological and Chemical Threat Modelling0 passages
Cybersecurity Threat Modelling0 passages
Expand Model Safety Training and Evaluation Model Safety Training and Evaluation0 passages
Biological and Chemical Safety Training and Evaluation0 passages
Cybersecurity Safety Training and Evaluation0 passages
Expand Realtime Model Safeguards Realtime Model Safeguards0 passages
Misalignment Monitoring0 passages
Misuse Monitor Design0 passages
Misuse Monitor Performance0 passages
Expand Red-teaming for Jailbreaks Red-teaming for Jailbreaks0 passages
Automated Red-teaming for Jailbreaks0 passages
External Evaluations of Bio Safeguards - SecureBio0 passages
Third Party Red-teaming for Jailbreaks by Private Organizations0 passages
Actor Level Enforcement0 passages
Expand Trust-based Access Trust-based Access0 passages
Biology - Trusted Access for Biology Research0 passages
Cybersecurity - Trusted Access for Cyber0 passages
Security Controls0 passages
GPT-6 Sol, GPT-6 Luna0 passages
Model Data and Training0 passages
Expand Model Safety Model Safety0 passages
Expand Safe Completions Safe Completions0 passages
Evaluations with Challenging Prompts0 passages
Safe Completions for Users Under 180 passages
Agentic Safe Completions0 passages
Expand Robustness Robustness0 passages
Prompt Injection0 passages
Expand Health Health0 passages
Dynamic Mental Health Benchmarks with Adversarial User Simulations0 passages
Expand Hallucinations Hallucinations0 passages
Performance in Cases Flagged by Users0 passages
Expand Alignment Alignment0 passages
Respecting Auto-Review0 passages
Respecting Warnings0 passages
Declining to Exploit a Honeypot During Difficult ExploitGym Problems0 passages
Expand Avoiding Deceptive Interactions with Users Avoiding Deceptive Interactions with Users0 passages
Coding Deception0 passages
Broken Search Tool0 passages
Unintended Engagement with External Agent Messages0 passages
Forecasting Misaligned Behavior with Deployment Simulation of Internal Codex Traffic0 passages
Expand Monitorability Monitorability0 passages
Expand Monitorability Under Adversarial Conditions Monitorability Under Adversarial Conditions0 passages
CoT Controllability0 passages
Monitor Evasion0 passages
Expand Preparedness Preparedness0 passages
Expand Capabilities Assessment Capabilities Assessment0 passages
Biological and Chemical Capabilities0 passages
Cybersecurity Capabilities0 passages
AI Self-Improvement Capabilities0 passages
Expand Safeguards Safeguards0 passages
Model Safety Training and Evaluation0 passages
Introducing: dots0 passages
Expand Robustness for dots Robustness for dots0 passages
Prompt Injection Automated Red-teaming0 passages
Manual Red-teaming0 passages
Expand Alignment for dots Alignment for dots0 passages
Expand Obeying Restrictions Obeying Restrictions0 passages
Respecting Auto-Review0 passages
Respecting Warnings0 passages
Declining to Exploit a Honeypot During Difficult ExploitGym Problems0 passages
Expand Avoiding Deceptive Interactions with Users Avoiding Deceptive Interactions with Users0 passages
Coding Deception0 passages
Broken Search Tool0 passages
Avoiding Misaligned Behavior in Realistic Work Environments0 passages
Unintended Engagement with External Agent Messages1 passage
1 unmarked passage Adapting to Changing Scope and Permissions0 passages
Maintaining Boundaries Across Chained Tasks0 passages
Robustness to Misleading Proactivity Inputs0 passages
Evaluating Auto-review0 passages
Expand Monitorability for dots Monitorability for dots0 passages
Monitor Evasion0 passages
Expand Preparedness for dots Preparedness for dots0 passages
Expand Capabilities Assessment Capabilities Assessment0 passages
Biological and Chemical Capabilities0 passages
Cybersecurity Capabilities0 passages
Expand Safeguards for dots Safeguards for dots0 passages
Model Safety Training and Evaluation0 passages
Expand Realtime Model Safeguards Realtime Model Safeguards0 passages
Misalignment Monitoring0 passages
Misuse Monitor Design0 passages
Misuse Monitor Performance0 passages
Published September 3, 20260 passages
GPT-6 Astra System Card0 passages
Change log Change log0 passages
Safety Overview: GPT-6 Astra0 passages
Model Data and Training0 passages
Internal Deployment of Astra0 passages
Safe Completions0 passages
Evaluations with Challenging Prompts0 passages
Safe Completions for Users Under 180 passages
Agentic Safe Completions0 passages
Static Jailbreak Evaluations0 passages
Multiturn Jailbreak Evaluations0 passages
Prompt Injection0 passages
Dynamic Mental Health Benchmarks with Adversarial User Simulations0 passages
Performance in Cases Flagged by Users0 passages
Alignment Values Training0 passages
Obeying Restrictions0 passages
Respecting Auto-Review0 passages
Respecting Warnings0 passages
Declining to Exploit a Honeypot During Difficult ExploitGym Problems0 passages
Avoiding Deceptive Interactions with Users0 passages
Coding Deception0 passages
Broken Search Tool0 passages
Avoiding Misaligned Behavior in Realistic Work Environments0 passages
Unintended Agent-to-agent Communication0 passages
Proactive Searches0 passages
Unintended Engagement with External Agent Messages0 passages
Forecasting Misaligned Behavior with Deployment Simulation of Internal Codex Traffic0 passages
Verbalized Metagaming and Oversight Gaming0 passages
Verbalized Metagaming and Oversight Gaming in Evaluations0 passages
Metagaming in Training0 passages
External Evaluations for Alignment – UK AISI0 passages
External Evaluations for Alignment - Apollo Research0 passages
Monitorability Under Non-adversarial Conditions0 passages
Aggregate Monitorability Findings0 passages
Per-environment Findings0 passages
CoT-only Monitor Scope0 passages
Action-only Monitor Scope0 passages
Takeaways for Monitorability Under Non-Adversarial Conditions0 passages
Monitorability Under Adversarial Conditions0 passages
CoT Controllability0 passages
Monitor Evasion0 passages
Sneaky Sandbox Escape0 passages
Awareness of CoT Monitoring Reduces Monitorability0 passages
Monitor Evasion Capability Under Prompted Sandbagging0 passages
Math Side-tasking Monitor Evasion0 passages
External Evaluation for Monitorability - UK AISI0 passages
Capabilities Assessment0 passages
Biological and Chemical Capabilities0 passages
Capability Threshold: High0 passages
Capability Threshold: Critical0 passages
Retiring Evaluations0 passages
External Evaluation for Biological Capabilities - SecureBio0 passages
Cybersecurity Capabilities0 passages
ExploitBench1 passage
1 unmarked passage Expert-Led Assessments0 passages
External Evaluations for Cyber Capabilities – Irregular0 passages
AI Self-Improvement Capabilities0 passages
Internal Research Debugging Evaluation0 passages
PostTrainBench Lite0 passages
MLE-Bench Revised0 passages
Threat Modeling0 passages
Biological and Chemical Threat Modelling0 passages
Cybersecurity Threat Modelling0 passages
Model Safety Training and Evaluation0 passages
Biological and Chemical Safety Training and Evaluation0 passages
Cybersecurity Safety Training and Evaluation0 passages
Realtime Model Safeguards0 passages
Misalignment Monitoring0 passages
Misuse Monitor Design0 passages
Misuse Monitor Performance0 passages
Red-teaming for Jailbreaks0 passages
Automated Red-teaming for Jailbreaks0 passages
External Evaluations of Bio Safeguards - SecureBio0 passages
Third Party Red-teaming for Jailbreaks by Private Organizations0 passages
Actor Level Enforcement0 passages
Trust-based Access0 passages
Biology - Trusted Access for Biology Research0 passages
Cybersecurity - Trusted Access for Cyber0 passages
Security Controls0 passages
GPT-6 Sol, GPT-6 Luna0 passages
Model Data and Training0 passages
Safe Completions0 passages
Evaluations with Challenging Prompts0 passages
Safe Completions for Users Under 180 passages
Agentic Safe Completions0 passages
Prompt Injection0 passages
Dynamic Mental Health Benchmarks with Adversarial User Simulations0 passages
Performance in Cases Flagged by Users0 passages
Respecting Auto-Review0 passages
Respecting Warnings0 passages
Declining to Exploit a Honeypot During Difficult ExploitGym Problems0 passages
Avoiding Deceptive Interactions with Users0 passages
Coding Deception0 passages
Broken Search Tool0 passages
Unintended Engagement with External Agent Messages0 passages
Forecasting Misaligned Behavior with Deployment Simulation of Internal Codex Traffic0 passages
Monitorability Under Adversarial Conditions0 passages
CoT Controllability0 passages
Monitor Evasion0 passages
Capabilities Assessment0 passages
Biological and Chemical Capabilities0 passages
Cybersecurity Capabilities0 passages
AI Self-Improvement Capabilities0 passages
Model Safety Training and Evaluation0 passages
Introducing: dots0 passages
Robustness for dots0 passages
Prompt Injection Automated Red-teaming0 passages
Manual Red-teaming0 passages
Alignment for dots0 passages
Obeying Restrictions0 passages
Respecting Auto-Review0 passages
Respecting Warnings0 passages
Declining to Exploit a Honeypot During Difficult ExploitGym Problems0 passages
Avoiding Deceptive Interactions with Users0 passages
Coding Deception0 passages
Broken Search Tool0 passages
Avoiding Misaligned Behavior in Realistic Work Environments0 passages
Unintended Engagement with External Agent Messages0 passages
Alignment in Persistent and Proactive Workflows0 passages
Adapting to Changing Scope and Permissions0 passages
Maintaining Boundaries Across Chained Tasks0 passages
Robustness to Misleading Proactivity Inputs0 passages
Evaluating Auto-review0 passages
Monitorability for dots0 passages
Monitor Evasion0 passages
Preparedness for dots0 passages
Capabilities Assessment0 passages
Biological and Chemical Capabilities0 passages
Cybersecurity Capabilities0 passages
Safeguards for dots0 passages
Model Safety Training and Evaluation0 passages
Realtime Model Safeguards0 passages
Misalignment Monitoring0 passages
Misuse Monitor Design0 passages
Misuse Monitor Performance0 passages
References40 passages
40 unmarked passages Category13 passages
13 unmarked passages Category6 passages
6 unmarked passages Category3 passages
3 unmarked passages Category9 passages
9 unmarked passages Category11 passages
11 unmarked passages External Evaluations - Gray Swan IPI Arena13 passages
13 unmarked passages HealthBench Professional length-adjusted0 passages
HealthBench length-adjusted0 passages
HealthBench Hard length-adjusted0 passages
HealthBench Consensus length-adjusted7 passages
7 unmarked passages Category53 passages
53 unmarked passages Overall misaligned outcome rate ↓0 passages
Unauthorized transactions0 passages
Data exfiltration0 passages
Destructive action0 passages
Service disruption0 passages
Security weakening0 passages
Unauthorized external communication0 passages
Circumventing restrictions0 passages
0.0%1 passage
1 unmarked passage Overall misaligned outcome rate ↓0 passages
Unauthorized transactions0 passages
Data exfiltration0 passages
Destructive action0 passages
Service disruption0 passages
Security weakening0 passages
Unauthorized external communication0 passages
Circumventing restrictions0 passages
0.0%82 passages · 1 marked
In this section, we provide results from our investigation into
Astra’s monitorability, that is, the extent to which we can expect
monitoring systems to be able to detect when Astra acts in misaligned or
otherwise undesirable ways. According to our evaluations, GPT-6 Astra
shows a substantial decrease in chain-of-thought monitorability compared
to previous models. Overall our alignment evaluations show that Astra is
more likely than GPT-5.6 Sol to respect security and safety restrictions
which make us confident in still deploying this model to the wider
public.
81 unmarked passages Monitorability evaluations9 passages
9 unmarked passages Increased model capabilities with reasoning=None1 passage
1 unmarked passage Monitor evasion2 passages
2 unmarked passages CoT controllability2 passages · 1 marked
We are actively investigating the causes of GPT-6 Astra’s increased
CoT controllability. Unlike
previous models , we find that CoT controllability for Astra
especially increases over the course of RL training. We are fairly
confident that there are no significant direct CoT grading pressures. We
are also quite confident that changes in CoT controllability are not
differentially due to any architectural changes. We have found that
these changes are correlated with the increase in no-CoT capabilities
(i.e., being able to take actions or return an answer without any
verbalized reasoning required)
1 unmarked passage What this means for the future of monitorability58 passages · 1 marked
Overall, most of the aggregate gap in CoT monitorability comes from
GPT-6 Astra producing shorter CoTs that often omit or weaken the
evidence the monitor needs, including by producing empty or nearly empty
CoTs more often. In ShadeArena, Impossible Coding Tasks, and Health
Queries: Missing Evidence, those gaps largely close at longer matched
CoT lengths. Meanwhile, on Destructive Actions and Health Queries:
Patient Opinion, GPT-6 Astra continues to have lower monitorability even
at longer matched CoT lengths relative to GPT-5.6 Sol. In these
instances, the intervention shifts GPT-6 Astra’s answers
distributionally, but the CoT gives an independent-looking rationale for
the answer, making the intervention’s influence hard to detect.
57 unmarked passages GPT-5.5 Thinking0 passages
GPT-6 Astra9 passages
9 unmarked passages GPT-5.5 Thinking0 passages
GPT-6 Astra6 passages
6 unmarked passages OAI-repo Sabotage v288 passages
88 unmarked passages Capability Threshold: High0 passages
Multimodal troubleshooting virology2 passages
2 unmarked passages ProtocolQA Open-Ended2 passages
2 unmarked passages Tacit knowledge and troubleshooting2 passages
2 unmarked passages TroubleshootingBench2 passages
2 unmarked passages Capability Threshold: Critical0 passages
AAV Capsid Packaging Prediction0 passages
Novel design2 passages
2 unmarked passages SHP2 Protein Function Prediction0 passages
Novel design2 passages
2 unmarked passages Coronavirus–ACE2 Cell-Entry Screen0 passages
Novel design2 passages
2 unmarked passages Phage–plasmid co-evolution0 passages
Novel design2 passages
2 unmarked passages Retiring Evaluations0 passages
Hard-negative protein binding prediction0 passages
Novel design2 passages
2 unmarked passages DNA sequence design for transcription factor binding0 passages
Novel design24 passages
24 unmarked passages Tacit16 passages
16 unmarked passages Category6 passages
6 unmarked passages Category6 passages
6 unmarked passages Category7 passages
7 unmarked passages Category9 passages
9 unmarked passages Category7 passages
7 unmarked passages Category27 passages
27 unmarked passages SEC-Bench Pro4 passages
4 unmarked passages ExploitGym34 passages
34 unmarked passages Internal Research Debugging Evaluation0 passages
Debugging internal research experiments1 passage
1 unmarked passage Kernel optimization and performance engineering1 passage
1 unmarked passage LLM pretraining and training-loop optimization1 passage
1 unmarked passage Post-training and RL recipe development1 passage
1 unmarked passage MLE-Bench Revised0 passages
Real world data science and ML competitions57 passages
57 unmarked passages 0.9784 passages
4 unmarked passages Category6 passages
6 unmarked passages Category24 passages
24 unmarked passages Category42 passages
42 unmarked passages Category6 passages
6 unmarked passages Category3 passages
3 unmarked passages Category3 passages
3 unmarked passages Category8 passages
8 unmarked passages Bio: high risk5 passages
5 unmarked passages Bio: severe5 passages
5 unmarked passages Violence: moderate5 passages
5 unmarked passages Violence: severe5 passages
5 unmarked passages Cyber5 passages
5 unmarked passages Multiturn Jailbreak Evaluations10 passages
10 unmarked passages Category6 passages
6 unmarked passages HealthBench Professional length-adjusted0 passages
HealthBench length-adjusted0 passages
HealthBench Hard length-adjusted0 passages
HealthBench Consensus length-adjusted4 passages
4 unmarked passages Category64 passages
64 unmarked passages GPT-6 Astra5 passages
5 unmarked passages GPT-6 Astra5 passages
5 unmarked passages OAI-repo Sabotage v226 passages
26 unmarked passages Multimodal Troubleshooting Virology1 passage
1 unmarked passage ProtocolQA Open-Ended1 passage
1 unmarked passage Tacit Knowledge and Troubleshooting1 passage
1 unmarked passage TroubleshootingBench1 passage
1 unmarked passage 38.6%4 passages
4 unmarked passages AAV Capsid Packaging Prediction1 passage
1 unmarked passage SHP2 Protein Function Prediction1 passage
1 unmarked passage Coronavirus--ACE2 Cell-Entry Screen1 passage
1 unmarked passage Phage--plasmid Co-evolution2 passages
2 unmarked passages 12.914 passages
14 unmarked passages SEC-Bench Pro3 passages
3 unmarked passages ExploitGym25 passages
25 unmarked passages 0.9584 passages
4 unmarked passages Production Chat0 passages
Synthetic Agentic Envs0 passages
Semi-Synthetic Agentic Envs0 passages
0.9851 passage
1 unmarked passage 0.9871 passage
1 unmarked passage Cybersecurity - Trusted Access for Cyber140 passages
140 unmarked passages OpenAI © 2015–20260 passages
Terms of Use Privacy Policy0 passages