社区安全报告与青少年新保护措施

ChatGPT 是全球使用最广泛的 AI 产品之一，我们投入大量资源，打造了业内一些最先进的系统，用于检测潜在危害、审查令人担忧的活动，并上报可信的威胁。为进一步推进这方面的工作，我们宣布两项举措：发布一份新的《社区安全保障报告》，并进一步限制未成年人接触枪支相关内容。ChatGPT is one of the world’s most widely used AI products, and we have invested in building some of the industry’s most advanced systems for detecting potential harm, reviewing concerning activity, and escalating credible threats. We’re making two announcements to further our work in this area: a new Community Safeguards Report and more restrictions around firearms content for minors.

保障社区安全始终是 OpenAI 的首要任务之一。我们的工作包括将迫在眉睫的暴力威胁告知执法部门，并且我们在 2026 年第三季度向执法部门转介了 200 多起案件。这些转介正在对瓦解暴力阴谋产生积极（在新窗口中打开）的影响（在新窗口中打开），我们也继续依靠心理健康和行为专家帮助我们评估棘手案件。Keeping communities safe⁠ continues to be a top priority for OpenAI. Our work includes bringing imminent threats of violence to the attention of law enforcement, and we made over 200 law enforcement referrals in Q3 2026. These referrals are making a positive⁠(opens in a new window) difference⁠(opens in a new window) in disrupting violent plots, and we continue to rely on mental health and behavioral experts to help us assess difficult cases.

我们认识到，人工智能公司与执法部门、家庭成员、心理健康专业人士和政策制定者各自承担着不同的角色；他们拥有至关重要的权威、背景信息和现实影响力。我们致力于充分发挥自身作用，不断强化系统、分享经验，并与最有能力在现实世界中采取行动的人直接合作。We recognize AI companies have a distinct role to play alongside law enforcement, family members, mental-health professionals, and policymakers, who bring critical authority, context and real-world reach. We are committed to making the most of that role by continuously strengthening our systems, sharing what we learn, and working directly with those who are best positioned to act in the real world.

我们不断加强各项措施，努力保护个人和社区。这意味着建立完善的防护机制，同时公开说明这些机制的成效以及我们为改进它们所做的工作。我们希望让人们清楚了解我们的做法、我们的模型如何识别并应对有害行为、我们在实际应用中发现的风险，以及我们为解决这些风险所采取的措施。We are constantly strengthening the steps we take to help protect people and communities. That means building strong safeguards, and also being transparent about how well they work and what we’re doing to enhance them. We want to give people a clear picture of our approach, how our models identify and respond to harmful behavior, the risks we see in practice, and the steps we take to address them.

我们承诺发布《社区安全报告》，介绍暴力预防及其他社区安全问题，以及我们各项防护措施的有效性。报告将说明我们如何训练系统来检测、调查和应对社区安全问题。我们将分享匿名案例，展示与暴力相关的伤害如何表现以及我们从中学到了什么，重点介绍新的缓解措施和政策变更，并提供相关数据作为这些发现的依据。We’re committing to launch the Community Safety Report on violence prevention and other community safety issues, and the effectiveness of our safeguards. The report will explain how we train our systems to detect, investigate, and respond to community safety issues. We’ll share anonymized examples of how violence-related harm manifests and what we’re learning, highlight new mitigations and policy changes, and include relevant data to support these findings.

我们将在 2027 年初发布首份报告，涵盖 2026 年下半年，此后每六个月更新一次。我们承诺分享有实质意义的发现，说明我们如何识别、审核和应对可能有害的内容。We will publish our first report in early 2027, covering the second half of 2026, with updates every six months thereafter. Our commitment is to share meaningful findings about how we identify, review, and respond to potentially harmful content.

我们的模型经过训练，不会提供帮助他人策划或实施暴力的指示。现在，我们进一步限制 ChatGPT 对有关过往大规模袭击及实施袭击者的问题的回答，即使其他在线来源提供了相关信息，模型在这些方面也会提供较少的细节。人们应该能够请 ChatGPT 帮助他们了解这些事件、受害者和社区受到的影响，并学习识别预警信号和预防未来的暴力事件。但我们正在收紧政策，限制对过往大规模袭击的重现，包括有关所用武器和装备及其获取方式的细节，以及可能提高袭击者恶名的伤害规模详细比较。无论用户年龄多大，也无论提问的原因是什么，这些限制都适用。Our models are trained to not give instructions that would help someone plan or carry out violence. We’re now placing additional restrictions on how ChatGPT responds to questions about past mass attacks and the people who carried them out, directing the model to provide less detailed information in those areas even if it is available from other online sources. People should be able to ask ChatGPT to help them understand these events, how victims and communities were impacted, and learn about recognizing warning signs and preventing future violence. But we’re tightening our policies to restrict reconstructions of past mass attacks, including details about the weapons and equipment used and how they were obtained, and detailed comparisons on scale of harm that could amplify an attacker’s notoriety. These limits apply regardless of a user’s age or reason for asking.

有时，单独看似乎很普通的请求，结合之前的对话，就会有不同的含义。5 月，我们分享了 ChatGPT 如何利用对早期警示迹象的简短事实摘要，在之后的聊天中更谨慎地作出回应。我们正在此基础上继续推进：当近期聊天显示可能存在暴力倾向的警示迹象时，ChatGPT 在分享可能被滥用的信息时会采取更为审慎的做法。我们也在努力将这些更严格的限制应用于我们预测年龄未满 18 岁的用户，即使他们的聊天中没有暴力意图的迹象。Sometimes a request that seems ordinary on its own takes on a different meaning in light of an earlier conversation. In May, we shared how ChatGPT can use short, factual summaries⁠ of earlier warning signs to respond more carefully in a later chat. We’re building on that work so that when recent chats show warning signs of possible violence, ChatGPT will respond more conservatively when sharing information that could be misused. We’re also working to apply those stricter limits when we predict someone is under 18, even if their chats show no signs of violent intent.

我们会封禁经判定违反暴力活动相关政策的账户。我们还在与心理健康和暴力预防领域的专家合作，探索更多自动化方式，以便更早介入。当对话显示出某人正执着于暴力或严重伤害他人的想法时，ChatGPT 将能够自动结束聊天，以及时打断这种模式。如果 ChatGPT 因此结束了多次聊天，我们可能会暂时暂停该账户。这是一项持续进行的工作；我们会继续加强并投入资源，完善技术和实际防护措施，包括如何可靠地识别警示信号，以及确定何时、如何介入。We ban accounts that we determine have violated our policies on violent activity⁠. We’re also working with mental health and violence prevention experts on additional, automated ways to intervene earlier. When a conversation shows signs that someone is fixating on violence or the idea of seriously harming another person, ChatGPT will be able to automatically end the chat to interrupt that pattern in the moment. If ChatGPT ends multiple chats for that reason, we may temporarily pause the account. This is an ongoing effort and we continue to strengthen and invest in technical and practical protections, including how to recognize warning signs reliably and determine when and how to intervene.

面向青少年的 ChatGPT⁠ 会为未满 18 岁的用户采取适龄防护措施，通过更严格的保护和额外限制，减少他们接触敏感内容的机会。现在，我们进一步限制青少年能够获取的武器相关信息，即使问题看起来无害也是如此。ChatGPT for Teens⁠ applies age-appropriate safeguards for users under 18, with stronger protections and additional limits to reduce exposure to sensitive content. We’re now placing further limits on weapons-related information teens can receive, even when a question appears harmless. 

我们的政策已经禁止协助任何人策划或实施暴力，也限制协助青少年寻找或获取武器。我们将进一步加强这些保护措施，限制提供有关武器和安保系统的实用信息，以免这些信息被滥用于助长暴力，即使没有迹象表明对方有暴力意图。青少年仍可使用 ChatGPT 来预防和缓和暴力、寻求支持，并联系值得信赖的成年人。Our policies already prohibit helping anyone plan or carry out violence and restrict helping teens find or obtain weapons. We’re extending those protections to restrict practical information about weapons and security systems that could be misused to facilitate violence, even when there’s no sign of violent intent. Teens can still use ChatGPT to help prevent and de-escalate violence, seek support, and connect with a trusted adult. 

我们去年推出了年龄预测功能，该功能会分析行为模式等多种信号，以估算用户是否未满或已满18岁。我们强化了年龄预测系统，使其能够在用户使用 ChatGPT 时持续评估新的信号，并在适当情况下将青少年转入未满18岁用户体验。被错误地转入未满18岁用户体验的用户，始终可以通过我们的年龄验证合作伙伴 Persona，以快捷且保护隐私的方式确认自己已成年，并解除额外的青少年保护措施。We launched age prediction⁠ last year, which analyzes multiple signals such as behavior patterns to estimate whether a user may be under or over 18. We strengthened our age prediction system to continually assess new signals as people use ChatGPT and move teens into the under 18 experience when appropriate. Users who are incorrectly placed in the under 18 experience will always have a fast, privacy-protective way to confirm they are adults and have additional teen protections removed through Persona, our age verification partner. 

我们的家长控制功能允许家长将自己的 ChatGPT 账户与青少年的账户关联，并共同管理安全设置。关联账户包含安全提醒：当经过专门培训的审核人员发现严重的自我伤害风险，或发现可能与饮食失调有关的行为时，系统可能会发送提醒。今年 7 月，我们扩展了提醒功能：如果青少年的账户因违反我们的暴力相关使用政策而被停用，家长也会收到通知。正如上文所述，我们正在努力推出相关通知，以便在我们因青少年反复讨论暴力而暂停其账户时通知家长。Our parental controls⁠ let parents link their ChatGPT accounts to their teens and manage safety settings together. Linked accounts include safety alerts⁠ that may be sent when specially trained reviewers identify a serious self-harm concern and behaviors that may be associated with disordered eating. In July, we expanded those alerts to notify parents if their teen’s account has been deactivated for violating our usage policies on violence. We are working to introduce notifications for parents if we pause their teen’s account for repeatedly discussing violence, as detailed above.

现实世界中的暴力事件令人心碎，也错综复杂，往往由多种因素共同造成。这些事件也鲜明地提醒我们，必须持续设计并迭代我们的系统，以应对人类行为本质上复杂的现实。要在 AI 系统中建立有效的暴力防护机制，就必须解决如何识别风险并作出恰当应对等全新问题。我们将继续投入资源、不断迭代，并分享经验，探索如何最好地落实我们正在推进的保护措施。此处详述的防护措施将在未来几周内开始逐步推出，我们也将持续完善。我们始终致力于降低 ChatGPT 中的伤害风险、强化多层防护、监控滥用行为、执行相关规则，并在情况需要时引入现实世界中的支持与干预。Acts of real-world violence are heartbreaking and complex, with many contributing factors. They are also a stark reminder that we must continue designing and iterating our systems to account for the inherently complicated realities of human behavior. Developing effective violence safeguards in AI systems requires solving novel problems in recognizing risk and responding appropriately, and we will continue to invest in, iterate, and share learnings  on how best to implement the protections we’re pursuing. The safeguards detailed here will begin rolling out in the next few weeks and we will continue to refine them. We remain committed to mitigating risks of harm in ChatGPT, strengthening our layered protections, monitoring for misuse, enforcing our rules, and involving real-world support and interventions when situations call for it.