Principal Engineer, Safety Rapid Response, Safety AI Systems

Why Safety?

At Roblox, we strive to connect a billion people with optimism and civility, and the Safety organization’s mission is to become the leader in civil immersive online communities. We systematically and proactively work to detect, remove, and prevent problematic content and behavior. We seek to influence and shape the product roadmap and prioritization, build safety products, and measure our impact on the community of users and developers. In doing so, we help keep Roblox safe, civil, and inclusive, fostering positive relationships between people around the world.

Why Safety AI Systems?

As a Principal Rapid Response Engineer for Safety AI Systems, you will drive immense social impact through rapid responses to safety incidents and emerging trends at scale. You will leverage innovative large-scale AI solutions to deliver immediate impact, measured in hours and days, to counter safety harms and risks across the Roblox platform. You’ll provide technical leadership and partnership across Roblox’s Safety AI product engineering, tooling, operations, and policy functions. 

In this role, you will apply ML solutions to safety rapid response. You will update our advanced ML models to detect emergent patterns of safety violations, leveraging repeatable training pipelines. You will operate and enhance AI-powered safety tools leveraging multi-modal (text, image, video, behavioral, game context) detection strategies to detect and mitigate emergent safety violations, from real-time text filtering at scale to large language models for cutting-edge content moderation.

You will collaborate closely with product managers, policy experts, data scientists, and Trust & Safety operations, often wearing a product & operations hat yourself. Together, you'll build and operate industry leading large-scale safety AI tools to understand complex user behaviors and implement interventions that mitigate abuse and harassment.

You’ll take ownership of safety AI tools and operate them at massive scale. Setting the standard and establishing best practices for Roblox and other online platforms, you will feel a deep sense of responsibility in protecting our users – thoughtfully and fairly – while carefully balancing user freedom with platform civility.

Your efforts will help make Roblox a safer and more inclusive environment where our community can express themselves and share experiences without fear. The Safety team’s work helps protect our community every day.

You Will

• Own the vision, direction, and execution of the safety rapid-response tools and technical operations for safety incidents, detecting and mitigating emergent patterns of violations at scale.
  
  
• Lead and grow a high-performing team of rapid-response engineers, fostering a culture of Safety 24x7 vigilance and resilience, at the intersection of SRE, SecOps, MLOps, DataOps, and DevOps, for the Trust & Safety domain.
  
  
• Respond to emerging safety threats in hours & days, not weeks, by rapidly adapting and deploying the existing safety systems and ML models. 
• In-take human insights (policy and new patterns) into Safety AI pipelines that can be rapidly scaled in production. 
• Retrain / fine-tune the existing ML models based on emerging patterns and samples, including AI-driven synthetic data generation. 
• Run large-scale scans, review precision/recall tradeoffs, adjust model operating points, and execute cleanup.
• Write and execute scripts, queries, and automations to catch & clean up violative content using safety AI tools. 
  
  
• Proactively engineer and improve rapid-response tools and systems
• Create and maintain a library of rapid-response toolkits and playbooks, in collaboration with product engineering teams. 
• Partner with policy, operations, and product to implement guardrails and ensure responses balance speed, accuracy, and fairness.
• Create flexible dashboards, monitoring hooks, and config-driven rapid-response systems. 
• Monitor safety metrics and community reactions at scale, to identify regressions and incidents, drive continuous improvements.

You Have

• 8+ years of experience with large-scale SRE, SecOps, MLOps, DataOps, or DevOps systems and operations in production environments.
  
  
• Proven track record of designing, developing, and launching rapid-response systems into production.
  
  
• 2+ years of hands-on experience using large language models or other AI/ML model technologies including prompt engineering & fine-tuning.
  
  
• Expertise in solving complex MLOps, data pipeline, and infrastructure challenges – with a focus on high velocity & quality at scale.
  
  
• Ability to thrive in ambiguity: you excel at bringing clarity and direction to undefined or open-ended problem spaces.
  
  
• Demonstrated success collaborating across functions (e.g. Product, Design, Data, Research, Ops), working together to drive meaningful business and user impact.
  
  
• Strong safety sense: able to establish clear success metrics and craft strategic roadmaps to achieve those goals.
  
  
• High emotional intelligence: adept at resolving conflicts, mentoring engineers, and nurturing the growth of your team members.
  
  
• Experience with modern microservice architectures and distributed systems paradigms (e.g. cloud services, scalable data pipelines, real time monitoring).
  
  
• Hands-on mindset: a willingness to dive into code/architecture reviews across the Roblox tech stacks, in addition to high-level planning.

You Are

• Creative and strategic problem-solver: able to distill complex issues into simple, innovative solutions that drive impact.
  
  
• An owner: you take responsibility for projects and outcomes end-to-end, and instill the same accountability in your team.
  
  
• A starter & scaler: you are good at going from 0 -> 1 and exceptional at going from 1 -> 100.
  
  
• A lifelong learner: constantly seeking new knowledge and techniques to grow your expertise and expand your impact.
  
  
• Independent and self-directed: capable of charting a course with minimal guidance, and comfortable making decisions in uncertain situations.
  
  
• Highly collaborative: effective at working with cross-functional partners and teams, and skilled at building consensus.
  
  
• Committed to diversity & inclusion: dedicated to fostering a workplace where everyone feels valued, supported, and able to contribute.
  
  
• Passionate about cutting-edge AI / ML tech: knowledgeable about the latest advances in AI and excited to apply these technologies to keep users safe.