As an Analyst on the Compute Responsible AI Trusted Experience team, you will partner closely with our Platforms and Devices product partners, as well as other teams across Google, to gather requirements, assess user risks, and plan and implement mitigation strategies to ensure a thriving, safe GenAI and Agentic AI ecosystem. In addition, you will collaborate cross-functionally to design, implement, and optimize safety workflows that secure users’ trust across a dimension of Google products and their integrations with external services like Model Context Protocol (MCP) connectors. This responsibility encompasses the design and implementation of effective run-time monitoring and analysis to ensure ongoing safety and address emerging trends.Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
US: $116000 - $166000 (USD) + 15% bonus target + equity + benefits
Learn more about benefits at Google.
Responsibilities
- Collaborate closely with product, engineering, policy, and Responsible AI experts to scope GenAI and Agentic AI testing requirements in support of Google’s Platforms and Devices products.
- Design and enhance operational workflows via process improvements and automation opportunities.
- Partner cross-functionally to define and build runtime monitoring capabilities that identify "agentic drift," recursive loops, or adversarial attempts to hijack agent reasoning.
- Analyze model and safety filter outputs to identify user safety trends, recommend risk mitigations, and handle leadership escalations. Apply technical and user-safety judgment to triage user trust risks and enhance overall product trust.
- Work with sensitive content or situations and may be exposed to graphic, controversial or upsetting topics or content.
Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 4 years of experience in program or project management, specifically in managing and defining project scope, identifying and tracking risks.
- 2 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.
Preferred qualifications:
- 5 years of data analysis experience with databases and querying languages (e.g., SQL, MySQL, MapReduce).
- Experience working on Large Language Models (LLMs) or experience analyzing ML or LLM model performance.
- Proven experience analyzing product policy and identifying policy risks.
- Demonstrated success in risk management across project and organizational levels.
- Collaborative and creative leader experienced in presenting to executive leadership and cross-functional, global teams.
- Strong problem-solving, critical thinking, and communication skills to bridge technical and non-technical teams.