Amazon
Quality Analyst, Prime Video Trust & Safety
Amazon, Lakeville, Minnesota, United States, 55044
Quality Analyst, Prime Video Trust & Safety
Our overall mission is simple: To be Earth’s most customer-centric company. We want Amazon to be the place where our customers can find, discover and buy anything online. With your help, Amazon will deliver world class AI generated experiences to our customers.Prime Video is looking for a Machine Learning Quality Analyst who will have responsibility to assess the output produced by content moderators and machine learning models, assessing the quality and providing vital insights to program, operations, and science teams to improve moderator and machine learning models quality.The role will require you to be a leader who prioritizes supporting the organization and ensuring defects do not persist. Your role will be to help set and oversee the quality standards of the data the team produces. You will define metrics, identify external signals, and build processes to reduce risk across the programs you support. You will consolidate large data sets into simplified insights that drive business growth and reduce risk.You will also be responsible for producing reports that show the quality assessments completed by the quality team as well as conducting data analysis to identify key drivers and insights that may be reducing the effectiveness of the models’ outputs. You will produce reports and evidence backed by data and present these findings to science, engineering and program teams.Key job responsibilities
LeadershipKnows and communicates Amazon's mission, vision and strategyInterfacing with diverse stakeholders such as, Program leadership, Operations leads, Technology teams, BusinessAbility to confidently facilitate team discussions and communicate business messagesCan adapt well to changing circumstances, direction, and strategyDemonstrates the ability to give overall direction, performance, coordination and evaluationStrong interpersonal and communication skills, good listener, used to interact with up to Director levelAbility to organize, prioritize and schedule work assignmentsExperience managing core business KPI’sOperational DeliveryUnderstands operational principles of service delivery and uses data to support continuous improvementGathering requirements and delivering complete data solutions to drive insights and flag risks to Quality, Program, and OperationsLeading complex analytical deep dives to identify potential process gapsBuilding metrics to analyze key inputs for risk detection and defect reductionRecognizing and adopting best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentationContinuous ImprovementUses data to identify areas of ongoing improvement in how content compliance and risk is managedFeedback Loop: Continuously communicate with the model development team to provide insights and observations regarding content moderation challenges, and potential improvements for the ML model's performanceData Integrity: Ensure the accuracy and integrity of the audited data by performing regular quality checks, identifying and addressing inconsistencies, and maintaining a high standard of data cleanlinessAdaptation: Keep up-to-date with the latest content policy trends, customer expectations, language requirements, to adapt to audit strategies and guidelines accordinglyA day in the lifeThis is an individual contributor (IC) role focused on quality assessments and data insights for the program, operations, and quality teams to action and drive improvement.You will provide reports that include the outcome and quality assessment of the audit and present findings, trends, and insights to business and science teams to improve the models training.BASIC QUALIFICATIONS
- 1+ years of tax, finance or a related analytical field experience- 1+ years of business or financial analysis experience- Bachelor's degree or equivalent- Experience with Excel- Experience with SQL- Experience defining requirements and using data and metrics to draw business insights- Experience making business recommendations and influencing stakeholdersPREFERRED QUALIFICATIONS
- 5+ years of Excel (including VBA, pivot tables, array functions, power pivots, etc.) and data visualization tools such as Tableau experience- Demonstrated ability to collaborate with technical and non-technical cross-functional partners- Ability to influence senior leaders and stakeholders- Prior experience in a risk organization- Prior trust & safety risk detection- Clear and effective verbal and written communication skills
#J-18808-Ljbffr
Our overall mission is simple: To be Earth’s most customer-centric company. We want Amazon to be the place where our customers can find, discover and buy anything online. With your help, Amazon will deliver world class AI generated experiences to our customers.Prime Video is looking for a Machine Learning Quality Analyst who will have responsibility to assess the output produced by content moderators and machine learning models, assessing the quality and providing vital insights to program, operations, and science teams to improve moderator and machine learning models quality.The role will require you to be a leader who prioritizes supporting the organization and ensuring defects do not persist. Your role will be to help set and oversee the quality standards of the data the team produces. You will define metrics, identify external signals, and build processes to reduce risk across the programs you support. You will consolidate large data sets into simplified insights that drive business growth and reduce risk.You will also be responsible for producing reports that show the quality assessments completed by the quality team as well as conducting data analysis to identify key drivers and insights that may be reducing the effectiveness of the models’ outputs. You will produce reports and evidence backed by data and present these findings to science, engineering and program teams.Key job responsibilities
LeadershipKnows and communicates Amazon's mission, vision and strategyInterfacing with diverse stakeholders such as, Program leadership, Operations leads, Technology teams, BusinessAbility to confidently facilitate team discussions and communicate business messagesCan adapt well to changing circumstances, direction, and strategyDemonstrates the ability to give overall direction, performance, coordination and evaluationStrong interpersonal and communication skills, good listener, used to interact with up to Director levelAbility to organize, prioritize and schedule work assignmentsExperience managing core business KPI’sOperational DeliveryUnderstands operational principles of service delivery and uses data to support continuous improvementGathering requirements and delivering complete data solutions to drive insights and flag risks to Quality, Program, and OperationsLeading complex analytical deep dives to identify potential process gapsBuilding metrics to analyze key inputs for risk detection and defect reductionRecognizing and adopting best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentationContinuous ImprovementUses data to identify areas of ongoing improvement in how content compliance and risk is managedFeedback Loop: Continuously communicate with the model development team to provide insights and observations regarding content moderation challenges, and potential improvements for the ML model's performanceData Integrity: Ensure the accuracy and integrity of the audited data by performing regular quality checks, identifying and addressing inconsistencies, and maintaining a high standard of data cleanlinessAdaptation: Keep up-to-date with the latest content policy trends, customer expectations, language requirements, to adapt to audit strategies and guidelines accordinglyA day in the lifeThis is an individual contributor (IC) role focused on quality assessments and data insights for the program, operations, and quality teams to action and drive improvement.You will provide reports that include the outcome and quality assessment of the audit and present findings, trends, and insights to business and science teams to improve the models training.BASIC QUALIFICATIONS
- 1+ years of tax, finance or a related analytical field experience- 1+ years of business or financial analysis experience- Bachelor's degree or equivalent- Experience with Excel- Experience with SQL- Experience defining requirements and using data and metrics to draw business insights- Experience making business recommendations and influencing stakeholdersPREFERRED QUALIFICATIONS
- 5+ years of Excel (including VBA, pivot tables, array functions, power pivots, etc.) and data visualization tools such as Tableau experience- Demonstrated ability to collaborate with technical and non-technical cross-functional partners- Ability to influence senior leaders and stakeholders- Prior experience in a risk organization- Prior trust & safety risk detection- Clear and effective verbal and written communication skills
#J-18808-Ljbffr