Staff Machine Learning Operations Engineer

How you'll make an impact:

• Review and refine test plans to ensure that all critical AI/ML functionalities are rigorously tested 
• Reproduce defects in a controlled test environment, track down their sources, and work with engineers to resolve them 
• Develop, maintain, and improve automated test suites for AI/ML models and data pipelines 
• Validate AI models under various conditions, including edge cases and high-load scenarios 
• Ensure data integrity across training, validation, and production pipelines 
• Work closely with software and AI engineers to define testing requirements and improve model reliability 
• Maintain clear documentation of test plans, issues found, and resolutions implemented 

What we're looking for:

• Minimum of 7 years of experience in software quality assurance, with at least 2+ years focused on AI/ML testing 
• Strong knowledge of test automation frameworks (e.g., PyTest) 
• Experience with AI/ML model validation and testing techniques 
• Proficiency in Python and familiarity with machine learning libraries (e.g., TensorFlow, PyTorch) 
• Hands-on experience with CI/CD pipelines and automated testing in DevOps environments 
• Ability to analyze logs, trace errors, and conduct thorough root cause analysis 
• Strong problem-solving skills and attention to detail 
• Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related field 

Preferred Qualifications:

• Experience working with cloud-based AI/ML platforms (AWS SageMaker, Azure ML, GCP AI) 
• Experience with large-scale distributed AI systems and performance benchmarking 
• Knowledge of MLOps best practices and model monitoring