We are seeking a skilled AI Testing Specialist to join our team. The ideal candidate will have experience in testing AI-based applications and systems, with a strong understanding of AI/ML concepts, testing methodologies, and project management skills.
Responsibilities:
Collaborate with the AI test team to plan and execute test plans, test cases, and test scenarios for AI systems.
Implement quality assurance standards to ensure the accuracy, reliability, and performance of AI solutions.
Design and implement benchmarking tests to evaluate AI system performance against industry standards and competitors.
Develop, execute, maintain, and enhance automated test frameworks and scripts dedicated to AI component testing.
Accurately report and track defects and issues related to AI testing, including writing detailed bug reports and verifying fixes in collaboration with the development team
Analyze benchmarking results to identify strengths, weaknesses, and areas for improvement in AI algorithms and models
Expand knowledge in testing deep learning algorithms and model families.
Required Skills
Proficiency in Python and related packages for image processing, data processing, and automation testing.
Familiarity with machine/deep learning frameworks like TensorFlow, Keras, or PyTorch.
Understanding of Software Development Life Cycle (SDLC) and Software Testing Life Cycle (STLC), with a focus on AI-specific testing phases and activities.
Experience in testing AI-driven applications across diverse platforms.
Experience in API testing using tools like Postman.
Knowledge of tools like Neptune, Weights and Biases, PyTorch Ignite, TensorFlow Model Analysis (TFMA), and DeepDetect.
Qualification:
Bachelor’s or Master’s degree in Computer Science, Data Science, Machine Learning, or related fields.
1-3 years of experience in AI testing, deep learning, or quality assurance.
ISTQB Certified Tester.
ISTQB Certified AI Tester.
Preferred Qualifications:
- Proficiency in machine learning pipelines and Continuous Integration/Continuous Deployment (CI/CD) pipelines tailored for AI development and testing workflows.
- Knowledge of advanced image processing algorithms.
- Experience with cloud computing platforms such as AWS or Azure, particularly in the context of testing AI solutions in cloud environments.
- Strong statistical analysis skills to evaluate model performance, validate results, and identify potential issues during AI testing.
