Job VC
Senior Automation Test Engineer/SDET (Playwright + AI)
Technologies
Description
N-iX is looking for
Senior Automation Test Engineer/SDET (Playwright + AI)
to join the team
About the client:
Our client is a cutting-edge, technology focused company that provides a better way of detecting and managing risks that may impact the outcome of clinical trials. Their solutions, all of which are cloud-based, are driven by a unique set of algorithms that interrogate clinical and operational data in real-time centrally to conveniently illuminate outliers and anomalies in data.
The Role:
We are looking for a highly skilled AI Tester with strong Playwright expertise who embraces an AI-First approach to quality engineering. In this role, your primary focus will be testing AI-powered features implemented within the application — ensuring their reliability, accuracy, robustness, explainability, and compliance with product expectations.
While automation remains a critical capability, this role requires a strong understanding of how AI-driven functionality behaves in real-world scenarios, including edge cases, model variability, and prompt-driven outputs.
You will play a key role in validating AI features end-to-end — from requirement analysis and test design to automated validation, exploratory testing, and model behavior analysis — while continuing to leverage AI tools like GitHub Copilot/Codex to accelerate test development.
Responsibilities:
Designing and executing comprehensive test strategies specifically for AI-powered features within the application
Validating AI outputs for accuracy, consistency, edge-case handling, and alignment with business requirements
Designing prompt-based and scenario-driven tests to evaluate model behavior under varied inputs
Defining measurable validation criteria for non-deterministic systems( confidence ranges, tolerance thresholds, expected behavior patterns)
Collaborating with engineering and product teams to improve explainability, observability, and traceability of AI decisions
Ensuring AI features meet quality, compliance, and audit requirements where applicable
Leveraging AI coding assistants (e.g., GitHub Copilot, Codex, or similar tools) to accelerate test development and framework enhancement
Using AI tools to generate high-quality test scenarios from requirements and user stories
Reviewing, validating, and refining AI-generated test code to ensure accuracy, scalability, and maintainability
Contributing to AI-driven test design patterns and reusable automation strategies
Promoting AI-augmented productivity practices within the QA team
Designing, developing, and maintaining scalable Playwright-based automation frameworks for UI, API, and end-to-end testing
Integrating automated test suites into CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins, etc.)
Performing exploratory testing to uncover edge cases, usability gaps, and unexpected system behavior
Required Qualifications:
5+ years of commercial experience in tests automation
Experience testing AI-driven or data-driven systems (LLMs, ML models,rule engines, recommendation systems, NLP-based features, etc.)
Understanding of AI/ML behavior concepts such as prompt variability, non-deterministic outputs, confidence thresholds, bias, hallucinations, and edge-case handling.
Ability to design validation strategies for probabilistic systems where results may not always be binary (pass/fail)
Strong hands-on experience with Playwright automation framework
Proficiency in JavaScript or TypeScript
Demonstrated expertise using GitHub Copilot, Codex, or AI coding assistants as part of daily development workflow
Solid understanding of automation framework architecture and design patterns
Experience integrating automated tests into CI/CD pipelines
Experience with test management tools such as Zephyr, Xray, or similar
Strong understanding of software testing fundamentals (test design techniques, defect lifecycle, risk analysis)
Proven experience in manual and exploratory testing of web applications
Excellent analytical, debugging, and communication skills
Upper-Intermediate/Advanced English level
Nice to have
Experience validating AI systems in regulated environments (auditability, traceability, explainability requirements)
Senior Automation Test Engineer/SDET (Playwright + AI)
to join the team
About the client:
Our client is a cutting-edge, technology focused company that provides a better way of detecting and managing risks that may impact the outcome of clinical trials. Their solutions, all of which are cloud-based, are driven by a unique set of algorithms that interrogate clinical and operational data in real-time centrally to conveniently illuminate outliers and anomalies in data.
The Role:
We are looking for a highly skilled AI Tester with strong Playwright expertise who embraces an AI-First approach to quality engineering. In this role, your primary focus will be testing AI-powered features implemented within the application — ensuring their reliability, accuracy, robustness, explainability, and compliance with product expectations.
While automation remains a critical capability, this role requires a strong understanding of how AI-driven functionality behaves in real-world scenarios, including edge cases, model variability, and prompt-driven outputs.
You will play a key role in validating AI features end-to-end — from requirement analysis and test design to automated validation, exploratory testing, and model behavior analysis — while continuing to leverage AI tools like GitHub Copilot/Codex to accelerate test development.
Responsibilities:
Designing and executing comprehensive test strategies specifically for AI-powered features within the application
Validating AI outputs for accuracy, consistency, edge-case handling, and alignment with business requirements
Designing prompt-based and scenario-driven tests to evaluate model behavior under varied inputs
Defining measurable validation criteria for non-deterministic systems( confidence ranges, tolerance thresholds, expected behavior patterns)
Collaborating with engineering and product teams to improve explainability, observability, and traceability of AI decisions
Ensuring AI features meet quality, compliance, and audit requirements where applicable
Leveraging AI coding assistants (e.g., GitHub Copilot, Codex, or similar tools) to accelerate test development and framework enhancement
Using AI tools to generate high-quality test scenarios from requirements and user stories
Reviewing, validating, and refining AI-generated test code to ensure accuracy, scalability, and maintainability
Contributing to AI-driven test design patterns and reusable automation strategies
Promoting AI-augmented productivity practices within the QA team
Designing, developing, and maintaining scalable Playwright-based automation frameworks for UI, API, and end-to-end testing
Integrating automated test suites into CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins, etc.)
Performing exploratory testing to uncover edge cases, usability gaps, and unexpected system behavior
Required Qualifications:
5+ years of commercial experience in tests automation
Experience testing AI-driven or data-driven systems (LLMs, ML models,rule engines, recommendation systems, NLP-based features, etc.)
Understanding of AI/ML behavior concepts such as prompt variability, non-deterministic outputs, confidence thresholds, bias, hallucinations, and edge-case handling.
Ability to design validation strategies for probabilistic systems where results may not always be binary (pass/fail)
Strong hands-on experience with Playwright automation framework
Proficiency in JavaScript or TypeScript
Demonstrated expertise using GitHub Copilot, Codex, or AI coding assistants as part of daily development workflow
Solid understanding of automation framework architecture and design patterns
Experience integrating automated tests into CI/CD pipelines
Experience with test management tools such as Zephyr, Xray, or similar
Strong understanding of software testing fundamentals (test design techniques, defect lifecycle, risk analysis)
Proven experience in manual and exploratory testing of web applications
Excellent analytical, debugging, and communication skills
Upper-Intermediate/Advanced English level
Nice to have
Experience validating AI systems in regulated environments (auditability, traceability, explainability requirements)