Test Engineering

Role Summary

Test Engineering

. Implement automated testing across

o Functional Testing

o API Testing

o Ul Testing

o Integration Testing

o Regression Testing

o Performance Testing

o Security Testing

. Integrate automated testing into CI/CD pipelines.

. Improve automation coverage and reduce manual testing effort.

. Analyze test failures and drive root-cause resolution.

Enterprise Application Testing

. Validate complex business workflows and enterprise application functionality.

. Develop comprehensive test plans, test cases, and test scenarios.

. Ensure requirements are testable and traceable throughout the development lifecycle.

. Perform exploratory, system, integration, and end-to-end testing.

. Verify software meets functional and non-functional requirements.

Cloud-Native Quality Assurance

. Test cloud-native applications running within Microsoft Azure.

. Validate reliability, scalability, resiliency, and fault-tolerance requirements.

. Verify integrations across distributed systems, APIs, messaging platforms, and databases.

. Ensure applications meet enterprise security, compliance, and operational standards.

. Participate in release validation and production-readiness assessments.

Al & Intelligent Application Testing

. Support testing of Al-powered product capabilities.

. Validate outputs from Generative Al and Large Language Model (LLM) integrations.

• Develop test strategies for:

o Al Chatbots

o Al Assistants

o Al Agents

o Retrieval-Augmented Generation (RAG) Solutions

o Intelligent Search Experiences

. Evaluate Al output quality, consistency, accuracy, and reliability.

. Support Responsible Al practices including fairness, transparency, and governance.

. Partner with Al engineers to establish Al evaluation methodologies and testing

Frameworks.

DevOps & Continuous Testing

. Integrate quality gates into CI/CD pipelines.

. Develop automated validation processes for software releases.

. Support infrastructure validation and deployment testing.

. Monitor quality metrics and test coverage.

. Contribute to DevSecOps and continuous delivery initiatives.

Expertise in one or more of

. Playwright

• Selenium

. Cypress

. Puppeteer

Experience with

• . Test automation architecture
• . Automated regression testing
• . CI/CD-based test execution
• . Automated reporting and dashboards
• API Testing

Experience with

. REST APIs

. Postman

• Swagger/OpenAPI

. Automated API validation

. Contract testing

. Integration testing

Programming & Scripting

. .NET

• . Python
• . JavaScript / TypeScript
• . PowerShell

Ability to develop maintainable automation frameworks and supporting utilities.

Performance & Security Testing

Experience with

• . Load testing tools
• . Performance test design
• . API performance validation
• . Security testing fundamentals
• . Vulnerability assessment processes
• Microsoft Azure Experience

Working knowledge of

. Azure App Services

. Azure Functions

. Azure Kubernetes Service (AKS)

. Azure SQL Database

. Azure Cosmos DB

• Azure Storage

. Azure API Management

. Azure DevOps

. Azure Monitor

. Application Insights

. Azure Entra ID

Ability to test applications operating in cloud-native Azure environments.

DevOps & CI/CD Experience

Experience with

• . Azure DevOps Pipelines
• . GitHub Actions
• . Automated build and deployment pipelines
• . Test execution within CI/CD workflows
• . Quality gates and release validation processes
• Al Knowledge

Working knowledge of

• . Generative Al concepts
• . Large Language Models (LLMs)
• . Prompt engineering fundamentals
• . Al-assisted software development
• . Al quality evaluation techniques
• . Al Agents and agentic workflows
• . Retrieval-Augmented Generation (RAG)
• . Azure OpenAl Service
• . Azure Al Search
• . Responsible Al principles
• Understanding of the unique testing challenges associated with Al-generated outputs,

probabilistic systems, hallucinations, grounding, and Al governance.

Responsibilities

Quality Engineering Leadership

• . Serve as a senior member of the engineering organization responsible for establishing
• and promoting quality engineering best practices.
• . Define quality standards, testing strategies, and automation frameworks across product
• teams.
• . Drive shift-left testing practices throughout the software development lifecycle.
• . Participate in architecture, design, and requirements reviews to identify quality risks early.
• . Mentor QA engineers and developers on testing and quality engineering practices.
• . Advocate for continuous improvement and quality-first development culture.

Test Automation

. Design, develop, and maintain robust automated test frameworks and test suites.

Requirements

Education

• . Bachelor's degree in Computer Science, Software Engineering, Information Technology, or
• a related field.
• . Equivalent professional experience will be considered.
• . 7+ years of software quality assurance experience.
• . 5+ years of hands-on automated testing experience.
• . Experience supporting enterprise-scale software products.
• . Experience working within Agile and Scrum delivery environments.
• . Experience collaborating directly with development teams throughout the SDLC.
• Required Technical Skills
• Test Automation

Preferred Qualifications

• . ISTQB Advanced Certification
• . Certified Software Test Engineer (CSTE)
• . Azure Fundamentals (AZ-900)
• . Azure Developer Associate (AZ-204)
• . Experience testing Al-enabled business applications.
• . Experience testing distributed microservices architectures.
• . Experience with containerized applications and Kubernetes.
• . Experience implementing quality engineering practices in cloud-native environments.
• Leadership Competencies
• . Quality-first mindset
• . Strong analytical and problem-solving skills
• . Technical leadership and mentoring
• . Attention to detail
• . Risk assessment and mitigation
• . Continuous improvement orientation
• . Collaboration and teamwork
• . Strong written and verbal communication
• . Customer-focused thinking
• Success Measures
• . Increased automated test coverage
• . Reduced production defects and escaped issues
• . Improved release quality and deployment confidence
• . Faster testing cycles and feedback loops
• . Increased reliability and performance of Azure-hosted applications
• . Successful validation of Al-powered capabilities
• . Strong collaboration across engineering, product, and operations teams
• . Continuous improvement of overall software quality metrics
• Ideal Candidate Profile
• The ideal Senior Quality Assurance Engineer combines strong software engineering and test
• automation expertise with a passion for delivering exceptional product quality. They are
• comfortable testing complex Azure-based enterprise applications, building scalable
• automation frameworks, and helping teams confidently adopt Al-powered capabilities while

maintaining rigorous standards for reliability, security, performance, and user experience.

• REMOTE
• NOTE The ideal Senior Quality Assurance Engineer combines strong software engineering and test
• automation expertise with a passion for delivering exceptional product quality. They are
• comfortable testing complex Azure-based enterprise applications, building scalable
• automation frameworks, and helping teams confidently adopt Al-powered capabilities while

maintaining rigorous standards for reliability, security, performance, and user experience.