Requisition ID11154-Posted - Years of Experience (3) -Consulting- Where (1)
WM Reply is the Reply Group company specializing in improving employees day-to-day lives through modern workplace solutions and connecting consumers to products and experiences they love online. We support our clients from beginning to end; designing and building their solution and easing adoption. Making sure our clients are not just enjoying the benefits of the cloud but exploiting them as well. We are recognised as leaders within Sitecore, Dynamics 365, Office365 and the products within such as SharePoint, Power Platform, Yammer and Microsoft Teams. A Microsoft Gold Partner five times over! We have a colourful team who are famous for their imagination, delivery, passion for technology and most importantly, their pride in delivery. www.wm.reply.com
Role Overview
As a QA Engineer, you will be responsible for ensuring quality across applications, agents, and integrations within Microsoft 365 and Azure environments. You will shape test strategies and plans, designing test cases based on business processes to ensure comprehensive coverage. Your role includes executing both functional and non-functional testing, starting with manual tests and automating where it adds value. You will also report clear, evidence-based findings to support confident go/no-go decisions for releases.
Responsibilities
- Translate epics, user stories, and business processes into comprehensive test strategies, plans, and traceable test cases across Power Apps, Copilot Studio agents, Teams apps, SharePoint solutions, and Azure-backed services.
- Identify quality gates within Azure DevOps (ADO), defining acceptance criteria and entry/exit conditions for each stage of the ALM process.
- Perform functional, regression, integration, cross-platform, and UAT testing across Microsoft 365 and Azure components, logging defects with clear reproduction steps and impact.
- Validate APIs (REST, Microsoft Graph, custom) using tools like Postman and Swagger, and verify data in Dataverse, SharePoint, and Azure SQL.
- Execute persona-based, scenario/workflow, and AI model validation tests for Copilot Studio agents, verifying guardrails, prompt flows, orchestration, and third-party integrations.
- Maintain reliable test suites across multiple environments and use Azure DevOps for test execution records, dashboards, and reporting.
- Collaborate daily with product owners, developers, solution/AI engineers, and business analysts, contributing to backlog refinement, sprint planning, demos, retrospectives, and risk mitigation.
- Support release readiness with concise test summaries, defect burn-down and escape analysis, evidence packs for stakeholder sign-off, and post-release smoke testing.
About the Candidate
- Experience designing test strategies and plans, and writing clear, reproducible test cases, with strong defect triage and stakeholder communication skills.
- Hands‑on API testing using Postman or Swagger and data validation with SQL or queries.
- Familiarity with Azure DevOps or Jira for application lifecycle management (ALM) and reporting.
- Practical knowledge of Microsoft 365 workloads (Teams, SharePoint, Viva) and Power Platform (Power Apps, Power Automate, Copilot Studio).
- Strong business process literacy, including understanding end-to-end flows, challenging ambiguous requirements, and deriving meaningful test scenarios.
- Comfortable in a partially customer-facing role, including running workshops, supporting UAT, and explaining risks and trade-offs in executive-friendly language.
- Exposure to Microsoft Graph API validation, Dataverse, and Azure services (Functions, Logic Apps, Storage) is beneficial.
- Experience testing Copilot Studio agents, validating AI/LLM behaviours, and light‑touch automation with tools like Copilot Studio Kit and Evals is advantageous.
Reply is an Equal Opportunities Employer and committed to embracing diversity in the workplace. We provide equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type regardless of age, sexual orientation, gender, identity, pregnancy, religion, nationality, ethnic origin, disability, medical history, skin colour, marital status or parental status or any other characteristic protected by the Law.
Reply is committed to making sure that our selection methods are fair to everyone. To help you during the recruitment process, please let us know of any Reasonable Adjustments you may need.
#J-18808-Ljbffr