Senior Quality Assurance Analyst

First Orion is seeking a Senior Quality Assurance Engineer to help ensure the quality, reliability, and customer experience of our customer-facing portal applications. This hands-on role primarily supports portal capabilities while contributing to shared quality and regression coverage and backup for the API contract-testing engine.  

The Senior QA Engineer works as an embedded member of the Branded Calling solutions delivery team, partnering with Product and Engineering throughout the software development lifecycle to evaluate requirements, define comprehensive test scenarios, identify quality risks, execute functional and exploratory testing, and develop and maintain automated tests. The role also partners with the QA Automation Engineer to expand reusable automation, improve regression coverage, and support reliable automated test execution.   

What you’ll be doing: 

Quality & Test Strategy 

• Develop a strong understanding of customer journeys, integrations, configurations, roles and permissions, business rules, and system dependencies. 

• Participate in backlog refinement, feature planning, requirements reviews, and technical discussions. 

• Identify gaps, edge cases, dependencies, data needs, permission considerations, and quality risks before development is complete. 

• Translate requirements and acceptance criteria into comprehensive test scenarios covering positive, negative, boundary, role-based, configuration, and integration scenarios. 

• Assess changes for potential impact across portal applications, shared services, APIs, workflows, and customer experience. 

Functional & Exploratory Testing 

• Test new features, enhancements, configuration changes, integrations, and defect fixes across UI, API, backend, and data layers. 

• Perform functional, integration, regression, exploratory, negative, permission, configuration, and risk-based testing. 

• Use API clients, application logs, browser tools, SQL queries, and other evidence to validate results and troubleshoot failures. 

• Validate accessibility, cross-browser behavior, responsive layouts, defects, and fixes. 

• Conduct targeted regression testing based on the functional and technical impact of changes. 

Test Automation 

• Develop, maintain, execute, and troubleshoot automated tests using Playwright with TypeScript and our Java/Gradle API contract-testing framework. 

• Build automated coverage for acceptance criteria, business rules, customer journeys, and regression scenarios as part of feature delivery. 

• Review automated results and distinguish application defects from environment, configuration, data, and automation issues. 

• Partner with the QA Automation Engineer on reusable components, test data, CI/CD execution, reporting, and flaky-test reduction. 

• Participate in peer reviews and help maintain reliable, maintainable test code. 

AI-Assisted Quality Engineering 

• Use AI coding agents, including Kiro, to support work within the test codebases. 

• Maintain appropriate instructions, skills, and guardrails for AI-assisted development. 

• Validate AI-generated output against requirements and observed system behavior. 

Defect, Release & Quality Leadership 

• Document defects with clear reproduction steps, evidence, and expected versus actual behavior. 

• Partner with engineers to troubleshoot and resolve complex failures. 

• Communicate testing status, known defects, coverage gaps, and release risks to Product, Engineering, and business stakeholders. 

• Maintain test data, ticket-to-test traceability, and known issues through resolution. 

• Mentor QA team members, share knowledge, and contribute to testing standards and continuous improvement. 

• Independently manage priorities, blockers, risks, and commitments. 

What you’ll need: 

• Professional software QA or quality engineering experience supporting web applications, services, or data-driven systems. 

• Experience independently leading test planning and quality strategy for complex features or product areas. 

• Strong experience with functional, integration, regression, exploratory, negative, and risk-based testing. 

• Hands-on experience developing automated web tests using Playwright and TypeScript. 

• Experience testing REST APIs, including OpenAPI specifications, JSON, authentication, HTTP behavior, and error handling. 

• Working knowledge of SQL for data validation and troubleshooting. 

• Ability to read Java, work within Gradle projects, and run and troubleshoot JUnit test suites. 

• Working knowledge of Agile development, defect tracking, CI/CD, and the software development lifecycle. 

• Comfort working from the command line, using Git, and running Python and shell scripts. 

• Experience using an AI coding agent against a codebase and evaluating its output. 

• Strong troubleshooting, communication, organization, and independent work-management skills. 

Bonus Points: 

• Experience integrating automated tests into CI/CD pipelines. 

• Experience testing configurable, multi-tenant, white-label, regional, or customer-specific applications. 

• Experience testing authentication, authorization, permissions, and role-based access. 

• Experience with test traceability, Jira, distributed systems, or API contract testing. 

• Experience mentoring QA professionals. 

• Experience with Java, Python, or shell scripting for test tooling. 

• Familiarity with Allure, Node tooling, AWS CLI/S3/SSO, accessibility testing, visual regression, or performance testing. 

• Experience creating instructions or guardrails for AI coding agents.

Company Benefits:

Balancing the work-life flow is key to health and happiness! That is why we offer one of the most competitive packages in our industry with open PTO, company paid holidays, Flex Fridays and flexible work arrangements. We strongly value the health and wellness of our teammates and through our state-of-the-art fitness center we’re helping our teammates reach their wellness goals while at work.  Add on generous health and dental/vision options, retirement plans, learning and development programs, career path frameworks, tuition reimbursement, company options and bonus potential you have many ways to take advantage of a comprehensive benefits package that means the most to you!

Learn More About First Orion:

First Orion helps businesses generate more revenue, increase efficiency, and improve the customer experience by empowering them to brand their phone calls with their name, logo and reason for calling. We are the market leader in branded communications technology, and a trusted partner to Fortune 500 companies and the largest U.S. mobile carriers.

• First Orion has been voted a Great Place to Work with top rankings in every category.

• Learn more about what our employees have to say on our First Orion Glassdoor page and watch our People First Diversity Statement/Video. 

• First Orion Culture Cornerstones are at the core of everything we do here.

Disclosure:

First Orion is an Affirmative Action and Equal Opportunity Employer. This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job.  Activities, duties, and responsibilities may change at any time with or without notice, based on the changing needs of our business.

This position is not eligible for employment-based immigration visa/status sponsorship. Employees are required to demonstrate proper work authorization as required by I-9 compliance. 

First Orion is interested in every qualified candidate who is eligible to work in the United States. First Orion’s immigration sponsorship policy is applied in a nondiscriminatory fashion regardless of race, gender, ethnic origin, or any other classification protected by law.