Software Test Engineer

Responsibilities

• Define and execute test plans across products, APIs, SDKs, model-powered features, and data platforms.
• Build and maintain automated test suites and frameworks for functional, integration, end-to-end, regression, API, browser, and service-level testing.
• Translate requirements and customer acceptance criteria into test strategies, test cases, and release gates.
• Create customer-focused and adversarial datasets, fixtures, and test environments covering edge cases, failure modes, and system limits.
• Evaluate speech-to-text, text-to-speech, and other AI behavior using metrics, expected outputs, human review, and regression coverage.
• Build test harnesses, reusable scripts, test-data tooling, result-aggregation pipelines, dashboards, and visualizations.
• Integrate automated tests, quality checks, canaries, and release validation into continuous integration and deployment workflows.
• Test data ingestion, processing, annotation, quality control, integrity, completeness, deduplication, leakage, and downstream readiness.
• Perform staging and production validation, load and reliability testing, cross-browser testing, customer-workflow testing, and user acceptance testing.
• Maintain test cases, automation coverage, documentation, and release-readiness reporting.
• Write reproducible bug reports with inputs, parameters, expected and actual results, logs or artifacts, and severity.
• Contribute to code reviews, test-design reviews, technical discussions, and engineering and QA practice improvements.

Requirements

• Bachelor's, master's, or doctoral degree in Computer Science, AI, Applied Mathematics, or a related field, or equivalent experience.
• At least 5 years of professional software or QA engineering experience, including shipping test infrastructure or evaluation systems.
• Backend or scripting experience in Python, Rust, Go, or a similar language.
• Experience designing and building automated test pipelines, evaluation frameworks, or data-processing systems.
• Strong analytical skills and comfort reasoning about metrics, thresholds, and statistical variation.
• Ability to take ownership of ambiguous technical challenges and communicate across research, engineering, and product teams.
• Preferred experience testing LLMs, RAG pipelines, agents, or multimodal models.
• Preferred experience with voice, audio, speech recognition, or real-time systems and metrics such as WER, MOS, latency, and time-to-first-byte.
• Preferred experience building test, evaluation, benchmarking, or ML infrastructure used by multiple teams or external users.
• Preferred experience with React Native, mobile applications, cloud infrastructure, containers, ephemeral test environments, monitoring tools, open-source projects, or cross-team technical bridging.