QA Engineer

IMPORTANT: after you apply please check your email. We send you a link to complete your application it is not considered until that last step is done. If you do not see it check your spam folder.

This is a fully remote position open to candidates based in United States.

Pay: $90$175/hr

Role Title: QA Engineer

Role Type: Contractor

Location: Remote

We are engaging QA Engineers to contribute expertise in software quality evaluation for a customers high-volume this role youll apply your expertise to help train next-generation AI systems. Your work will shape how models learn reason and perform through high-quality real-world input. No prior experience in AI is required your domain knowledge is what matters. This opportunity is open to specialists with strong professional QA backgrounds. Prior paid experience with human data annotation RLHF model output evaluation or rubric-based grading for AI training is a plus but not required.

Scope of Work

1. Evaluate and rate AI-generated technical outputs against defined quality criteria and rubrics identifying answers that may appear correct but are actually inaccurate or incomplete.
2. Design and assess comprehensive test cases for functional regression and edge-case scenarios including negative and boundary tests.
3. Review bug reports and test documentation to ensure issues are reproducible documentation is complete and severity is properly assessed.
4. Identify isolate and document defects with precise reproduction steps and utilize structured tracking mechanisms.
5. Provide detailed actionable written feedback and annotations to support efficient resolution by developers without the need for clarification.
6. Collaborate with project teams to refine evaluation guidelines and ensure continuous improvement of testing standards and methodologies.

Preferred Qualifications

1. Proven professional experience as a QA Engineer SDET Test Engineer QA Analyst or similar role in software quality assurance.
2. Strong command of QA fundamentals including test case design bug tracking regression testing and both manual and automated testing strategies.
3. Hands-on experience with automation frameworks and test management tools such as Selenium Playwright Cypress Appium Postman Jira TestRail Zephyr or BrowserStack (or similar tools).
4. Prior paid human data experience supporting AI training annotation labeling RLHF AI response evaluation model evaluation or rubric-based grading is a plus.
5. Excellent analytical and problem-solving skills with meticulous attention to detail.
6. Ability to communicate complex findings clearly in written English providing specific actionable feedback (B2 level or above).
7. No formal degree requiredpractical demonstrable testing experience takes precedence.
8. Reliable internet connection and readiness to begin promptly.

How to apply

Apply here with your profile. We will then email you a link to complete your application on the hiring platform your application is only considered once that final step is done.