Physics Subject Matter Expert Prompt Creator (Germany)
Job Location:
Monthly Salary:
Posted:
Application Deadline:
Vacancies:
Job Summary
Work Location: Remote
Engagement Model: Independent Contractor/Freelance
Estimated Project Duration: 2 - 4 weeks approx.
Estimated Start Date: ASAP
Role Summary
DataForce by TransPerfect is seeking doctoral-level experts in Physics to contribute to a highly specialized high-impact AI training this role you will leverage your own doctoral research to craft stumper promptscomplex PhD-level scientific problems specifically designed to be unsolvable by current Large Language Models (LLMs).
You will be responsible for designing the problem testing it against various LLMs to verify they fail documenting their flawed outputs and finally providing the authoritative step-by-step expert solution. This is an analytically demanding role that requires deep subject-matter expertise rigorous scientific reasoning and proficiency with digital documentation tools.
This is an initial pilot project and final project duration and compensation details will be communicated before onboarding. We anticipate a commitment of approximately 15 hours per week during the pilot phase. Participants who perform well may be considered for future project phases and additional long-term opportunities as the program expands.
Role Responsibilities
Prompt Creation: Design original highly complex self-contained STEM problems based on your doctoral research or directly related subfields.
LLM Testing & Verification: Input your prompts into multiple designated LLMs to verify that they consistently fail to produce the correct answer (stumping the models).
Authoritative Solution Generation: Write a flawless derivation or calculation leading to the correct answer including all relevant steps explanations equations and visual diagrams.
Platform Navigation: Utilize our proprietary DataForce Platform (DFP) to draft test and format your submissions (e.g. drawing chemical structures creating physics diagrams utilizing equation editors).
Peer Review (For Senior/QA roles): Top-performing experts will be selected to review peer submissions ensuring scientific accuracy clarity and adherence to project guidelines.
Role Requirements
A Ph.D. (completed or in the final stages of defense) in one of the following subdomains:
Domain: Physics
Basic Physics
Condensed Matter Physics
Computational Physics
Applied Physics
Experience:
Prior experience with peer review academic grading or scientific publishing.
Deep expertise in a specific doctoral research niche.
Familiarity with interacting with GenAI/LLMs and a critical eye for identifying AI hallucinations or logical leaps in scientific reasoning.
Skills:
Exceptional analytical and critical thinking skills.
Proficiency in standardized scientific documentation (e.g. SMILES InChIKey for Chemistry; standard notation and equations for Physics).
Comfort working in an agile data collection/annotation platform environment.
Meticulous attention to detail and a commitment to strictly original work (AI assistance in generating your own solutions is strictly prohibited).
DataForce by TransPerfect is part of the TransPerfect family of companies the worlds largest provider of language and technology solutions for global business with offices in more than 100 cities worldwide.
We offer high-quality data for Human-Machine Interaction to some of the most prestigious technology companies in the world. Our department focuses on gathering enriching and processing data for Machine Learning in different AI domains. To learn more about DataForce please visit us at
