Remote Software Engineer Evaluator
Turing
Netherlands
Full-time
Remote
Intermediate
posted 16 hours ago
Vacancies Summary
Join Turing, a leading AI research accelerator, as a Software Engineering evaluator. You'll create advanced datasets for training large language models and collaborate with top researchers while working with various programming languages.
About the Company
Turing, located in San Francisco, California, is the premier research accelerator for frontier AI labs and a trusted partner for global enterprises implementing advanced AI systems. Turing enhances frontier research with high-quality data and expert AI researchers specializing in software engineering and related fields.
The Role
As a Software Engineering evaluator, you will be responsible for creating innovative datasets for training, benchmarking, and advancing large language models. You will work closely with researchers to curate code examples, provide accurate solutions, and refine AI-generated code for efficiency and reliability.
Responsibilities
- Curate code examples and build solutions in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
- Evaluate and enhance AI-generated code to ensure efficiency, scalability, and reliability.
- Collaborate with cross-functional teams to improve AI-driven coding solutions against industry benchmarks.
- Develop agents to verify code quality and identify error patterns.
- Hypothesize steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and assess model capabilities.
- Design verification mechanisms to automatically validate solutions to software engineering tasks.
Requirements
- 3+ years of experience in software engineering.
- Strong expertise in building full-stack applications and deploying scalable, production-grade software using modern languages and tools.
- Deep understanding of software architecture, design, development, debugging, and code quality assessment.
- Excellent oral and written communication skills for clear evaluation rationales.
What We Offer
- Flexible engagement with a minimum commitment of 10 hours per week, up to 40 hours per week (partial PST overlap required).
- Contractor type engagement (no medical/paid leave).
- Initial duration of 1 month with potential extensions based on performance.
- Remote work for candidates based in the US, Canada, or Western European countries (UK, Netherlands, Italy, Germany, etc.).
Note: Candidates will undergo an AI video interview as part of the assessment process. After applying, you will receive an email with a login link to complete your profile.
If you know talented individuals, refer them at turing.com/referrals and earn rewards from your network.
Required skills
Prototyping
Modern languages
Debugging
API
Software Engineering
Python
Artificial Intelligence (AI)
Architecture
Rust
Large Language Models (LLM)
Reliability
Javascript
English level
Fluent
Still searching manually?
Let us do the work for you.
TotaMatch works for you
We scan thousands of jobs daily and notify you when there is a match. No searching needed.
Anonymous, safe and free
Your profile stays anonymous. Your employer will not see it. You choose when to become visible.
Ready in 3 minutes
Answer a few questions and create your profile in minutes. No commitment.
About TotaMatch
TotaMatch helps professionals find work that truly fits their work happiness. We believe work is more than just an income. It is a source of fulfillment, growth, and pride. Instead of endlessly scrolling through job boards, TotaMatch works for you. Our platform continuously analyzes thousands of opportunities and identifies roles that align with what truly matters to you. You focus on your work and the people around you. We make sure you never miss a better opportunity.