Turing, based in San Francisco, California, is at the forefront of AI research, partnering with global enterprises to deploy advanced AI systems. We accelerate frontier research with high-quality data and top AI researchers specializing in software engineering and more. In this role, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, working closely with researchers to curate code examples, provide precise solutions, and correct code in various programming languages.

The Role

As a Software Engineering evaluator, your day-to-day tasks will include:

• Curating code examples and building solutions in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
• Evaluating and refining AI-generated code for efficiency, scalability, and reliability.
• Collaborating with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks.
• Building agents to verify code quality and identify error patterns.
• Hypothesizing on steps in the software engineering cycle and evaluating model capabilities.
• Designing verification mechanisms for software engineering tasks.

Requirements

• 3+ years of software engineering experience.
• Strong expertise in building full-stack applications and deploying scalable software.
• Deep understanding of software architecture, design, development, debugging, and code quality assessment.
• Excellent oral and written communication skills for clear evaluation rationales.

What We Offer

• Flexible engagement, minimum 10 hrs/week, up to 40 hrs/week (partial PST overlap required).
• Contractor type (no medical/paid leave).
• Duration: 1 month (starting next week; potential extensions based on performance and fit).
• Location: Candidates must be based in the US, Canada, or Western European countries (UK, Netherlands, Italy, Germany, etc.).

Please note that as part of the assessment process, you will participate in an AI video interview. After applying, you will receive an email with a login link to complete your profile. If you know talented individuals, refer them at turing.com/referrals to earn rewards from your network.