Senior Software Engineer - AI Interaction Evaluator (up to $200/hr)

About the role

We are looking for a senior‑level software engineer to evaluate how modern AI coding assistants such as OpenAI Codex and Claude Code interact with developers. This contract position focuses on judging the quality of AI‑generated code, explanations and reasoning rather than writing production code.

Key responsibilities

• Assess end‑to‑end AI‑generated coding interactions for usefulness, correctness and engineering judgment.
• Rate responses on a quality scale and differentiate subtle levels of performance.
• Provide clear, opinionated feedback on what worked, what didn’t and what felt misleading.
• Help define standards for “great” AI‑assisted development experiences.

Required profile

• Staff‑ or principal‑level engineer (or equivalent experience).
• Strong background in TypeScript/JavaScript or Python.
• Hands‑on experience with OpenAI Codex, Claude Code and AI‑first IDEs such as Cursor.
• Deep familiarity with modern AI‑assisted development workflows.
• Ability to evaluate code and explanations without fully executing every line.
• Comfortable delivering direct, rigorous feedback.

Required skills

• TypeScript
• JavaScript
• Python
• OpenAI Codex
• Claude Code
• Cursor (AI‑first IDE)

What we offer

• Hourly rate up to $200 (US/Canada), $150 (EU/Latam) or $100 (other locations).
• 10–20 hours per week, remote work.
• Contract through early May with possible extension.