Senior Software Engineer - AI Interaction Evaluator (up to $200/hr)

About the role

We are seeking a senior‑level software engineer to evaluate the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This contract position focuses on assessing how well the model’s responses align with the judgment of an experienced developer, rather than writing production code.

Key responsibilities

• Review end‑to‑end AI‑generated coding interactions and judge their usefulness, correctness, and engineering soundness.
• Provide clear, opinionated feedback on what worked, what didn’t, and any misleading aspects.
• Distinguish between different levels of response quality and help define standards for great AI‑assisted coding experiences.
• Collaborate with the team to shape evaluation criteria and improve tool guidance.

Required profile

• Staff‑ or principal‑level engineer (or equivalent experience) with a strong engineering taste.
• Deep familiarity with modern AI‑assisted development workflows.
• Comfortable making rigorous, subjective judgments about code explanations and reasoning.
• Ability to work 10–20 hours per week remotely and start immediately.

Required skills

• TypeScript or JavaScript
• Python
• Experience using OpenAI Codex
• Experience using Claude Code
• Familiarity with Cursor or similar AI‑first IDEs

What we offer

• Hourly compensation up to $200 (US/Canada), $150 (EU/Latam), $100 (other regions).
• Flexible part‑time schedule (10–20 hrs/week) with remote work.
• Opportunity to influence the future of AI‑assisted software development.