Back to all jobs

Software Engineer, AI Coding Tasks at Askable

WeWorkRemotely
Apply NowSign in to track
AI-enhanced for better readability

Askable: Software Engineer, AI Coding Tasks (Contract)

Headquarters: Australia
URL: https://www.askablelabs.com/

We're looking for experienced software engineers to build AI coding tasks from a codebase they know well. You will turn a real change from a repository you know into a task that today's best AI coding models struggle with: hard for the models, but fair for a skilled engineer. Your tasks are used to measure and train AI coding models.

Location: Remote, any location.
Compensation: US$1,000 per task that passes review.
Commitment: Minimum of one task a week (about 10 hours a week).

How it Works

  1. Apply: Complete a short screener interview and upload your resume.
  2. Propose: Once you're selected, pick a change from a repository you know and submit a short proposal. We approve it or suggest a better candidate.
  3. Build: In our platform, set up the repository as it was before the change, then write the brief, the correct solution, and the grading checks.
  4. Stress-test: Try lazy, incorrect, and shortcut solutions and make sure your checks catch them.
  5. Model testing: Run your task against leading AI models until strong models often fail but a skilled engineer can clearly solve it.
  6. Review: A reviewer checks your task and you revise it. Most tasks take more than one round.
  7. Next task: Once your task is accepted, start another.

Requirements

  • 2+ years of professional software engineering.
  • Code merged into a public open-source repository, ideally one you know well. A private codebase you own may also qualify (not employer or client code).
  • Strong in at least one of Python, TypeScript, Go, Rust, Java, or C++.
  • Solid with Docker, Linux, Git, and automated testing.
  • Regular use of an AI coding tool.
  • Experience writing tests, rubrics, or evaluation criteria, ideally for AI models.
  • Ability to explain a change clearly and concisely, in your own words.
  • Availability of at least 10 hours a week, starting now.
  • A secure personal or work computer (no public or shared machines).

Nice to Have

  • Deep expertise in one area, such as databases, compilers, distributed systems, security, or infrastructure.
  • Experience building agent tasks or RL environments.

Terms

  • US$1,000 for each task that passes our quality review, paid directly to you.
  • Once your proposal is qualified, you sign Askable's contract and accept its terms.
  • The work is used for AI training. The change and your solution must be your own, and you must be free to license them to us.
  • Don't publish the work anywhere: no public pull request or public fork.

How to Apply

Apply at https://www.askable.com/experts/roles/senior-software-engineer

Original Posting: We Work Remotely

Similar jobs