Back to all jobs

Data Annotation Operations Lead at Pingintel

HackerNews
Apply NowSign in to track
AI-enhanced for better readability

Data Annotation Operations Lead - Pingintel

Location: Miami or Remote
Type: Full-time
Website: https://www.pingintel.com
Source: Hacker News

About the Role

We're hiring a Data Annotation Operations Lead to run ML training data annotation. You'll manage offshore annotation contractors, become an expert annotator yourself, and drive quality, cost, and throughput — while working with engineering to automate annotation with LLMs.

Responsibilities

  • Manage offshore annotation contractors as main liaison
  • Write and maintain annotation guidelines
  • Annotate data yourself, especially early on
  • Track quality metrics (agreement rate, accuracy, rework) and drive improvement
  • Cut cost and boost throughput without sacrificing quality
  • Partner with engineering to automate annotation via LLMs/agents

Requirements

  • Experience managing offshore/distributed teams
  • ML annotation / training data pipeline knowledge
  • Extremely detail-oriented with strong written/verbal communication skills
  • Proficiency in SQL and spreadsheet/BI tools
  • Comfort turning ambiguous decisions into clear rules

Nice to Have

  • Python experience
  • Annotation UI/UX design experience
  • Taxonomy classification experience
  • LLM/agent automation experience

How to Apply

Reach out at jobs@pingintel.com

Similar jobs