Skip to content
About

Treat human evaluation as an engineering discipline

Calibrated, measured, audited, delivered under contract. The industry's constraint has moved from data volume to judgment quality, and the supply side of judgment is still dominated by models built for volume.

A named podRatios hold at every scale

1.3×

Calibrated bench

Held against deployed demand

100%

KYC verified

Before task access is granted

Mission
To deliver the world’s most reliable human intelligence for AI development. By recruiting India’s best technical talent, training it to frontier-lab standards, and wrapping it in quality systems that make excellence repeatable.
Vision
To become India’s most trusted AI Operations company. The execution partner frontier labs rely on when the quality of human judgment determines the quality of their models.

Most trusted

Not largest, not cheapest. Trust is the purchasing criterion in this market. Clients hand over confidential model outputs, unreleased benchmarks and safety-sensitive data. Trust compounds; scale follows it.

AI Operations company

A category deliberately broader than data labelling. We operate workflows: evaluation pipelines, RLHF programs, benchmark harnesses, QA systems. Operations remains a durable business even as raw annotation commoditises.

Execution partner

The relationship is institutional. We sign MSAs, carry SLAs and own outcomes. The opposite of a talent marketplace that transfers risk back to the client.

Our Philosophy

Treat human evaluation as an engineering discipline.

Calibrated. Measured. Audited. Delivered under contract. The industry’s constraint has moved from data volume to judgment quality, and the supply side of judgment is still dominated by models built for volume.

  1. 01

    Quality over volume

    We never accept a project the team cannot staff to a ≥95% acceptance rate. Work that forces quality dilution is declined, including work we want.

  2. 02

    Contributors as professionals

    Paid training, transparent pay, and a real career ladder from contributor to reviewer to lead. Low churn is a quality strategy, not an HR nicety.

  3. 03

    Radical measurability

    Every deliverable ships with quality evidence: acceptance rates, inter-rater agreement, audit trails. Clients never wonder what they received.

  4. 04

    Confidentiality by default

    Every engagement is treated as if it covers unreleased model data, because it usually does.

Who we are

Practitioner-led, by design.

The founding team has sat inside the exact workflows its clients outsource, which is why the QA system was designed before the sales deck.

MM

Mayank Mishra

Founder & Chief Executive Officer

Leads client engagement and partnerships. Hands-on delivery history across RLHF, LLM evaluation and preference ranking through frontier-lab data pipelines.

Pipeline · Pricing · Partnerships · Capital

RJ

Rajat Joshi

Co-Founder & Chief Operating Officer

Owns the delivery system, the QA framework and the contributor organisation. Background in coding evaluation, Terminal-Bench-style agent tasks and rubric design.

Delivery · Quality · People

Organisation

A delivery pyramid, not a headcount pile.

Every layer exists to protect quality at the layer below it. The reviewer ratios are structural constants that hold at any scale.

Leadership

  • Founder & CEO

    Pipeline, pricing, partnerships, capital

    New MRR · client count

  • Co-Founder & COO

    Delivery, QA system, hiring, contributor experience

    Acceptance rate · SLA compliance

Delivery management

  • Head of Delivery

    SLAs across programs

    On-time delivery · utilisation

  • Head of Quality

    Metrics system and audits

    Escaped-defect rate · QA accuracy

  • Project Lead

    One client program end to end

    Program acceptance rate

Quality line

  • Senior Reviewer

    QA gate, rubric maintenance, coaching

    Escaped defects · IAA

  • Reviewer

    First-pass review of contributor output

    Review accuracy vs audit

Delivery base

  • Contributor

    Task execution to rubric

    Personal acceptance rate

  • Expert bench

    On-call domain specialists

    Domain accuracy

Positioning
For AI labs and data platforms that need expert human judgment at scale, Newbieget Labs is the managed AI-operations partner that delivers complete, quality-assured evaluation and training-data projects, combining India’s deepest technical talent with frontier-lab QA discipline.

Not a marketplace

No self-serve gig pool. Every contributor is sourced, tested, trained, calibrated and managed under a named lead.

Not a body shop

We sell accountable deliverables under SLAs, not resumes at an hourly markup. Scope, acceptance criteria and rework terms are contractual.

Not a model company

We build no competing IP. There is no scenario where your unreleased capabilities become our product.