Engineering · AI / ML

AI / ML Engineer

Build and maintain the model pipelines behind our product — fine-tuning, retrieval, evaluation and the harness that decides what ships.

Experience

3–5 years

Location

Bengaluru

Level

Experienced

01

About the Role

Our model layer is the product, not a feature of it. This role builds and maintains the pipelines behind it — fine-tuning runs, retrieval components, evaluation datasets and the scoring harness that decides whether a model version ships.

You work under the AI/ML Lead alongside our AI fellows, which means part of the job is setting the standard for how experiments are run and recorded. This is applied engineering, not research: the measure is whether it works in production for a client.

02

Key Responsibilities

1

Build model pipelines

Data preparation, fine-tuning runs, checkpoint management and deployment.

2

Own retrieval quality

Chunking, embedding, reranking — and measuring whether each change actually helped.

3

Write the evaluations

Build golden datasets and regression suites so model quality is a number, not an opinion.

4

Do the error analysis

When output is wrong, find out why and fix the cause rather than the prompt.

5

Watch cost and latency

Track inference cost per transaction and keep it inside the envelope.

6

Work with the fellows

Review their experiments and help them reach production standard.

03

What You Bring

  • 3–5 years in applied machine learning, or an AI fellowship with demonstrated production contribution.
  • Strong Python; PyTorch and the Hugging Face ecosystem as daily tools.
  • You have run a fine-tune and can explain why it did or did not move the metric.
  • Retrieval pipelines built and tuned in production — and measured, not assumed.
  • You write evaluation datasets rather than judging model output by eye.
  • You can read a paper and tell whether it is worth implementing.
04

What Would Be Great to Have

  • OCR and document extraction pipelines.
  • Speech and audio processing.
  • Quantisation and inference optimisation.
  • Model governance and documentation under ISO 42001.

Sound like you?

Send your CV to careers@newstreettech.com. The subject line is filled in with the role code (NS-AIE-001) for you.