Location
New York City, United States
New York City, United States
Salary
(Yearly)
(Yearly)
(Yearly)
(Yearly)
(Hourly)
Undisclosed
Category
AI Engineer
Date posted
June 2, 2026
Job type
Full-time
Experience level
Summary this job with AI
Highlight
Highlight

Job Description

Harness Engineer

Location: NYC Reports to: CTO

About Nomic

Nomic builds AI agents and developer tools that power the built world. We help enterprise teams in architecture, engineering, and construction extract structured knowledge from decades of drawings, specs, and project files. Our platform combines embedding models, document parsing, and autonomous agents that reason over real-world data and take action in live environments.

The Role

Our agents reason over massive, messy, real-world document collections — construction drawings, specifications, decades of project history. Getting that right means solving retrieval, context assembly, and evaluation as first-class engineering problems, not afterthoughts bolted onto a prompt.

We're hiring a Harness Engineer to work on the systems that make our agents effective: how they find information, how they assemble context, how we know they're working, and how we make them better over time.

You should be the kind of engineer who knows what a vector database is and when not to use one. Who thinks about retrieval as an architecture problem, not a library call. Who's paying attention to how agent systems actually get built and deployed in 2026 — and has opinions about it.

What You'll Work On

  • Retrieval systems — search, ranking, chunking strategies, hybrid approaches, knowing which tool fits which problem

  • Context engineering — assembling the right information for agents operating over large, heterogeneous document sets

  • Evaluation and harnesses — building the infrastructure to continuously measure agent accuracy, regression-test retrieval quality, and close feedback loops

  • Agent pipelines — the orchestration layer between retrieval, models, and downstream actions

  • Scale — making all of the above work across thousands of customer document collections, not just a demo corpus

What We're Looking For

  • Strong software engineering skills in Python and/or TypeScript

  • Real experience with retrieval systems — embeddings, vector search, traditional IR, or some combination

  • You've built systems that had to work on messy, real-world data — not just clean benchmarks

  • Familiarity with LLMs and agent frameworks in practice, not just in theory

  • You think in systems — how components interact, where things break, what doesn't scale

  • Intellectual curiosity about the retrieval and agent tooling landscape as it exists right now

Even better if you have:

  • Experience with evaluation infrastructure — evals, benchmarks, regression testing for AI systems

  • Background in search, NLP, or information retrieval

  • Exposure to the AEC industry or other document-heavy domains

Apply now
Nomic AI is hiring a Harness Engineer. Apply through The AI Chopping Block and and make the next move in your career!
Apply now
Companies size
11-50
employees
Founded in
Headquaters
New York City, NY, United States
Country
United States
Industry
Computer Software
Social media
Visit website

Similar AI jobs

Here are other jobs you might want to apply for.

CA.svg
Canada

Engineering Manager, AI

Full-time
AI Engineer
US.svg
United States

AI Engineer - Data Intelligence

Full-time
AI Engineer
KR.svg
South Korea

Applied AI Engineer

Full-time
AI Engineer
AU.svg
Australia

Engineering Manager

Full-time
AI Engineer
US.svg
United States

Harness Engineer

Full-time
AI Engineer
US.svg
United States

Member of Technical Staff, Evals

Full-time
AI Engineer
Open Modal