AI Backend Engineer Jobs

Discover the latest remote and onsite AI Backend Engineer roles across top active AI companies. Updated hourly.

Check out 76 new AI Backend Engineer opportunities posted on AI Chopping Block

Software Engineer, Foundations Retrieval

New
Top rated
OpenAI
Full-time
Full-time
Posted

Build and scale retrieval infrastructure across indexing, serving, and query execution. Develop low-latency, high-throughput systems for real-time model interaction. Partner with research to productionize embedding and retrieval techniques. Support dense, sparse, and hybrid retrieval pipelines. Own system performance, reliability, and observability at scale. Collaborate across Pretraining, Inference, and Product teams to integrate retrieval end-to-end. Contribute to model-system interfaces for agentic workflows.

$380,000 – $555,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Senior Backend / Systems Engineer (AI) - San Mateo, CA

New
Top rated
Trustlab
Full-time
Full-time
Posted

Design and build extensible backend systems supporting flexible configurations for different customers and content types. Develop infrastructure interfacing with LLMs to enable prompt engineering, context injection, and modular evaluation workflows. Build tooling and platforms for fast iteration by AI engineers and analysts, including declarative pipelines, parameterized jobs, and reproducible experiments. Prioritize ease of deployment, integration, and testing for internal teams and external partners. Collaborate closely with product, data, and policy teams to translate nuanced safety needs into scalable, maintainable software systems.

$150,000 – $220,000
Undisclosed
YEAR

(USD)

San Mateo, United States
Maybe global
Remote

Software Engineer, Agent

New
Top rated
Sierra
Full-time
Full-time
Posted

Design and deliver production-grade AI agents that are highly performant, reliable, and intuitive, running in production environments across industries like finance, healthcare, and commerce. Own and drive the entire Agent Development Life Cycle (ADLC) from initial pilot through deployment and continuous iteration, building, tuning, and evolving AI agents in production environments and defining best practices for ADLC. Partner directly with leaders at large enterprises and cutting-edge startups to understand their business challenges and build AI agents that transform their operations at scale. Collaborate with customers to guide the evolution of Sierra's core platform by surfacing unmet needs, prototyping new tools and features, and working with research, product, and platform teams to shape the future of AI agent development and Sierra's product.

A$235,000 – A$425,000
Undisclosed
YEAR

(AUD)

Sydney, Australia
Maybe global
Remote

Staff Software Engineer, AI Voice Agent

New
Top rated
Aircall
Full-time
Full-time
Posted

As a Software Engineer on the AI Voice Agent team, you will work on real-time speech pipeline systems including live audio buffering, streaming, latency optimization, and integrating with speech providers. You will build and improve conversation intelligence systems that manage the LLM layer for natural conversation flow, including prompt construction, context management, function calling, and dialogue management. You will develop the action framework that allows the AI Voice Agent to execute tasks during calls such as querying account data, creating tickets, and checking order status, handling API configuration, success/failure branching, authentication management, and runtime execution. Additionally, you will work on knowledge ingestion, storage, and retrieval for the voice agent and manage memory for retaining information across conversations to improve responses. You will collaborate with designers to create easy-to-use interfaces for agent lifecycle management including creation, configuration, testing, and deployment. You will contribute to building evaluation frameworks and metrics for voice AI quality, post-call analytics, and instrumentation, as well as participate in the on-call rotation.

$215,000 – $250,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Software Engineer, AI Voice Agent

New
Top rated
Aircall
Full-time
Full-time
Posted

As a Software Engineer on the AI Voice Agent team, you will work on real-time systems involving live audio such as buffering, streaming, and latency optimization, along with integrating speech providers. You will build and improve conversation intelligence systems, including prompt construction, context management, function calling, and dialogue management to make conversations feel natural. You will develop the action framework to execute configurable API calls, manage success/failure branching, authentication, and runtime execution during calls. You will work on knowledge ingestion, storage, retrieval, memory, and context for the voice agent to improve its performance over time. Additionally, you will collaborate on agent lifecycle tasks such as creation, configuration, testing, and deployment of voice agents and help build evaluation frameworks for model performance, call quality metrics, and call analytics. Participation in on-call rotations is also expected.

$130,000 – $220,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Senior Software Engineer, AI Voice Agent

New
Top rated
Aircall
Full-time
Posted

As a Senior Software Engineer on the AI Voice Agent team, you will work on real-time systems involving live audio streaming and latency optimization integrated with speech providers. You will build and improve conversation intelligence systems that manage LLM layers, including prompt construction, context management, function calling, and dialogue management to create natural, actionable phone conversations. You will develop the action framework allowing configurable API calls with branching logic and runtime execution, supporting tasks like data lookup and ticket creation during calls. You'll manage knowledge ingestion, storage, and retrieval to enhance agent memory and learning over time. You will collaborate with designers to enable customers to create, configure, test, and deploy voice agents through intuitive product experiences. Additionally, you will help develop evaluation frameworks, analytics, call quality metrics, and monitoring instrumentation, and participate in on-call rotation duties.

$150,000 – $220,000
Undisclosed
YEAR

(USD)

Maybe global

Director, Engineering, Proactive Offense

New
Top rated
Horizon3ai
Full-time
Full-time
Posted

Lead and scale Horizon3.ai's Offensive Engineering organization, overseeing teams responsible for exploit development, offensive content, and attack automation within the NodeZero platform. Set clear technical and product direction for how NodeZero identifies, exploits, and validates vulnerabilities across large, complex environments. Partner with Product, Precision Defense, and Platform teams to define and deliver offensive capabilities that influence the roadmap and enhance customer outcomes. Drive execution from proof-of-concept through production to transform cutting-edge attack research into scalable, productized features. Stay hands-on to guide architectural decisions and evaluate exploit and automation approaches, mentoring technical leads in building resilient, modular systems. Build, mentor, and scale diverse teams of software engineers, exploit developers, and offensive researchers, fostering a culture of collaboration, creativity, and engineering excellence that bridges offensive and product software development. Collaborate across engineering, product, and GTM teams to align offensive innovation with business priorities and ensure delivery of impactful capabilities for customers. This role is central to the mission of delivering continuous, autonomous security testing at scale.

$240,000 – $285,000
Undisclosed
YEAR

(USD)

US, United States
Maybe global
Remote

New Grad - Full Stack Engineer (Python/React) - Ankara, TR

New
Top rated
Trustlab
Full-time
Full-time
Posted

The Full Stack Engineer is responsible for building and maintaining backend services in Python, contributing to APIs and microservices with clean and maintainable abstractions, working with datasets and asynchronous processing pipelines, improving performance, reliability, and observability, participating in system design discussions and learning from senior engineers, collaborating closely with frontend and AI/ML engineers, writing production-quality, testable, and secure code, and participating in code reviews to continuously improve.

$40,000 – $45,000
Undisclosed
YEAR

(USD)

Ankara, Turkey
Maybe global
Remote

Senior Python Engineer (FastAPI / Python)

New
Top rated
Photoroom
Full-time
Full-time
Posted

You will design, build, and evolve the public API product for Photoroom, which is the core interface through which developers access the company's AI capabilities. You will ship features used by both self-serve developers and large enterprise customers, ensuring the API remains reliable, scalable, and easy to integrate. You will own the API surface end-to-end, from design decisions such as naming, versioning, and structure to implementation, performance, and long-term maintainability. You will iterate quickly based on real usage, shipping multiple times per week, using data and user feedback to prioritize what matters most. You will work at the intersection of backend engineering and AI, abstracting complex image models into simple, elegant developer-facing interfaces. Collaboration with product, machine learning, backend, and sales teams is required to ensure the API delivers real value to users. You will join a small, senior team with high ownership and direct product impact from day one.

$75,000 – $110,000
Undisclosed
YEAR

(USD)

Paris, France
Maybe global
Remote

Back-End Engineer - Team Agents

New
Top rated
Taktile
Full-time
Full-time
Posted

Build and ship backend features for Taktile's AI agent platform in Python (FastAPI) deployed on AWS serverless infrastructure. Own work end-to-end by collaborating on scope, implementation, testing, releasing, and iterating based on real usage and customer feedback. Improve how agents run, connect to external tools, and behave when errors occur. Use AI tools daily to move faster, improve quality, and build AI-native capabilities. Review pull requests in depth, improve test coverage and CI/CD, and raise engineering excellence and reliability. Engage in team rituals including daily syncs, planning sessions, demos, and technical deep-dives. Grow professionally by learning from experienced team members, contributing to foundational product layers, and participating in cross-team learning groups. Participate in daytime operations duty and join an on-call rotation to support system ownership and DevSecOps skill growth.

Undisclosed

()

Berlin, Germany
Maybe global
Hybrid

Want to see more AI Backend Engineer jobs?

View all jobs

Access all 4,256 remote & onsite AI jobs.

Join our private AI community to unlock full job access, and connect with founders, hiring managers, and top AI professionals.
(Yes, it’s still free—your best contributions are the price of admission.)

Frequently Asked Questions

Have questions about roles, locations, or requirements for AI Backend Engineer jobs?

Question text goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

[{"question":"What does a AI Backend Engineer do?","answer":"AI Backend Engineers develop and maintain the scalable, secure services that power AI-driven applications. They build backend systems that ensure high availability and performance while integrating AI capabilities into core products. Their work includes designing machine learning pipelines, managing data flows, transforming ML models into APIs, and exploring advanced technologies like Agent Reasoning and Agentic RAG. They regularly collaborate with frontend, product, and data science teams."},{"question":"What skills are required for AI Backend Engineer?","answer":"Strong programming skills in languages like Python, Go, Java, or Node.js are essential for this role. Proficiency with AI frameworks such as LangChain, LangGraph, TensorFlow, and PyTorch is typically required. Experience with distributed systems, microservices architecture, databases, and cloud-native technologies is important. Problem-solving abilities and practical experience with AI agents round out the technical skillset, while cross-functional collaboration skills are equally valuable."},{"question":"What qualifications are needed for AI Backend Engineer role?","answer":"Most AI Backend Engineer positions require a Bachelor's degree or higher in Computer Science, Software Engineering, or related technical fields. Companies typically seek candidates with 3-8+ years of backend development experience, with the specific requirement varying by seniority. Practical experience working with AI agents and frameworks is increasingly important, as is a demonstrated history of building scalable backend systems that support machine learning applications."},{"question":"What is the salary range for AI Backend Engineer job?","answer":"The research provided doesn't include specific salary information for AI Backend Engineer positions. Compensation likely varies based on location, experience level, company size, and specific technical expertise with AI frameworks and backend technologies. As a specialized role combining both AI and backend development skills, salaries may be higher than standard backend engineering positions due to the additional expertise required."},{"question":"How long does it take to get hired as a AI Backend Engineer?","answer":"The research doesn't provide specific hiring timeline information for AI Backend Engineer roles. The hiring process likely includes technical assessments of both backend development skills and AI knowledge, coding challenges, and multiple interview rounds with engineering teams. Given the specialized nature of the position requiring both strong backend development skills and practical AI experience, the process may be more thorough than for generalist roles."},{"question":"Are AI Backend Engineer job in demand?","answer":"AI jobs, including Backend Engineer positions focusing on AI, appear to be in demand based on active hiring from major companies like Microsoft and Zoom. These companies seek candidates with 3-8+ years of experience depending on seniority level. The specialized skillset combining backend development expertise with AI knowledge makes these professionals valuable as organizations integrate more AI capabilities into their products and services."}]