AI Backend Engineer Jobs

Discover the latest remote and onsite AI Backend Engineer roles across top active AI companies. Updated hourly.

Check out 76 new AI Backend Engineer opportunities posted on AI Chopping Block

Software Engineer - Backend

New
Top rated
Resolve AI
Full-time
Full-time
Posted

Build simulation environments where AI agents can be trained and evaluated on realistic SRE work including debugging, incident response, infrastructure changes, and on-call grind. Work directly with Research Scientists and domain experts to translate real SRE scenarios into reproducible, graded environments. Own the architecture and implementation of large subsystems from design through long-term evolution, including infrastructure, tooling, data pipelines, and scoring. Design, build, and scale backend services and APIs that generate, run, and score scenarios in high-concurrency environments. Ensure reliability, scalability, and performance across the system, especially in distributed components. Ship initial versions quickly, observe performance, identify issues, and refine. Focus on creating environments that accurately reflect real production failures. Use AI tools throughout the development stack for code generation, scenario generation, and debugging to increase productivity.

Undisclosed

()

San Francisco, United States
Maybe global
Onsite

Software Engineer I, RLE

New
Top rated
Handshake
Full-time
Full-time
Posted

Build and scale core components of Reinforcement Learning Environments (RLE) and infrastructure, design and implement backend systems and data pipelines, translate ambiguous product and research needs into production systems, develop modular, reusable workflow domains, and improve reliability, observability, and system performance.

$157,500 – $175,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Staff Engineer, CPU Core Verification

New
Top rated
Tenstorrent
Full-time
Full-time
Posted

Lead and contribute to cross-functional efforts solving complex physical design challenges across IPs, projects, and advanced technology nodes. Develop and enhance RTL-to-GDS methodologies, including floorplanning, synthesis, P&R, STA, signoff, and assembly. Architect and deploy AI/ML-driven solutions in production flows to improve engineering efficiency, turnaround time, and QoR. Optimize EDA tools and custom CAD flows using data-driven and ML-based techniques, in close collaboration with verification, extraction, timing, DFT, and EDA vendors.

$100,000 – $500,000
Undisclosed
YEAR

(USD)

Austin or Santa Clara or Fort Collins, United States
Maybe global
Hybrid

Staff Software Engineer, Backend

New
Top rated
Harvey
Full-time
Full-time
Posted

As a Product Backend Engineer, you will design and operate backend systems that enable AI capabilities to provide dependable product experiences. Responsibilities include collaborating closely with Product to prioritize customer-focused work and deliver reliable features quickly, designing and owning backend services and APIs for web applications, workflows, and integrations, modeling and managing data in Postgres and related data stores, building secure, multi-tenant, permissions-aware systems with appropriate auditing, implementing backend features using LLMs and agentic tools, collaborating with frontend, product, and design teams to define API contracts and ship features end-to-end, adding logging, metrics, and tracing for service observability and on-call readiness, improving performance and scalability by profiling and tuning, and participating in code reviews, technical design discussions, and an on-call rotation for the services you own.

Undisclosed

()

Bengaluru, India
Maybe global
Remote

Senior Software Engineer, Backend

New
Top rated
Harvey
Full-time
Full-time
Posted

As a Product Backend Engineer, design and operate backend systems that enable AI capabilities to deliver seamless and dependable product experiences. Build secure, multi-tenant services, orchestrate interactions with large language models (LLMs) and agentic tools, and define backend architecture for expanding product offerings. Collaborate with Product to prioritize customer-focused work and deliver reliable features quickly. Design and own backend services and APIs supporting web applications, workflows, and integrations. Model and manage data in Postgres and related data stores to ensure low-latency and reliable user experiences. Build permissions-aware systems with appropriate auditing for enterprise and government customers. Implement backend features that interact with AI systems via robust, well-structured services. Collaborate with frontend, product, and design partners for solution design, API contract definition, and end-to-end feature delivery. Add logging, metrics, and tracing for service observability and on-call readiness. Improve performance and scalability by profiling, tuning, and refining service boundaries. Participate in code reviews, technical design discussions, and an on-call rotation for owned services.

Undisclosed

()

Bengaluru, India
Maybe global
Remote

Senior software engineer, enterprise AI platform (UK)

New
Top rated
Writer
Full-time
Full-time
Posted

Act as a whole-systems thinker by making meaningful system design decisions and owning the architecture of core platform components from initial design through production deployment. Develop secure generative AI services and applications using Python and modern frameworks to drive enterprise-wide transformation. Build and optimize high-performance and low-latency APIs and microservices for integrating advanced AI models and agentic workflows into the enterprise platform. Drive proactivity without red tape by clearly communicating changes, plans, and proposals to cross-functional teams without waiting for approval. Bridge the gap between backend services, infrastructure, and operations to ensure seamless deployments and scalable architecture.

Undisclosed

()

London, United Kingdom
Maybe global
Remote

Staff Software Engineer, CAPE

New
Top rated
Crusoe
Full-time
Full-time
Posted

The Staff Software Engineer is responsible for architecting, designing, and developing the intelligence layer that controls GPU node assignment, monetization, and management within Crusoe's fleet. They will be among the first engineers on the Virtual Pool Service and Capacity Management Intelligence systems, shaping implementation and making key design decisions, building foundational cloud platform infrastructure. Responsibilities include building the Virtual Pool Service as the source of truth for GPU node states and history, designing the Capacity Management Intelligence automation layer to handle allocation and automated node lifecycle transitions, collaborating cross-functionally to architect and implement physical infrastructure management systems, championing system reliability, scalability, and security, streamlining cloud deployment and operations using technologies such as Go, gRPC, NATS event streaming, PostgreSQL on Kubernetes, and Netbox, and mentoring engineers while contributing to team growth in collaboration with engineering management.

$209,000 – $253,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Software Engineer, Foundations Retrieval

New
Top rated
OpenAI
Full-time
Full-time
Posted

Build and scale retrieval infrastructure across indexing, serving, and query execution. Develop low-latency, high-throughput systems for real-time model interaction. Partner with research to productionize embedding and retrieval techniques. Support dense, sparse, and hybrid retrieval pipelines. Own system performance, reliability, and observability at scale. Collaborate across Pretraining, Inference, and Product teams to integrate retrieval end-to-end. Contribute to model-system interfaces for agentic workflows.

$380,000 – $555,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Senior Backend / Systems Engineer (AI) - San Mateo, CA

New
Top rated
Trustlab
Full-time
Full-time
Posted

Design and build extensible backend systems supporting flexible configurations for different customers and content types. Develop infrastructure interfacing with LLMs to enable prompt engineering, context injection, and modular evaluation workflows. Build tooling and platforms for fast iteration by AI engineers and analysts, including declarative pipelines, parameterized jobs, and reproducible experiments. Prioritize ease of deployment, integration, and testing for internal teams and external partners. Collaborate closely with product, data, and policy teams to translate nuanced safety needs into scalable, maintainable software systems.

$150,000 – $220,000
Undisclosed
YEAR

(USD)

San Mateo, United States
Maybe global
Remote

Software Engineer, Agent

New
Top rated
Sierra
Full-time
Full-time
Posted

Design and deliver production-grade AI agents that are highly performant, reliable, and intuitive, running in production environments across industries like finance, healthcare, and commerce. Own and drive the entire Agent Development Life Cycle (ADLC) from initial pilot through deployment and continuous iteration, building, tuning, and evolving AI agents in production environments and defining best practices for ADLC. Partner directly with leaders at large enterprises and cutting-edge startups to understand their business challenges and build AI agents that transform their operations at scale. Collaborate with customers to guide the evolution of Sierra's core platform by surfacing unmet needs, prototyping new tools and features, and working with research, product, and platform teams to shape the future of AI agent development and Sierra's product.

A$235,000 – A$425,000
Undisclosed
YEAR

(AUD)

Sydney, Australia
Maybe global
Remote

Want to see more AI Backend Engineer jobs?

View all jobs

Access all 4,256 remote & onsite AI jobs.

Join our private AI community to unlock full job access, and connect with founders, hiring managers, and top AI professionals.
(Yes, it’s still free—your best contributions are the price of admission.)

Frequently Asked Questions

Have questions about roles, locations, or requirements for AI Backend Engineer jobs?

Question text goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

[{"question":"What does a AI Backend Engineer do?","answer":"AI Backend Engineers develop and maintain the scalable, secure services that power AI-driven applications. They build backend systems that ensure high availability and performance while integrating AI capabilities into core products. Their work includes designing machine learning pipelines, managing data flows, transforming ML models into APIs, and exploring advanced technologies like Agent Reasoning and Agentic RAG. They regularly collaborate with frontend, product, and data science teams."},{"question":"What skills are required for AI Backend Engineer?","answer":"Strong programming skills in languages like Python, Go, Java, or Node.js are essential for this role. Proficiency with AI frameworks such as LangChain, LangGraph, TensorFlow, and PyTorch is typically required. Experience with distributed systems, microservices architecture, databases, and cloud-native technologies is important. Problem-solving abilities and practical experience with AI agents round out the technical skillset, while cross-functional collaboration skills are equally valuable."},{"question":"What qualifications are needed for AI Backend Engineer role?","answer":"Most AI Backend Engineer positions require a Bachelor's degree or higher in Computer Science, Software Engineering, or related technical fields. Companies typically seek candidates with 3-8+ years of backend development experience, with the specific requirement varying by seniority. Practical experience working with AI agents and frameworks is increasingly important, as is a demonstrated history of building scalable backend systems that support machine learning applications."},{"question":"What is the salary range for AI Backend Engineer job?","answer":"The research provided doesn't include specific salary information for AI Backend Engineer positions. Compensation likely varies based on location, experience level, company size, and specific technical expertise with AI frameworks and backend technologies. As a specialized role combining both AI and backend development skills, salaries may be higher than standard backend engineering positions due to the additional expertise required."},{"question":"How long does it take to get hired as a AI Backend Engineer?","answer":"The research doesn't provide specific hiring timeline information for AI Backend Engineer roles. The hiring process likely includes technical assessments of both backend development skills and AI knowledge, coding challenges, and multiple interview rounds with engineering teams. Given the specialized nature of the position requiring both strong backend development skills and practical AI experience, the process may be more thorough than for generalist roles."},{"question":"Are AI Backend Engineer job in demand?","answer":"AI jobs, including Backend Engineer positions focusing on AI, appear to be in demand based on active hiring from major companies like Microsoft and Zoom. These companies seek candidates with 3-8+ years of experience depending on seniority level. The specialized skillset combining backend development expertise with AI knowledge makes these professionals valuable as organizations integrate more AI capabilities into their products and services."}]