AI Backend Engineer Jobs

Discover the latest remote and onsite AI Backend Engineer roles across top active AI companies. Updated hourly.

Check out 76 new AI Backend Engineer opportunities posted on AI Chopping Block

Backend Software Engineer, ChatGPT ImageGen

New
Top rated
OpenAI
Full-time
Full-time
Posted

Design, build, and operate backend systems that power image generation and image editing experiences in ChatGPT. Develop scalable APIs, services, and infrastructure that support multimodal AI workflows. Optimize reliability, latency, throughput, and cost across large-scale distributed systems. Partner with researchers to productionize new image generation capabilities and bring them to users quickly and safely. Collaborate closely with Android, iOS, web, and full-stack engineers to build seamless end-to-end product experiences. Drive technical architecture decisions across storage, serving, orchestration, and platform systems. Use data and experimentation to identify opportunities for improving user experience, performance, and system efficiency. Help shape engineering culture through technical leadership, mentorship, and operational excellence.

$185,000 – $305,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Remote

Engineering Manager, RLE

New
Top rated
Handshake
Full-time
Full-time
Posted

Build and scale reinforcement learning environments and platforms behind them; drive architecture for scalable, reliable, extensible environment systems and data generation pipelines; partner with Research, Product, and Ops teams to turn ambiguous needs into production systems; build modular, plug-and-play domains that integrate cleanly with training and evaluation loops; improve reliability, observability, performance, and data quality of systems.

Undisclosed

()

Bengaluru, India
Maybe global
Onsite

Software Engineer, Backend

New
Top rated
Exa
Full-time
Full-time
Posted

As a backend engineer, you would play a critical role in the search architecture at Exa. Your work may involve building massive-scale machine learning systems, working on projects based on your skills and interests, such as recreating Google-level keyword search over 10 billion pages in one month, building state-of-the-art crawling systems that work optimally for any website, and building custom vector databases that can run over a billion vectors in under 100 milliseconds.

SGD 90,000 – SGD 300,000
Undisclosed
YEAR

(SGD)

Singapore, Singapore
Maybe global
Onsite

Software engineer, generative AI

New
Top rated
Writer
Full-time
Full-time
Posted

Design and develop robust, secure, and scalable generative AI services and applications using Python and modern frameworks to drive enterprise-wide transformation. Build and optimize high-performance, low-latency APIs and microservices to integrate advanced AI models and sophisticated agentic workflows into the core platform. Make meaningful system design decisions and own the architecture of core platform components from initial proposal through production deployment. Implement and maintain responsive user interfaces using technologies like React and TypeScript to deliver intuitive user experiences and bridge the gap between backend services and frontend enablement. Communicate changes, plans, and proposals clearly to cross-functional teams and collaborate closely with product managers, data scientists, and DevOps engineers. Partner with DevOps teams to build continuous deployment, logging, and monitoring systems that ensure top-tier performance, security, and reliability across distributed workloads.

$111,700 – $304,100
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Remote

Software Engineer, ML Data Infrastructure

New
Top rated
Ideogram
Full-time
Full-time
Posted

The Software Engineer, ML Data Infrastructure will collaborate with engineers to build advanced AI design experiences, tackle complex technical challenges including scaling distributed systems and enabling generative media experiences, build robust data infrastructure at petabyte scale ensuring reliability and performance across multi-modal training pipelines, optimize data processing workflows for high throughput involving distributed systems, TPU infrastructure, and large-scale storage, and partner with research scientists to understand data requirements and translate them into production-grade systems to accelerate model development cycles.

Undisclosed

()

Toronto, Canada
Maybe global
Onsite

Full Stack Engineer, AI systems

New
Top rated
Bjak
Full-time
Full-time
Posted

Build end-to-end product features across frontend, backend, and AI integrations; design agent workflows that handle planning, tool use, failure, and recovery across multiple steps; integrate LLMs, memory, and external tools into systems that behave reliably under real-world conditions; design real-time AI interactions with streaming, partial results, and tight latency constraints; improve system reliability, observability, and fallback mechanisms; collaborate closely with ML, backend, and product teams to ship features end-to-end; continuously iterate based on real usage and failure modes.

Undisclosed

()

Seoul, South Korea
Maybe global
Remote

Backend Engineer, AI (Agent Systems)

New
Top rated
Bjak
Full-time
Full-time
Posted

As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. You build and operate backend systems that serve AI-powered features in production, design inference pipelines, orchestration layers, and service boundaries around models. You are responsible for production concerns such as monitoring, logging, alerting, and incident response. Additionally, you optimize latency and throughput across inference, caching, batching, and streaming. Your work enables backend systems to run reliably at scale, handling production AI traffic with low latency and high throughput, ensuring APIs are stable, clear, and support seamless integration with frontend and ML systems. You ensure production incidents are quickly detected, diagnosed, and resolved, minimizing user impact, and continuously improve system performance and reliability through iterative changes based on real usage.

Undisclosed

()

Seoul, South Korea
Maybe global
Remote

Senior Software Engineer (FastAPI & Async Python)

New
Top rated
Photoroom
Full-time
Full-time
Posted

Collaborate with the AI Tools squad to implement and improve AI features in the Photoroom app, including Logo maker, AI Images, AI Videos, and other features on the app homepage. Design and architect new features by chaining a mix of internal and external services to generate images and videos for users. Monitor and scale the growing load on the FastAPI service using Datadog to find optimizations and bottlenecks or implement smart caching of pipeline steps.

€100,000 – €110,000
Undisclosed
YEAR

(EUR)

Paris, France
Maybe global
Remote

Senior Backend / Systems Engineer (AI) - San Mateo, CA

New
Top rated
Trustlab
Full-time
Full-time
Posted

Design and build extensible backend systems that support flexible configurations for different customers and content types. Develop infrastructure that interfaces cleanly with large language models (LLMs), enabling prompt engineering, context injection, and modular evaluation workflows. Build tooling and platforms that enable fast iteration by AI engineers and analysts, including declarative pipelines, parameterized jobs, and reproducible experiments. Prioritize ease of deployment, integration, and testing for both internal teams and external partners. Collaborate closely with product, data, and policy teams to translate nuanced safety needs into scalable, maintainable software systems.

$150,000 – $220,000
Undisclosed
YEAR

(USD)

San Mateo, United States
Maybe global
Remote

Software Engineer, Backend

New
Top rated
Mirage
Full-time
Full-time
Posted

Design, build, and own backend systems end-to-end, including services, APIs, data pipelines, and infrastructure that power the products. Solve complex technical challenges across distributed systems, scaling, concurrency, and performance. Integrate and operate large generative AI models in production, including deploying, serving, and scaling systems that combine internal research and external capabilities. Instrument, experiment, and iterate in production to continuously improve system and product quality. Design and operate core platform infrastructure, including integrations with third-party providers, storage systems, security, and internal APIs.

$175,000 – $275,000
Undisclosed
YEAR

(USD)

Union Square or New York, United States
Maybe global
Onsite

Want to see more AI Backend Engineer jobs?

View all jobs

Access all 4,256 remote & onsite AI jobs.

Join our private AI community to unlock full job access, and connect with founders, hiring managers, and top AI professionals.
(Yes, it’s still free—your best contributions are the price of admission.)

Frequently Asked Questions

Have questions about roles, locations, or requirements for AI Backend Engineer jobs?

Question text goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

[{"question":"What does a AI Backend Engineer do?","answer":"AI Backend Engineers develop and maintain the scalable, secure services that power AI-driven applications. They build backend systems that ensure high availability and performance while integrating AI capabilities into core products. Their work includes designing machine learning pipelines, managing data flows, transforming ML models into APIs, and exploring advanced technologies like Agent Reasoning and Agentic RAG. They regularly collaborate with frontend, product, and data science teams."},{"question":"What skills are required for AI Backend Engineer?","answer":"Strong programming skills in languages like Python, Go, Java, or Node.js are essential for this role. Proficiency with AI frameworks such as LangChain, LangGraph, TensorFlow, and PyTorch is typically required. Experience with distributed systems, microservices architecture, databases, and cloud-native technologies is important. Problem-solving abilities and practical experience with AI agents round out the technical skillset, while cross-functional collaboration skills are equally valuable."},{"question":"What qualifications are needed for AI Backend Engineer role?","answer":"Most AI Backend Engineer positions require a Bachelor's degree or higher in Computer Science, Software Engineering, or related technical fields. Companies typically seek candidates with 3-8+ years of backend development experience, with the specific requirement varying by seniority. Practical experience working with AI agents and frameworks is increasingly important, as is a demonstrated history of building scalable backend systems that support machine learning applications."},{"question":"What is the salary range for AI Backend Engineer job?","answer":"The research provided doesn't include specific salary information for AI Backend Engineer positions. Compensation likely varies based on location, experience level, company size, and specific technical expertise with AI frameworks and backend technologies. As a specialized role combining both AI and backend development skills, salaries may be higher than standard backend engineering positions due to the additional expertise required."},{"question":"How long does it take to get hired as a AI Backend Engineer?","answer":"The research doesn't provide specific hiring timeline information for AI Backend Engineer roles. The hiring process likely includes technical assessments of both backend development skills and AI knowledge, coding challenges, and multiple interview rounds with engineering teams. Given the specialized nature of the position requiring both strong backend development skills and practical AI experience, the process may be more thorough than for generalist roles."},{"question":"Are AI Backend Engineer job in demand?","answer":"AI jobs, including Backend Engineer positions focusing on AI, appear to be in demand based on active hiring from major companies like Microsoft and Zoom. These companies seek candidates with 3-8+ years of experience depending on seniority level. The specialized skillset combining backend development expertise with AI knowledge makes these professionals valuable as organizations integrate more AI capabilities into their products and services."}]