AI Backend Engineer Jobs

Discover the latest remote and onsite AI Backend Engineer roles across top active AI companies. Updated hourly.

Check out 76 new AI Backend Engineer opportunities posted on AI Chopping Block

Full Stack Engineer, AI systems

New
Top rated
Bjak
Full-time
Full-time
Posted

Build end-to-end product features across frontend, backend, and AI integrations; design agent workflows that handle planning, tool use, failure, and recovery across multiple steps; integrate LLMs, memory, and external tools into systems that behave reliably under real-world conditions; design real-time AI interactions with streaming, partial results, and tight latency constraints; improve system reliability, observability, and fallback mechanisms; collaborate closely with ML, backend, and product teams to ship features end-to-end; continuously iterate based on real usage and failure modes.

Undisclosed

()

Seoul, South Korea
Maybe global
Remote

Backend Engineer, AI (Agent Systems)

New
Top rated
Bjak
Full-time
Full-time
Posted

As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. You build and operate backend systems that serve AI-powered features in production, design inference pipelines, orchestration layers, and service boundaries around models. You are responsible for production concerns such as monitoring, logging, alerting, and incident response. Additionally, you optimize latency and throughput across inference, caching, batching, and streaming. Your work enables backend systems to run reliably at scale, handling production AI traffic with low latency and high throughput, ensuring APIs are stable, clear, and support seamless integration with frontend and ML systems. You ensure production incidents are quickly detected, diagnosed, and resolved, minimizing user impact, and continuously improve system performance and reliability through iterative changes based on real usage.

Undisclosed

()

Seoul, South Korea
Maybe global
Remote

Senior Software Engineer (FastAPI & Async Python)

New
Top rated
Photoroom
Full-time
Full-time
Posted

Collaborate with the AI Tools squad to implement and improve AI features in the Photoroom app, including Logo maker, AI Images, AI Videos, and other features on the app homepage. Design and architect new features by chaining a mix of internal and external services to generate images and videos for users. Monitor and scale the growing load on the FastAPI service using Datadog to find optimizations and bottlenecks or implement smart caching of pipeline steps.

€100,000 – €110,000
Undisclosed
YEAR

(EUR)

Paris, France
Maybe global
Remote

Senior Backend / Systems Engineer (AI) - San Mateo, CA

New
Top rated
Trustlab
Full-time
Full-time
Posted

Design and build extensible backend systems that support flexible configurations for different customers and content types. Develop infrastructure that interfaces cleanly with large language models (LLMs), enabling prompt engineering, context injection, and modular evaluation workflows. Build tooling and platforms that enable fast iteration by AI engineers and analysts, including declarative pipelines, parameterized jobs, and reproducible experiments. Prioritize ease of deployment, integration, and testing for both internal teams and external partners. Collaborate closely with product, data, and policy teams to translate nuanced safety needs into scalable, maintainable software systems.

$150,000 – $220,000
Undisclosed
YEAR

(USD)

San Mateo, United States
Maybe global
Remote

Software Engineer, Backend

New
Top rated
Mirage
Full-time
Full-time
Posted

Design, build, and own backend systems end-to-end, including services, APIs, data pipelines, and infrastructure that power the products. Solve complex technical challenges across distributed systems, scaling, concurrency, and performance. Integrate and operate large generative AI models in production, including deploying, serving, and scaling systems that combine internal research and external capabilities. Instrument, experiment, and iterate in production to continuously improve system and product quality. Design and operate core platform infrastructure, including integrations with third-party providers, storage systems, security, and internal APIs.

$175,000 – $275,000
Undisclosed
YEAR

(USD)

Union Square or New York, United States
Maybe global
Onsite

Software Engineer, Core Science

New
Top rated
OpenAI
Full-time
Full-time
Posted

As a Software Engineer, Core Science, you will help design and build the platforms, products, and infrastructure powering AI-native scientific research workflows inside Codex. You will own systems end-to-end from architecture and implementation to evaluation, launch, and production operations, focusing on quality and velocity. Responsibilities include building backend services, data and orchestration pipelines, model-powered workflows, and user-facing experiences. You will shape AI-powered scientific research by building backend systems and full-stack product experiences across Prism and Codex. Develop AI-native workflows for paper writing, literature review, paper understanding, research synthesis, and scientific knowledge exploration. Partner closely with researchers and domain experts across biology and adjacent scientific disciplines to understand research workflows, identify AI opportunities, and translate scientific needs into product capabilities. Build AI-powered tools for scientific data analysis and simulation to help researchers explore data, run experiments, interpret results, and iterate on models or hypotheses. Assist in establishing product, platform, and engineering foundations for fast-moving 0 to 1 efforts, balancing rapid experimentation with rigor and reliability required for research tools.

$293,000 – $385,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Hybrid

Senior Backend Engineer

New
Top rated
Chattermill
Full-time
Full-time
Posted

Design, build, and maintain scalable backend services and APIs that power Chattermill’s core analytics platform. Architect reliable, maintainable distributed systems and contribute to the evolution of backend service design and infrastructure. Own end-to-end delivery of backend engineering workstreams, from technical scoping and architecture through to implementation, testing, observability, and production support. Integrate language models, agentic frameworks, and AI pipelines into core product and backend services. Drive performance, reliability, and observability across high-throughput distributed data systems, including logging, tracing, alerting, and incident response. Work with cloud infrastructure and distributed systems in GCP (preferred) or AWS environments. Collaborate closely with Product to define scope, shape technical solutions, and explore new platform capabilities and features. Contribute to engineering excellence through code reviews, architectural discussions, and continuous improvement of development standards across the team.

Undisclosed

()

United Kingdom, Europe
Maybe global
Remote

Senior Software Engineer

New
Top rated
Hiya
Full-time
Full-time
Posted

Own the complete development lifecycle for spam and scam detection infrastructure including research, proposing solutions, implementation, testing, deployment, production maintenance, and monitoring. Participate in on-call rotation for rapid recognition and resolution of production issues while improving system reliability. Design and build frameworks that enable data scientists to develop, test, and deploy complex scam detection models with access to call data in a privacy-aware and regulation-compliant manner. Make independent implementation decisions while driving collaborative design discussions to improve system quality, maintainability, and cost-effectiveness. Evaluate critical tradeoffs between immediate fixes and durable solutions prioritizing service quality and system resilience. Collaborate with product managers, data scientists, and engineering teams to align technical decisions with business impact and user needs. Recognize and promote engineering patterns, design principles, and architectural decisions across teams to raise quality and execution speed. Influence team operations by pushing back on non-aligned solutions, surfacing issues early in project planning, and reasoning about business impact versus cost.

Undisclosed

()

Budapest, Hungary
Maybe global
Hybrid

Senior Software Engineer, Events

New
Top rated
Haydenai
Full-time
Full-time
Posted

As a Senior Software Engineer on the Platform - Cloud Events team, you will ensure that data captured by Hayden's devices is properly validated and assessed by ML models that run in the Cloud. You will improve ML operations by enabling a more efficient model improvement lifecycle, work closely with the Product Team, Technical Program Managers, and partner engineering teams to build edge software and interpret sensor data. Responsibilities include maintaining high code quality through code review and documentation, optimizing machine learning operations with robust systems and cross-team collaboration, expanding the event pipeline capabilities to meet general and client-specific needs, and reducing business costs by optimizing the usage of cloud resources, especially GPUs.

$175,000 – $228,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Hybrid

Nivii - Software Engineer, AI/LLM Platform

New
Top rated
Silver.dev
Full-time
Full-time
Posted

Diseñar, construir y operar servicios core de la plataforma que soportan los flujos de AI/LLM. Desarrollar y correr sistemas basados en LLM, como text-to-SQL, reasoning agents y planners, enfocándose en confiabilidad, performance y costos. Construir y mantener servicios backend y APIs que orquestan pipelines complejos y multi-step. Trabajar hands-on con infraestructura basada en Kubernetes, incluyendo despliegues, escalado y debugging en producción. Contribuir a workflows de DevOps y MLOps, incluyendo CI/CD, ambientes, monitoreo, logging y buenas prácticas operativas. Participar en decisiones de arquitectura relacionadas con observabilidad, manejo de fallas, evaluación y trade-offs del sistema. Colaborar directamente con los fundadores y el equipo de producto para transformar problemas reales de negocio en soluciones técnicas robustas.

Undisclosed

()

Buenos Aires, Argentina
Maybe global
Hybrid

Want to see more AI Backend Engineer jobs?

View all jobs

Access all 4,256 remote & onsite AI jobs.

Join our private AI community to unlock full job access, and connect with founders, hiring managers, and top AI professionals.
(Yes, it’s still free—your best contributions are the price of admission.)

Frequently Asked Questions

Have questions about roles, locations, or requirements for AI Backend Engineer jobs?

Question text goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

[{"question":"What does a AI Backend Engineer do?","answer":"AI Backend Engineers develop and maintain the scalable, secure services that power AI-driven applications. They build backend systems that ensure high availability and performance while integrating AI capabilities into core products. Their work includes designing machine learning pipelines, managing data flows, transforming ML models into APIs, and exploring advanced technologies like Agent Reasoning and Agentic RAG. They regularly collaborate with frontend, product, and data science teams."},{"question":"What skills are required for AI Backend Engineer?","answer":"Strong programming skills in languages like Python, Go, Java, or Node.js are essential for this role. Proficiency with AI frameworks such as LangChain, LangGraph, TensorFlow, and PyTorch is typically required. Experience with distributed systems, microservices architecture, databases, and cloud-native technologies is important. Problem-solving abilities and practical experience with AI agents round out the technical skillset, while cross-functional collaboration skills are equally valuable."},{"question":"What qualifications are needed for AI Backend Engineer role?","answer":"Most AI Backend Engineer positions require a Bachelor's degree or higher in Computer Science, Software Engineering, or related technical fields. Companies typically seek candidates with 3-8+ years of backend development experience, with the specific requirement varying by seniority. Practical experience working with AI agents and frameworks is increasingly important, as is a demonstrated history of building scalable backend systems that support machine learning applications."},{"question":"What is the salary range for AI Backend Engineer job?","answer":"The research provided doesn't include specific salary information for AI Backend Engineer positions. Compensation likely varies based on location, experience level, company size, and specific technical expertise with AI frameworks and backend technologies. As a specialized role combining both AI and backend development skills, salaries may be higher than standard backend engineering positions due to the additional expertise required."},{"question":"How long does it take to get hired as a AI Backend Engineer?","answer":"The research doesn't provide specific hiring timeline information for AI Backend Engineer roles. The hiring process likely includes technical assessments of both backend development skills and AI knowledge, coding challenges, and multiple interview rounds with engineering teams. Given the specialized nature of the position requiring both strong backend development skills and practical AI experience, the process may be more thorough than for generalist roles."},{"question":"Are AI Backend Engineer job in demand?","answer":"AI jobs, including Backend Engineer positions focusing on AI, appear to be in demand based on active hiring from major companies like Microsoft and Zoom. These companies seek candidates with 3-8+ years of experience depending on seniority level. The specialized skillset combining backend development expertise with AI knowledge makes these professionals valuable as organizations integrate more AI capabilities into their products and services."}]