AI Program Manager Jobs

Discover the latest remote and onsite AI Program Manager roles across top active AI companies. Updated hourly.

Check out 139 new AI Program Manager opportunities posted on The Homebase

Compliance Program Manager

New
Top rated
Grammarly
Full-time
Full-time
Posted

Own the observability and lifecycle management of AI features across the organization. Build tools and infrastructure to enable teams to develop, monitor, and optimize LLM-powered features. Design and implement closed-loop evaluation pipelines that automatically validate prompt changes. Develop comprehensive metrics and dashboards to track LLM usage, including cost per feature, token patterns, and latency. Create systems that connect user feedback to specific prompts and LLM calls. Establish best practices and processes for the full lifecycle of prompts: development, testing, deployment, and monitoring. Collaborate with engineering teams across the organization to ensure they have the tools and visibility needed to build high-quality AI features.

$103,000 – $174,000
Undisclosed
YEAR

(USD)

Ukraine
Maybe global
Remote

Manager/Sr. Manager, Biopharma Marketing

New
Top rated
PathAI
Full-time
Full-time
Posted

Lead the team responsible for the AI/ML Stack infrastructure that bridges ML research and large-scale production, evolving the stack to meet scalability needs in ML training and inference workloads. Develop and execute the long-term vision and roadmap for the MLOps team to support ML development and deployment across business units, balancing short-term tactical deliveries and long-term architectural transformation. Manage and mentor a team of 6-7+ engineers, allocate resources strategically to support existing services and strategic initiatives. Collaborate across machine learning, data science, product engineering, and infrastructure teams to identify and address bottlenecks and facilitate deployment of new solutions. Architect compute and storage pipelines to manage large datasets without fragmentation or latency. Modernize the AI product inference stack to support significant growth in AI runs globally. Work with Site Reliability Engineering to establish comprehensive system observability metrics. Conduct build vs. buy assessments and technology stack refresh audits to benchmark and ensure best toolsets are in use.

$181,500 – $278,300
Undisclosed
YEAR

(USD)

Boston
Maybe global
Remote

Chief Technology Officer

New
Top rated
Bjak
Full-time
Full-time
Posted

The Chief Technology Officer is responsible for defining the long-term architecture for A1's AI systems, infrastructure, and developer platform, evaluating trade-offs between speed of iteration and long-term system design, and ensuring systems are designed for scalability, reliability, and long-term evolution. They guide key decisions across model integration, data pipelines, distributed systems, and product architecture. The CTO works with engineers to translate product direction into clear technical execution, helps structure engineering workstreams and maintain team alignment on priorities, maintains high engineering standards while encouraging shipping, and establishes engineering culture, development practices, and technical standards across the company. They build and scale a world-class engineering team across key talent hubs including China and the US, identify strong technical leaders, define hiring standards and interview processes, and ensure technical workstreams move forward smoothly across teams and locations. The CTO works closely with product, research, and leadership teams and helps resolve cross-team technical and execution challenges.

Undisclosed

()

New York, United States
Maybe global
Remote

Chief Technology Officer

New
Top rated
Bjak
Full-time
Full-time
Posted

The Chief Technology Officer will define the long-term architecture for A1’s AI systems, infrastructure, and developer platform, evaluate trade-offs between speed of iteration and long-term system design, and ensure systems are designed for scalability, reliability, and long-term evolution. They will guide key decisions across model integration, data pipelines, distributed systems, and product architecture. The CTO will work with engineers to translate product direction into clear technical execution, help structure engineering workstreams and keep teams aligned on priorities, maintain high engineering standards while focusing on shipping, and establish engineering culture, development practices, and technical standards. Additionally, they will build and scale a world-class engineering team across key talent hubs including China and the US, identify strong technical leaders, define hiring standards and interview processes, work closely with product, research, and leadership teams, ensure technical workstreams move forward smoothly across teams and locations, and help resolve cross-team technical and execution challenges.

Undisclosed

()

Beijing, China
Maybe global
Remote

Program Manager, Data Center Delivery

New
Top rated
Together AI
Full-time
Full-time
Posted

Advance inference efficiency end-to-end by designing and prototyping algorithms, architectures, and scheduling strategies for low-latency, high-throughput inference. Implement and maintain changes in high-performance inference engines such as SGLang- or vLLM-style systems and Together’s inference stack, including kernel backends, speculative decoding like ATLAS, and quantization. Profile and optimize performance across GPU, networking, and memory layers to improve latency, throughput, and cost. Design and operate RL and post-training pipelines, optimizing algorithms and systems for efficiency where inference constitutes the majority of the cost. Make RL and post-training workloads more efficient with inference-aware training loops, async RL rollouts, and speculative decoding to reduce large-scale rollout collection and evaluation costs. Use these pipelines to train, evaluate, and iterate on frontier models atop the inference stack. Co-design algorithms and infrastructure for tightly coupled objectives, rollout collection, and evaluation with efficient inference, and identify bottlenecks across training engines, inference engines, data pipelines, and user-facing layers. Conduct ablations and scale-up experiments to analyze trade-offs among model quality, latency, throughput, and cost, using insights to inform model, RL, and system design. Profile, debug, and optimize inference and post-training services under production workloads. Lead roadmap efforts that require engine modifications including changes to kernels, memory layouts, scheduling logic, and APIs. Establish metrics, benchmarks, and experimentation frameworks to validate improvements rigorously. Provide technical leadership by setting technical direction for cross-team efforts at the intersection of inference, RL, and post-training and mentoring engineers and researchers in full-stack ML systems work and performance engineering.

$200,000 – $280,000
Undisclosed
YEAR

(USD)

San Francisco
Maybe global
Onsite

Senior Engineering Manager, Handshake AI

New
Top rated
Handshake
Full-time
Full-time
Posted

The Senior Engineering Manager leads a core product and platform engineering team responsible for building systems that integrate human expertise into AI development workflows. The team owns critical infrastructure connecting talent networks, data operations, and research needs into scalable, reliable, and high-quality platforms. The role involves leading, hiring, and developing a high-performing engineering team, owning roadmap and execution in close partnership with Product, Research, and Operations, driving architecture and technical strategy for scalable and extensible systems, building modular platforms to enable new domains and workflows to launch quickly, raising engineering quality across reliability, observability, performance, and data integrity, and fostering a culture of ownership, velocity, and strong engineering fundamentals in a fast-moving, ambiguity-heavy environment.

$230,000 – $300,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Director, Forward Deployed Engineering

New
Top rated
Harvey
Full-time
Full-time
Posted

As Director of Forward Deployed Engineering at Harvey, you will own the program end-to-end for the Forward Deployed Engineering team, which delivers a tailored experience for strategically important accounts. Your responsibilities include building, hiring, and managing a team of software engineers and managers deployed into strategic accounts. You will define staffing models, engagement structures, capacity allocation, and develop specialist pods of engineers for new verticals such as M&A, litigation, fund formation, and compliance. You are responsible for setting and upholding quality standards for client deliverables, documentation, and knowledge transfer. In terms of technical execution, you will maintain deep technical fluency to accurately scope custom builds, unblock engineering decisions, and evaluate the quality of delivered solutions. You will oversee the design and implementation of tailored workflows, retrieval systems, agent tools, and knowledge sources built on Harvey's platform, ensuring these solutions are operationalized with evaluations, documentation, and user training. Additionally, you will identify patterns across client engagements that highlight gaps or opportunities in Harvey's core platform and bring these insights to product and engineering leadership with specificity about client needs, frequency, and generalization requirements.

$320,000 – $360,000
Undisclosed
YEAR

(USD)

New York, United States
Maybe global
Onsite

Senior Program Manager, Infrastructure Strategy and Business Operations

New
Top rated
Together AI
Full-time
Full-time
Posted

Advance inference efficiency end-to-end by designing and prototyping algorithms, architectures, and scheduling strategies for low-latency, high-throughput inference; implement and maintain changes in high-performance inference engines, including kernel backends, speculative decoding, and quantization; profile and optimize performance across GPU, networking, and memory layers to improve latency, throughput, and cost. Unify inference with RL/post-training by designing and operating RL and post-training pipelines, making workloads more efficient with inference-aware training loops, and using these pipelines to train, evaluate, and iterate on frontier models. Co-design algorithms and infrastructure to tightly couple objectives, rollout collection, and evaluation to efficient inference and identify bottlenecks across the training engine, inference engine, data pipeline, and user-facing layers. Run ablations and scale-up experiments to understand trade-offs between model quality, latency, throughput, and cost, feeding insights back into model, RL, and system design. Own critical systems at production scale by profiling, debugging, and optimizing inference and post-training services; drive roadmap items requiring engine modification; establish metrics, benchmarks, and experimentation frameworks to validate improvements rigorously. Provide technical leadership by setting technical direction for cross-team efforts and mentoring engineers and researchers on full-stack ML systems and performance engineering.

$200,000 – $280,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Manager, Forward Deployed Engineer (FDE), Life Sciences

New
Top rated
OpenAI
Full-time
Full-time
Posted

Lead and grow a team of Forward Deployed Engineers (FDEs) delivering production AI systems across regulated life sciences environments; be accountable for the team’s end-to-end delivery outcomes, balancing scope, speed, robustness, and risk in high-stakes deployments; coach and develop engineers through direct feedback, high technical standards, and clear expectations for execution and ownership; operate as a player-coach by directly contributing to production systems while leading, coaching, and setting technical direction; guide teams through ambiguous, multi-workstream engagements spanning data, workflows, infrastructure, security, and scientific stakeholders; run evaluation loops measuring model and system quality against workflow-specific scientific benchmarks and convert results into clear roadmap input.

$252,000 – $335,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Hybrid

Senior Engineering Manager, Reinforcement Learning Environments (RLE)

New
Top rated
Handshake
Full-time
Full-time
Posted

Lead and grow a high-performing team of 8–9 engineers building reinforcement learning environments. Manage, mentor, and develop senior engineers and future engineering leaders. Partner closely with research, product, and operations teams to define roadmap and execution priorities. Drive technical architecture for scalable, reliable, and extensible environment systems. Build plug-and-play environments that integrate seamlessly with model training pipelines. Balance platform rigor with operational complexity and data quality requirements. Establish engineering best practices around reliability, observability, and performance. Foster a culture of ownership, velocity, and high technical standards.

$230,000 – $280,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Want to see more AI Program Manager jobs?

View all jobs

Access all 4,256 remote & onsite AI jobs.

Join our private AI community to unlock full job access, and connect with founders, hiring managers, and top AI professionals.
(Yes, it’s still free—your best contributions are the price of admission.)

Frequently Asked Questions

Have questions about roles, locations, or requirements for AI Program Manager jobs?

Question text goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

[{"question":"What does an AI Program Manager do?","answer":"AI Program Managers lead cross-functional teams to deliver artificial intelligence and machine learning initiatives. They develop program plans, budgets, timelines, and AI roadmaps aligned with business objectives. Their daily responsibilities include tracking progress metrics, identifying roadblocks, and mitigating risks in AI implementation. They ensure data assets and models remain discoverable and reusable across the organization. A crucial aspect of their role involves translating complex technical concepts for non-technical stakeholders and championing ethical AI practices. They also oversee the governance and enterprise-wide adoption of AI systems while managing development teams building specialized AI tools."},{"question":"What skills are required for AI Program Manager jobs?","answer":"Successful AI Program Managers need exceptional organizational abilities to juggle multiple AI initiatives simultaneously. Strong communication skills are essential for translating technical AI concepts to various stakeholders. Risk management expertise helps identify and mitigate potential roadblocks in AI implementation. Knowledge of AI/ML technologies enables effective collaboration with technical teams on model evaluation and measurement frameworks. Project management skills, including timeline forecasting and resource allocation, keep AI programs on track. Experience with data governance ensures proper handling of training datasets. Leadership abilities are crucial for guiding cross-functional teams, while ethical judgment supports responsible AI development and deployment."},{"question":"What qualifications are needed for AI Program Manager jobs?","answer":"Employers typically seek candidates with a bachelor's degree in computer science, business, or related fields, though advanced degrees can be advantageous. Professional certifications in project management (PMP) or agile methodologies (Scrum) demonstrate foundational program management expertise. Experience managing technical projects, particularly those involving data science or machine learning, is highly valued. Understanding of AI model evaluation frameworks helps when engaging with technical teams. Prior experience coordinating cross-functional teams and managing complex budgets strengthens applications. While not always required, technical programming knowledge or data science experience provides credibility when leading AI initiatives and communicating with development teams."},{"question":"What is the salary range for AI Program Manager jobs?","answer":"Several factors influence AI Program Manager compensation, including geographical location, company size, industry, and the complexity of AI initiatives being managed. Experience level significantly impacts earning potential, with senior roles commanding higher salaries. The technical depth required varies by position—roles needing deeper AI expertise generally offer higher compensation. Organizations leading in AI adoption, such as major tech companies and specialized AI firms, typically pay premium rates. Additional factors affecting salary include the scope of responsibility, budget size managed, team size, and strategic importance of AI programs to the company's core business. Education level and specialized certifications can also boost earning potential."},{"question":"How long does it take to get hired as an AI Program Manager?","answer":"The hiring timeline for AI Program Manager positions typically spans 1-3 months from application to offer. The process usually begins with resume screening, followed by initial HR interviews to assess program management fundamentals. Technical interviews often evaluate understanding of AI/ML concepts and measurement frameworks without requiring deep coding knowledge. Candidates frequently meet with cross-functional stakeholders to demonstrate communication skills with both technical and business teams. For senior roles, expect additional rounds evaluating strategic thinking and leadership capabilities. Organizations like OpenAI or enterprise AI teams may include case studies to assess how candidates would approach specific AI program challenges, extending the process timeframe."},{"question":"Are AI Program Manager jobs in demand?","answer":"AI Program Manager roles show strong demand across multiple sectors as organizations scale their artificial intelligence initiatives. Leading technology companies like OpenAI and Nutanix actively recruit for these positions to oversee their expanding AI portfolios. Government agencies and AI policy organizations are adding program managers to coordinate AI fellowships and policy initiatives. Enterprises implementing company-wide AI strategies require dedicated managers to oversee governance, adoption, and integration efforts. As machine learning becomes central to business operations, the need for skilled program managers who can bridge technical and business considerations continues to grow. This role represents an emerging career path within the broader AI practitioner ecosystem."},{"question":"What is the difference between AI Program Manager and Product Manager?","answer":"While both roles drive organizational success, AI Program Managers focus specifically on coordinating and delivering AI/ML initiatives across multiple teams, ensuring technical alignment with enterprise AI strategies. Product Managers, by contrast, own product vision, market fit, and user experience, regardless of underlying technology. Program Managers excel at complex project orchestration, risk mitigation, and cross-functional coordination, whereas Product Managers emphasize market research, competitive analysis, and feature prioritization. AI Program Managers require stronger understanding of machine learning concepts, data governance, and AI ethics frameworks. Product Managers typically have deeper customer insight and business model expertise. Both need strong communication skills, but with different emphasis—technical translation versus customer-focused messaging."}]