Skip to content
Chat with AI Agent
Foundations

Why Developers Need AI Product Manager Skills

Orange ITS — AI engineering team 9 min read

An AI coding assistant can produce a plausible first draft before the team has agreed what the feature should do. The code arrives quickly. The harder questions remain: which user workflow deserves attention, what happens when the answer is wrong, which data the system may access and how anyone will know the release helped.

This is where the developer role in AI starts to look more product-shaped. The engineer still builds the system, but also needs enough customer and domain context to turn an ambiguous request into a bounded capability with evidence behind it.

AI makes first-draft output cheaper, which raises the value of product judgement around context, evaluation, feedback and business outcomes. For teams that need this blend inside a real workflow, forward-deployed AI engineering is one delivery model built around close contact between engineers and users.

Calling this person an AI product manager can be useful shorthand. It describes a capability mix rather than a wholesale change of profession. Product and engineering remain separate disciplines, with important responsibilities on each side.


AI Changed the Bottleneck, While Developers Still Own the Result

AI tools can reduce the effort required to generate routine code, tests or interface drafts. That does not make the output ready for production. Someone still has to judge whether the change fits the architecture, handles permissions correctly, survives edge cases and improves the workflow it was meant to serve.

Developer sentiment reflects that gap. In the 2025 Stack Overflow Developer Survey, 46% of respondents said they distrusted the accuracy of AI tools, compared with 33% who trusted it. Suggestions that were almost right frustrated 66%, while 45% cited time spent debugging AI-generated code. The survey is self-selected, so those percentages should not be treated as population estimates. They still challenge the idea that generation has removed the need for engineering judgement.

The productivity evidence is mixed as well. A randomised METR study followed 16 experienced open-source developers across 246 real tasks in repositories they already knew. With early-2025 tools, they took 19% longer on average when AI was available. The sample was small and specialised, and the tools were a snapshot from February to June 2025. The useful lesson is narrower: every team has to measure its own delivery result, including review and debugging time.

For many AI-enabled workflows, generation can shift the bottleneck toward context, review and verification. Teams need to establish whether the resulting system works for real users. This is the product-shaped part of modern development.

The Product-Shaped Work Now Inside AI Engineering

A conventional feature often starts from behaviour the team can specify in advance. Many generative-AI features expose probabilistic behaviour. Similar inputs can produce different responses, and a model update can alter behaviour without changing the surrounding application code. That makes product judgement part of implementation.

For a developer, the work begins before choosing a model or opening an editor:

  • Observe the target workflow and name the outcome the business cares about. A shorter handling time, lower correction rate or improved conversion can serve as a measure. Generated lines of code cannot.
  • Identify the cost of a wrong answer and define the cases that must go to a human. This includes permissions, sensitive data and actions the system may never take by itself.
  • Decide whether the task needs a model, retrieval from a trusted source, a deterministic rule or a combination. Some workflow steps are better left unchanged.
  • Turn historical and deliberately difficult examples into evaluation cases with clear release criteria.
  • Instrument the live feature so the team can see overrides, failures, user corrections and the business measure after release.

These decisions concern user value and trade-offs, which gives them a product character. They remain engineering work because the decisions have to become tests, data flows, access controls and observable production behaviour. The same gap between a convincing model demonstration and a dependable workflow is explored in the AI last-mile problem.

Engineering and Product Management Keep Distinct Responsibilities

The title “AI product manager” can blur roles that a delivery team still needs. A developer may own the outcome for one workflow without taking over product strategy. A product manager may help define success without becoming responsible for system reliability. Treat the split below as one practical starting point. Adapt it to the team’s size, regulated duties and existing decision rights.

ResponsibilityEngineering leadProduct or business leadShared decision
Architecture, integrations and data boundariesAccountableConsultedChoice of acceptable trade-offs
Reliability, latency, security and incident responseAccountableInformedRelease risk tolerance
Customer discovery and problem selectionContributes technical insightAccountableWorkflow scope
Portfolio sequencing, pricing and adoption strategyConsultedAccountableInvestment case
Evaluation criteria and user feedbackBuilds repeatable evidenceDefines desired outcome and recruits usersRelease and change decisions

Deep engineering skill matters at least as much when generated code enters the system. A larger change can arrive faster than the team can understand it. Architecture, review, observability and incident response prevent that speed from turning into fragile software.

Product management also remains a real specialism. Choosing a market, comparing customer segments or sequencing investments across teams requires broader evidence than one developer usually sees. The productive shift happens at the boundary: developers gain product judgement for the capability they build, and product leaders become more precise about evidence and technical constraints.

A Small Team Needs Clear Decision Rights

An SMB rarely needs a new title for every AI pilot. It needs named owners from the first workflow discussion through the first production review. One person can wear both hats in a small company, but the two accountabilities should still be visible. One suggested allocation is:

DecisionAccountable leadEssential partnerEvidence before scale
Target workflow and business measureProduct or business ownerDeveloperBaseline measure and named user group
AI or conventional architecture and data accessDeveloper or technical leadSecurity or data ownerData-flow review and fallback path
Evaluation set and release thresholdDeveloper or technical leadProduct or domain expertRepresentative cases and pass criteria
Model, provider and cost trade-offDeveloper or technical leadProduct or business ownerQuality, latency, cost and privacy comparison
Production feedback and change decisionSharedSupport or operationsOverride, failure, adoption and outcome measures

This table can fit on one page. Its value comes from preventing ownership gaps. A model can produce a plausible answer while everyone assumes somebody else checked the source, defined the escalation path or measured what happened next.

Access to users is also a delivery dependency. Asking a developer to build an agent from an ambiguous prompt leaves the most important product decisions unresolved. Give the technical owner time with the people doing the work and with the domain expert who understands the costly exceptions.

Evaluation Is Part of the Product

For conventional software, a test can verify that the same input produces the expected output. AI systems need a broader evidence loop. Correctness may depend on context, usefulness can be subjective and some failures matter far more than others.

The NIST AI Risk Management Framework organises this work around govern, map, measure and manage. It calls for testing before deployment, regular evaluation in operation, documented responsibilities and monitoring. That framework is a practical model for delivery even when a system falls outside a regulated category.

A compact evidence pack for an SMB feature should include:

  1. The intended users, target workflow and measurable baseline.
  2. Representative evaluation examples, plus unacceptable responses and foreseeable misuse cases.
  3. The data and access map, human escalation route and fallback behaviour.
  4. A release threshold, accountable owners and a record of model or prompt changes.
  5. Production measures covering corrections, overrides, incidents, review effort and the chosen business outcome.

This is where product judgement becomes concrete. A goal such as “help support staff answer faster” has to become an evaluation set and a threshold the team can defend. The technical implementation of that loop is covered in more depth in AI agent testing and evals.

European teams also need to classify the use case before assuming which legal obligations apply. The EU AI Act applies different obligations according to role and risk category. Its territorial scope can reach providers or deployers outside the EU where an AI system’s output is used in the Union, so Swiss establishment alone does not decide scope. The EU AI Act guide for AI agents provides the wider compliance context. Legal classification deserves specialist advice when the use case is consequential.

Where the AI Product Manager Framing Breaks Down

The capability mix has limits. Three situations deserve particular care.

The developer has little customer access. Product judgement needs evidence from users and the business. Without it, a developer can make local interface choices but cannot reliably choose the right problem or represent a market.

The system sits inside a legacy or regulated environment. Integration, identity, auditability and failure handling may dominate the workload. Strong product instincts help with trade-offs, while specialist engineering and domain review remain decisive.

The organisation has portfolio choices to make. A developer close to one workflow can become its strongest advocate. Someone still has to compare that investment with other customer needs and commercial priorities across the company.

The framing also breaks when leaders use it to load discovery, delivery and commercial accountability onto one person without time or authority. Cross-functional work is easier to govern when the boundary is explicit and both sides have access to the evidence they need.

A Practical 90-Day Capability Plan

A 90-day pilot is long enough to build an evidence loop and short enough to keep the initial scope narrow. The schedule below is illustrative. Adapt it to integration complexity and the cost of failure.

Days 1 to 15: choose the workflow. Observe users, record a baseline and identify one outcome. Name out-of-scope cases and the human owner for exceptions. Decide whether AI is warranted for each step.

Days 16 to 35: build the evidence pack. Select representative historical cases, add difficult and unacceptable examples, document data access and agree on a release threshold. This is where the product and technical owners make their shared assumptions testable.

Days 36 to 65: build against the evaluation. Implement the smallest useful slice, connect only the data it needs and review generated code with the same standards as human-written code. Track evaluation results alongside latency, cost and operational constraints.

Days 66 to 90: release with a reversible path. Start with human review or a limited user group. Log corrections and incidents, compare the outcome with the baseline and decide whether to scale, revise or stop.

At the end, assess the team as well as the feature. Can the developer explain the user outcome and failure cost? Can the product owner explain the evaluation threshold and technical constraints? Can both point to production evidence? Those answers reveal whether the organisation has developed the capability behind the AI product manager label.

The future of software developers is unlikely to collapse into a single hybrid title. A clearer change is already visible in the work: generation becomes easier, while responsibility for context and proof moves closer to the engineer building the feature. Teams that protect distinct specialisms and share the outcome can turn that shift into better products rather than a larger pile of plausible code.

Frequently asked questions

Is every developer becoming an AI product manager?

No. The phrase describes an expanding capability mix rather than a universal job change. Developers building AI-enabled workflows increasingly need to understand users, define evaluation criteria and follow outcomes in production. Product managers still own broader discovery, portfolio priorities and commercial trade-offs, while engineers remain responsible for architecture, integration, security and reliable operation.

What does an AI product manager do differently from a software developer?

An AI product manager usually leads problem selection, customer discovery, prioritisation and the commercial case. A software developer turns those choices into a secure, observable system and produces evidence that it works. Their work overlaps on scope, evaluation criteria, feedback and release decisions. The boundary depends on team size, regulation and how close each person is to users.

Which product skills do developers need for AI product development?

The useful skills are workflow observation, clear outcome definition, evaluation design and disciplined feedback collection. A developer should understand who uses the feature, what a costly failure looks like, when a human must take over and which business measure should move. They do not need to absorb the entire product-management remit to apply that judgement to one capability.

How should a small business evaluate an AI feature?

Start with representative cases from the target workflow and define correct, useful and unacceptable behaviour before launch. Record the data boundary, fallback path and accountable owner. During a controlled release, track review time, corrections, overrides, incidents and the chosen business outcome. Revisit the test set when users find new failure patterns or the model and workflow change.

Can one person own both the product and engineering sides of an AI pilot?

Yes, especially in a small company, provided the two decision areas remain explicit. That person must be able to test technical behaviour and make informed workflow choices with real user access. For consequential or regulated use cases, bring in the relevant domain, security or legal expertise. A combined role does not remove the need for independent review where the failure cost demands it.

Insights

Put these ideas to work

A 30-minute call is enough to find out whether an AI agent fits your workflow — and what it would return.