Guides For Product Teams

Decisions To Make Before An AI Feature Ships

PDF guides for product managers, product leaders and the engineers building AI features.

Start with the model guide when a product requirement needs a defensible choice. When a model flags tickets or alerts for a person to handle, the F1 guide shows how to tell whether its mistakes are acceptable. Read the security guide before an agent can reach data, tools or actions.

Decide · For Product Managers

Model Comparison For Product Managers

Choose a model strategy for a support reply copilot, starting from the business problem and ending with a decision an executive team can act on.

  • Split the work into use cases with different risk
  • Compare candidates on quality, p95 latency and cost per completion
  • Run a pilot with stop gates
Read The GuideDownload PDF
Measure · For Product Managers

F1 Scores For Product Managers

Follow a PM investigating a wrong refund answer and an overloaded review queue to decide which model setting deserves a pilot.

  • See why a 96% accurate model still misses 20 required referrals
  • Calculate precision, recall and F1 from four counts
  • Pick a cutoff that meets the miss limit and fits the review queue
Read The GuideDownload PDF
Build · For Teams And Builders

Secure Agent Build Guide

Build a first agent system from small parts: a front door, a worker that owns the loop, one guarded way to read files and a saved result you can inspect.

  • Return drafts for a person to review instead of editing files
  • Give each eval an owner, an automatic check and a human decision
  • Scaffold a first monorepo from the included starter prompt
Read The GuideDownload PDF

Need To Work Through The Decision?

If your product does not match a guide's example, bring the requirement and the options you are weighing to product advisory.

Contact Ascendvent