LESSON 07 · YOUR NEXT SMALL SYSTEM

Go further
when you are ready.

You do not need to become an AI engineer. You need one useful problem that happens often enough to deserve a small system you can understand, inspect, and improve.

START HEREOne repeated problemDescribe the friction before you choose the technology.
APIAutomationMore controlAgentEvaluation
Choose the job first. The right next step becomes much easier to see.

Be ready to explain the job.

“I should build an agent” is rarely the real need. A better starting point is: “Every Friday I turn scattered notes into a client update,” or “I keep recreating the same product mockups,” or “I need a dependable first pass on this form.” Name the repeated friction, the input, the useful output, and the cost of being wrong. Then move backward to the right kind of tool.

You are ready to extend a workflow when it works manually, its inputs are known, you can check its output, and someone owns the decision to use it. Pick one small, reversible experiment.

Pick the path that matches the job.

01 / API

Need model capability inside an app or workflow you control?

Put a small, draft-only feature behind an interface. Keep keys out of Git and browser code.

02 / AUTOMATION

Need a repeatable handoff with predictable steps?

Start with a known sequence: trigger, gather, AI prepares, human reviews, result is recorded.

03 / MORE CONTROL

Need greater control over where data and work happen?

Compare approved hosted options and local options realistically. More control is not automatic privacy or compliance.

04 / AGENT

Need a goal carried across several tool calls?

Give it a narrow job, read access before write access, clear stop conditions, and an approval gate.

05 / EVALUATION

Need to trust a workflow you have already built?

Save examples with expected results, then rerun them whenever prompts, tools, or models change.

An automation follows a known sequence. An agent gets a goal and chooses some of its own steps along the way. Both can be useful. The difference matters because more freedom needs clearer boundaries, more visible records, and more careful review.

What each next step looks like.

APIs

Build a feature, not a mystery.

An API lets your application or workflow request model capability from a provider. Start with a small feature that drafts, classifies, or summarizes—then let a person review the result. An API key is a secret with spending power: store it in environment variables or a secret manager, never in Git or browser/mobile code. Set a small project budget and usage alert before you explore. An alert may not stop spending; check whether the provider offers a hard limit and add an application-level cap where needed.

AUTOMATION

Make the handoff repeatable.

Start with trigger → gather information → AI prepares → human review → record. A good first automation creates a draft in a review folder, not an email sent to a customer. Keep the first version narrow enough that you can see every step.

MORE CONTROL

Ask where the work should happen.

Some tasks may need more control over data location, access, or offline use. Local models can be part of that answer, but “local” must be verified end to end: the model runner, connectors, backups, logs, device, and network all matter. It does not automatically mean private, compliant, free, or right for your organization.

AGENTS

Give a narrow goal and a stop sign.

An agent needs a goal, the right tools, clear limits, and a way to report what happened. Start read-only or in a sandbox. Define when it must stop: a time, iteration, or spending limit; missing information; a blocked task; or any external action that needs your approval.

EVALUATION

Keep checking, then deepen the test.

Basic checking starts with your first task. For a workflow you plan to repeat, save a small set of normal, messy, edge-case, ambiguous, and unsafe requests. Add the expected result and a pass/fail note. Run them again whenever the prompt, tools, or model changes. Checks, human review, and real-world feedback work better together than any one test alone.

A NEXT STEP YOU CAN MEASURE

A Friday update from your own notes.

Start manually: give the assistant a sample week of notes and ask for a draft with completed work, open questions, and next steps. Keep five test cases, including contradictory dates and a missing owner. Write down the correct behavior for each.

When the drafts are dependable, automate gathering notes from one approved folder. Keep the update as a draft for your review. Success might mean a useful update in ten minutes, with no invented deadlines or accidental sends.

Put a boundary around the experiment.

Costs and surprises arrive when a promising idea expands faster than your controls. Begin with the simplest model that does the job, cap the amount of content it can process, log each run, and set a budget, time limit, and clear stop or rollback plan. If a workflow can write, send, publish, purchase, delete, or change access, place a human approval gate in front of it.

SAFE EXPERIMENT CARD
Name the repeated problemWhat friction are you reducing?
Define the smallest useful resultWhat should version one create or decide?
Set the access and source dataWhat can it read? What must remain out of scope?
Choose the approval gateWho reviews before any consequential action?
Set the cap and recordWhat is the time or dollar limit? Where will results be logged?
Name the stop / rollback ownerWho can pause it, undo a change, or shut it down?

Let confidence earn autonomy.

The goal is not maximum automation. It is a useful system that stays understandable as it grows. Start with a draft. Review it. Save the examples that worked and the ones that did not. Add one capability at a time. Your fifty-foot view—purpose, boundaries, and judgment—is what lets the detailed work become safely more powerful.

NEXT-STEP PROMPT

"I have a repeated problem: [describe it]. Help me choose between a small API feature, automation, more private or local options, an agent, or an evaluation set. Ask only the questions needed to recommend the smallest safe first experiment. Then give me its scope, data sources, access level, approval gate, success measure, time or cost cap, log, and stop or rollback plan."

GO DEEPER

Explore official guidance on API basics, evaluations, and API key safety. For a grounded view of agent design and testing, see Anthropic on effective agents and agent evaluations.

TRY IT · FICTIONAL PRACTICE DATA

Fill one experiment card before connecting tools

Use a fictional Friday update. Your first experiment prepares a draft from one sample note; it does not need an API or scheduled run.

Your starting information

This week: flyer wording approved.
Owner of printing: Sam.
Launch date: not agreed.
Next decision: confirm printing cost.
SAMPLE + PROMPT, READY TO PASTE

Turn this sample into a Friday update with completed work, open questions, and next steps. Do not invent a date or price. Then make a small experiment card: one input folder, draft-only output, a human reviewer, a success check, and a stop condition. Do not connect or automate anything yet.

Check the expected result

Illustrative answer · check your own result first

  1. Completed: flyer wording approved. Open questions: launch date and printing cost. Next step: Sam checks the printing details; a human confirms any commitment.
  2. Example experiment card: input /sample-notes; output a draft in /review; reviewer the person responsible for the update; success no invented dates or prices; stop if notes conflict or a required fact is missing. These are proposed folders, not existing connections.
  3. Try five notes, including missing and contradictory details. Consider automation only when you can recognize both a useful draft and a failure.

You are ready to move on when…

  • I can explain what better means and how I will check it.
  • I chose one next experiment and know when to stop it.
YOU HAVE THE FOUNDATION

Keep building, one useful thing at a time.

Return whenever you find a new problem worth understanding, making, or teaching.

Return to the learning path →