What is Agentic AI?

Agentic AI is the name for a system where a language model is given a goal, a set of tools, and the autonomy to decide what to do next - then runs in a loop until the goal is done. It is the difference between asking a model a question and handing it a task. The model is not just answering; it is acting.

The word agentic is doing real work in that sentence. An agentic system has agency: it chooses the next step, calls a tool, reads the result, revises its plan, and continues. The model is still the brain, but around it sits the scaffolding that lets it touch the outside world - a file, an inbox, a database, an API, another agent. That scaffolding is what turns a chatbot into something that can finish a job.

An agent is a model deciding, in a loop, what to do next.- the working definition most teams have settled on

Assistant vs. agent

The clearest way to ground the term is to put it on a line. On one end is the assistant most people met first: a chat box that answers questions one turn at a time. On the other end is an agent: a system given a goal and left to work. In between is everything that is partly autonomous - the kind of system that can run a tool when asked, but still stops after each step to check in.

Less autonomous More autonomous
Tier 1

Plain assistant

One question in, one answer out. No tools, no memory beyond the conversation, no actions taken in the outside world.

Tier 2

Assistant with tools

The model can call functions you provide - search, calculator, lookup - but a human is in the loop deciding when each step runs.

Tier 3

Agent

Given a goal, the model plans its own steps, calls tools as needed, reacts to results, and stops when the work is done.

None of this is a hard boundary - real products mix tiers. A coding tool might let you ask a quick question (tier 1), run a single command on request (tier 2), or hand it a multi-step refactor that takes several minutes to complete (tier 3). What changes from tier to tier is how much trust you are extending to the model and how much of the work it does without checking back.

The agent loop

Underneath the marketing, almost every agentic system runs the same small cycle. The model thinks about what to do, picks an action, executes it through a tool, reads the result, and decides whether to keep going. The loop is the engine.

The agent loop
01 · Plan

Decide the next step

Given the goal and what has happened so far, the model picks one concrete action to take next.

02 · Act

Call a tool

The action becomes a tool call - search, read a file, send an email, run code - executed by the runtime.

03 · Observe

Read the result

The output of the tool comes back into the context window. The model sees what actually happened, errors and all.

04 · Decide

Continue or stop

If the goal is met, the agent stops. If not, it loops back to plan the next step with the new information in hand.

A short task might take one or two passes through the loop. A long one might take dozens. The model never sees the entire universe at once; it sees the goal, the history of what it has tried, and the latest tool result, and it makes the next call from there. Getting that loop to converge - to actually finish, without going in circles or burning the budget - is most of the engineering behind a usable agent.

The pieces that make it work

An agent is not a single component. It is a small stack of parts that have to cooperate.

  • A capable model. The model has to be good enough to plan, follow instructions reliably, and reason about tool results. Modern frontier models - Claude, GPT-class systems, Gemini-class systems - cleared this bar in the last couple of years, which is why the term agentic suddenly became practical.
  • Tools the model can call. Functions, APIs, file system access, web search, code execution. Each tool has a name, a description, and a schema for its inputs. The model picks tools by reading those descriptions, so naming and documentation are part of the design.
  • A runtime that drives the loop. Something has to take the model's chosen action, run it, capture the output, and feed it back. This is the agent harness - Claude Code, Microsoft Agent Framework, an in-house orchestrator, or any of a dozen open-source frameworks.
  • Memory and context. The agent needs to remember what it has tried, what it has learned, and what the user actually wants. In practice this means a careful design around the context window: what gets kept, what gets summarised, what gets pulled in from outside on demand.
  • Guardrails. Approval steps for destructive actions, budgets for cost and time, restrictions on which files the agent can touch. Guardrails are how you let an agent run unsupervised without it doing something nobody asked for.

If you have heard of Agent Skills, that is one popular shape for packaging the tools-plus-instructions piece. It is not the only one, but it is a good example of how the parts above get bundled into something portable.

Where agentic AI earns its keep

The hype has moved faster than the reality. There are still many tasks where a plain chatbot - or no AI at all - is the right answer. Agentic AI is worth the extra complexity in a specific shape of problem.

  • Multi-step work with a clear goal. Refactor this file. Triage these tickets. Draft replies to this batch of emails. Tasks that decompose into a handful of concrete steps with an obvious finish line are the agent's sweet spot.
  • Work that touches several systems. When the answer requires reading one place, writing to another, and verifying against a third, the loop pays for itself. A one-tool answer rarely justifies the harness.
  • Work where the steps are hard to predict. Debugging, research, exploration. The model decides what to look at next based on what it just found - which is the case agentic systems are built for.
  • Work that benefits from a human at the end, not in the middle. The agent goes off, does the legwork, comes back with a draft. A person reviews, approves, ships. That shape is where most production agentic deployments live today.

What does not fit: one-shot questions, real-time interactions where every second of latency matters, and anything where the cost of a wrong action is high and the agent cannot be supervised. Agents are slow, expensive, and occasionally wrong; you reach for them when the work they save is worth those three properties.

What makes it hard

The headline demos make agentic AI look easy. The production reality has rough edges that anyone shipping these systems learns quickly.

  • Loops can fail to terminate. A model that cannot make progress will sometimes keep trying variations of the same broken approach until it hits the iteration limit. Good harnesses watch for this and force a stop.
  • Context windows fill up. Every tool result the agent reads eats space. Long tasks need a strategy for keeping the important things and summarising or dropping the rest, or quality collapses.
  • Mistakes compound. An error early in a chain of tool calls can poison every step after it. Verification steps - the agent checking its own work before moving on - are how teams keep this from running away.
  • Trust is earned slowly. The first time you let an agent send an email or commit code on your behalf, you watch every step. The second time, you skim. By the tenth time, you only look when something is flagged. Designing the system so that progression is safe is its own discipline.

None of this is a reason to avoid agentic AI - it is the reason the field exists. The interesting work right now is mostly about the loop itself: how to plan better, how to verify, how to recover, how to know when to stop.

Where to go next

If this article was the map, the next stop is one of the territories on it. The articles below cover the model that powers most modern agents, the surface most developers use to actually run one, the packaging format for teaching agents new skills, and the people whose work is worth following as the field moves.

Pick the one that matches what you want to build next. They all live inside the same path, so you can come back here when you want the bird's-eye view again.