A buyer's guide to AI agents

Everyone says they have an agent.
Almost no one means the same thing.

The word has gotten slippery. It now covers everything from a chatbot in the corner of your screen to a system that can knock multiple to-do’s off your list in an afternoon. This is a short guide to telling agents apart, and how to spot the real thing when buying software.

The Basics

The word “agent” is used a lot. But what is an agent?

Strip away the marketing and the idea is simple. For decades, software waited for you. You clicked, it responded. You typed a number, it stored it.

An agent is meant to flip that around. Instead of waiting for the next click, it takes a goal and works toward it: deciding the steps, doing them, noticing when something’s off, and coming back to you only when it needs guidance or is done.

What is an agent?

An agent is software you can hand a task to and reasonably trust to carry it out, flag what’s unclear, and tell you when it’s done.

That’s the promise. The term “agent” has become confusing because almost all products are using the word, and most stop well short of that definition – only handling a small number of tasks or unable to take action. It’s worth knowing the types of agent you’ll see in the wild, and which ones are worthy investments.

The landscape

Most things called an “agent” are really one of three things.

You’ll probably recognize all three. Each offers some value, with real limitations. Once you see the pattern, you’ll know to ask for more.

1 · The answer box
You’ll hear“Ask our agent anything about your data.”
Watch out forIt’s a smart search box. It reads a slice of your data and answers questions about it. Helpful for looking things up, but it can’t change anything for you or take action.
2 · The file cleaner
You’ll hear“Our agent prepares your data.”
Watch out forIt tidies up a messy spreadsheet and hands it back. That’s where it stops. The new file still goes through the same manual upload and review process. You’re just starting from a cleaner CSV.
3 · The drafter
You’ll hear“Our agent writes your disclosures.”
Watch out forIt produces a first draft, a better starting point than a blank page. But you still have to manually review, correct, and submit yourself.

All three are helpful. But notice the pattern: each only handles a discrete task and, at the end, the work comes back to you. Each makes one step easier, but can’t take the next step.

True agents can do all of this and more, carrying the work through to the end.

The most important question

When you hear “agent,” ask: Can it do everything I can do in the software, or just what you demoed?

A true agent is general purpose. It can do anything a person on your team can do in software, with code instead of clicks. There’s a big gap between an agent that can do almost anything on a platform, and an agent that can only do the three things it was wired to do.

A rule of thumb

If it only works on a handful of tasks they demoed, it’s a feature, not an agent.

To understand the difference, it helps to see one. So here’s the Gravity agent doing a job, from start to finish.

See an agent at work

An all-purpose agent that does the work, from start to finish.

The Gravity agent can do most anything a user can do in the platform. Here’s an example of a real job we handed to the agent and what it did. Scroll to watch it work through the problem, step by step.

YOU PROMPT

You hand it a goal, the way you would a new hire.

IT PLANS

First it breaks the goal into a task checklist.

IT GATHERS

It goes and finds what it needs: files, your data, web searches.

IT LEARNS YOUR STYLE

It reads last year’s report so this one matches.

IT CHECKS IN

It shows you exactly what it wants to bring in, for approval.

IT DRAFTS

It drafts your disclosure, in your own voice.

YOU APPROVE

You approve and it saves the draft, with a record of all steps taken.

Gravity Agentworking · live Ready
The task: “Bring in last year’s energy data and get a head start on our CDP disclosure.”
Breaking the goal into a checklist of five tasks.
Reading the files you uploaded.utility-bills-2025.xlsx + 6 more
Looking up this year’s published emission factors.
Pulling 14 months from your connected meters.2 utility accounts linked
Reading last year’s CDP report to match its structure and tone.
Proposed importpreview · nothing saved
Add 4,318 activity records across 12 sites
Map 2 utility accounts to the 2025 factors
Fill 9 data gaps using your documents
Bringing it in, testing every record on a private copy first.
CDP · C6.1 · Scope 1 emissions
Report your gross global Scope 1 emissions for the reporting year.
Our gross global Scope 1 emissions for FY2025 were 12,480 tCO₂e, a 6% reduction year over year, driven largely by the fuel-switching project at Plant 3…
Drafted 7 answers in all, each matching last year’s wording.
Saved, with a written record of every change, in case anyone asks.
To-do
Gather your source data
Match last year’s format
Stage the import
Draft disclosure answers
Hand back for approval
Scroll to watch
Nothing is written until you approve Nothing saved yet

This is only possible when software is “API-first.”

When a platform is built this way, the API serves as a door that lets the software use every tool in the platform, so agents can do a wide variety of work. When a platform isn’t built this way, the vendor is forced to bolt shortcuts onto an existing product and call each one an “agent.”

Skills

What makes all-purpose agents useful? Expertise embedded in “skills.”

Many agents are a thin layer over an off-the-shelf AI like ChatGPT or Claude, dressed up with a clever prompt. That’s fine for narrow tasks, but the underlying AI lacks the expertise to reliably do complex work. To be useful, agents require skills – reusable expertise that the agent applies automatically when relevant.

What is a skill?

A skill is detailed written guidance that an agent reads before doing a specific kind of task, including both instructions and context.

At Gravity, for example, we have teams of full-time climate and energy experts who continuously create new skills for the agent. We have trained 85+ skills so far, which codify expertise to migrate data from Excel and other platforms, identify cost-saving energy projects, and draft reports for regulations like California’s climate disclosures, among other use cases.

Here’s how an all-purpose agent is trained:

Customer feedbackWhat’s working, what’s missing
Changing regulationsNew disclosure rules and deadlines
Revised standards & auditor guidanceFrom our advisors and partners
Experts make sense of itOur experts decide what it means in practice.
Experts teach & test the agentsIt becomes a skill, trained like a new hire.
Every customer benefitsCustomers use prebuilt skills, and create their own.

A real agent isn’t a thin wrapper over an off-the-shelf AI. It embeds real expertise, consistently updated and validated by human subject matter experts.

Guardrails

“But is it safe?” Here’s what to look for.

Agents are a new way to work with software, and they naturally raise questions around control, auditability, and access. Enterprise-grade agents will have guardrails in place to address your concerns.

A mature agent should operate like a new team member with a login: it works inside the same access controls and security measures your team already trusts. It can only see and do what the person running it is allowed to see and do.

A person on your teamSees only what their role allows
Same access rules
A Gravity agentSees only what its operator allows

Enterprise-grade agents also offer additional guardrails:

Approvals

Agents should always request human review and approval before taking action, for example editing data or drafting a report.

Data security

Agents should only access the data the person using them can access, or a subset of that data.

Auditability

Agents should always leave a trace, creating an audit trail so users can review what happened, when, and why.

Access controls

Agents should be subject to the same permissions as employees. They should never get a master key.

The Buyer’s Guide

Nine questions worth asking when evaluating an agent

The answers reveal whether you’re evaluating a true agent, or just a feature.

What’s the scope of what it can do?A real agent should be able to do anything a person can do in the platform.
Typical“It handles data entry, reporting, and gap analysis.” A list of tasks means a list of limits.
Stronger“Anything you can do in the platform, the agent can do on your behalf.”
Can it actually change my data without breaking it?This is the line between an agent and an answer box.
Typical“It gives you a clean file to upload.” That’s a data cleaner – the filing is still on you.
Stronger“It tries the change on a copy of your data first, then applies it only once you approve.”
Can it work in the background, on its own?Can you hand it something and walk away?
Typical“Ask it whenever you need something.” Means it’s idle until you prompt it.
Stronger“You give it a task and leave; it runs for as long as the work takes.”
Can I run many of them at once?Software shouldn’t queue like a single employee.
Typical“You can ask it lots of questions.” Still one thread, one thing at a time.
Stronger“Run as many as you need, in parallel, each on its own task.”
How does it get smarter from my feedback?A good assistant learns your business; a tool resets each session.
Typical“It improves as the model updates.” Generic, and nothing specific to your business.
Stronger“It remembers your corrections and your context, and applies them next time.”
How does it check its own work?Doing the work means catching mistakes before you do.
Typical“The model is very accurate.” No mention of how it catches its own mistakes.
Stronger“It runs an internal consistency check against your real data and stops if anything is off.”
Can you trust the numbers it gives you?Are they calculated the same way every time, or is the AI guessing?
Typical“The AI works out the numbers for you.” If a model writes your numbers, they can quietly drift.
Stronger“The numbers come from fixed formulas that run the same way every time; the AI never makes them up.”
How is your agent permissioned?Does it work inside your access controls, or around them?
Typical“It’s enterprise-grade and fully secure.” Reassuring, but doesn’t tell you who it’s actually allowed to act as.
Stronger“It acts as the person running it: the same permissions, nothing more.”
Is everything it does on the record?You may have to show an auditor exactly what happened.
Typical“You can scroll back through the chat.” A transcript isn’t an audit trail.
Stronger“Every action is logged and traceable to its source, and exportable.”
Before you sign, make a vendor prove it on your data,
not on slides.
Bring real data to the demo.A sample of your own messy data, loaded on the call. A platform built for this can take it in and show you something useful in minutes.
Run a one-week pilot – and expect value fast.Point it at a real task, not a scripted demo. If a vendor needs months just to get ready, that tells you something. A real agent can show value in days.
Ask it to do something off-script.If the agent only works on the tasks it was demoed on, it’s a bundle of features, not an agent. Give it a job the sales team didn’t prepare for and see what happens.

Bring your data. Watch it work.

The fastest way to tell a real agent from a feature is to put your own data in front of it. Book a short call and we’ll do exactly that, live.

Talk to an expert Explore agents