The most common question I get from business owners exploring AI: "Should we just use ChatGPT, or do we need something custom?"
It's the right question, and most of the answers floating around the internet are wrong — either evangelizing custom development for problems that ChatGPT would solve in 20 minutes, or claiming everything can be handled with a free account and a good prompt.
Here's the actual framework I use.
First: understand what you're actually choosing between
Plain ChatGPT (or Claude.ai):A general-purpose AI assistant your team uses through a web interface. No custom setup. No integration with your systems. The AI doesn't know anything about your business except what you paste into the conversation.
Custom GPTs / Claude Projects: A configured version of the same AI with a system prompt that defines its role, uploaded knowledge (your docs, FAQs, SOPs), and specific instructions for how to behave. Still accessed through a chat interface, but tuned for your context. No code required to set up.
Custom AI agents: Software built by developers. The AI is the brain, but it has tools — it can read from databases, send emails, update CRM records, call APIs, trigger workflows. It can take action, not just produce text. This is where significant engineering is involved.
The three questions
Question 1: Does the AI need to access your data, or just general knowledge?
If your team is using AI for general tasks — writing, brainstorming, summarizing, editing — plain ChatGPT is probably fine. The AI doesn't need to know anything specific about your business to help draft a marketing email or summarize a report.
If the AI needs to answer questions about your business — your products, your policies, your pricing, your processes — you need some form of custom configuration. A custom GPT with your knowledge base uploaded, at minimum. If the data changes frequently or comes from live systems (inventory, customer records, order status), you need an agent with a database connection.
Question 2: Does the AI need to take action, or just produce information?
This is the clearest dividing line between a custom GPT and a full agent build.
If the AI needs to: send an email, book a calendar appointment, update a record in your CRM, submit a form, call a webhook, or do anything that changes state in another system — that requires code. You can't do this with a custom GPT through the standard interface.
If the AI just needs to answer questions and produce text — even complex text with specific formatting — a custom GPT can handle it. The bar for "needs an agent" is specifically: does it need to do something, not just say something?
Question 3: Who is the user — your team, or your customers?
If it's your internal team using the AI through a chat interface: a custom GPT is often the fastest and cheapest option. No deployment complexity, no website integration, your team already knows how to use chat interfaces.
If it's customer-facing — on your website, in your product, answering support tickets — you almost always need a custom build. You don't want customers using OpenAI's interface directly (no brand control, no audit trail, privacy concerns). You need an embedded widget or API integration, which means code.
The decision matrix
Based on those three answers:
- Team productivity, general tasks, no custom data needed → Plain ChatGPT or Claude.ai. Don't overcomplicate it.
- Team productivity, but needs your specific knowledge → Custom GPT or Claude Project. Configure it with your docs. Still no code required.
- Customer-facing, answers only, no live data needed → Simple chatbot build. Custom prompt, RAG on your docs, embedded widget. 3–4 weeks of development.
- Customer-facing or internal, needs live data or system actions → Full agent build. API integrations, database connections, tool use. 6–10 weeks, real engineering budget.
Where people go wrong
Overbuilding for internal use.I've seen companies spend $30,000 building a custom agent for internal knowledge management when a properly configured Claude Project would have done 90% of the job in a week for free. Ask whether you actually need the extra 10%.
Underbuilding for customer-facing use. A custom GPT deployed through a third-party chat widget with your system prompt pasted in is technically possible. But you have no audit trail, no escalation logic, no brand control, and no analytics. For anything customer-facing at scale, this is not the right approach.
Confusing a demo for a product.Getting an AI to do something impressive in a 20-minute demo is very different from having it do that reliably across 10,000 conversations with real users who ask things you didn't anticipate. The engineering work in a proper agent build is mostly about handling edge cases, not the core happy path.
My recommendation for most SMBs starting out
Start with the simplest thing that solves a real problem. If your team needs help with repetitive writing, give them Claude.ai accounts and a shared prompt library. That costs $20/month per person and you'll know within 30 days whether the time savings justify going further.
If you want a customer-facing chatbot, build a proper one — not a half-measure that creates more problems than it solves. But scope it tightly. One function. One audience. Deployed, measured, tuned. Then expand.
The biggest waste I see: companies that spend $50,000 on a complex agent build when they haven't validated that their team will actually use AI tools. Run the cheaper experiment first. Build confidence. Then invest in automation.
