We’ve now rolled out 21+ AI agents and 12+ vibe coded apps at SaaStr AI, used 1,100,000+ times. AI SDRs. An AI VP of Marketing (10K) that in many ways now manages us, not the other way around. AI-powered VC tools that have run over a million startup valuations. A LinkedIn attendee card generator I shipped from the back of a Waymo, and an AI Parking Pass app that distributed 5,000 custom parking passes and saved weeks of human time.
And QBee is the best thing we’ve built. By a lot.
QBee is our AI VP of Customer Success. Qbee managed all 100+ sponsors for SaaStr AI Annual 2026, all our media sponsors, and everyone coming back for 2027. She sends every one of them hyper-personalized check-ins. She tracks 13 core tasks with dozens of subtasks per customer. She follows up without drama. She identifies gaps in real time. She pushes a Slack and email update to our team every single day.
She was built on Replit, by Amelia (our Chief AI Officer), with zero engineers. Our AI token costs across all of our vibe coded apps combined haven’t hit $200/month yet.
The result: 70% fewer human hours on customer management. 10x more customer logins and on-time submissions versus our old off-the-shelf tool. Sponsors didn’t even realize most of the communication was coming from an AI until we told them on a webinar.
Here are the top 10 things we learned building her. If you’re thinking about doing this yourself, steal all of it.
1. It Didn’t Start as an AI VP of Customer Success. The Agent Emerged.
QBee was not designed to be an AI VP of Customer Success. That was never the plan.
The original goal in January was modest: replace the off-the-shelf sponsor portal we’d been paying for. That tool had zero AI. No SSO. No analytics. We couldn’t even tell if a sponsor had logged in unless they submitted something. Amelia’s initial spec was basic project management. Assign tasks, add single sign-on, build in light reminder automations.
That’s all QBee did for the first couple of weeks. And she was already better than what we had.
Then real customer data started flowing. Logins, task completions, usage patterns, gaps. Once the data existed, the agentic possibilities became obvious. Daily personalized check-ins. Triggered follow-ups. Real-time internal reporting. Proactive outreach.
The learning: don’t try to build the AI VP of Customer Success on day one. Build the dashboard or portal first. Ship it. Let the data tell you what to automate next. The agentic layer emerges from the operational layer, not the other way around.
2. Daily Beats Quarterly. The QBR Was Always a Broken Concept.
QBee is partially a riff on QBR, the Quarterly Business Review. Except she doesn’t run quarterly. She runs every day. Sometimes twice.
Think about the dated (but still way too common) QBR for a second. A customer has deliverables due in 60 days. A trigger event worth celebrating happened yesterday. A contract gap shows up in the data this morning. And the plan is to wait until the next scheduled quarterly call to surface it?
Quarterly is retrospective by definition, and in many ways, just a stealth upsell motion. Everything in a QBR has already happened. Great CS isn’t something you do in a one-hour call every 90 days. It’s something you do continuously, in the background, across every account, every day.
That’s what QBee actually does. It watches who’s engaged, who’s gone quiet, who’s about to miss a deadline, who just had a trigger event worth acting on. It runs whether anyone asks her to or not. It acts.
If you’re building AI for customer success and it still waits to be asked a question, you’re building last year’s product.
3. Hyper-Personalized Means 4 to 6 Unique Data Points Per Message. Not a Merge Tag.
The biggest mistake people make with “AI-powered” customer emails is thinking a first-name merge tag and some light context injected into the body of a email qualifies as “personalization”. It doesn’t. Customers see through it immediately. It adds no value and triggers the AI Slop meter.
Every QBee message to a sponsor reflects their specific situation and needs right now.
Which tasks are done. Which are overdue. What’s coming up next. Their unique registration links. Their booth number. Their badge allotment. Their content deadlines. Their last login date. Their speaker slot.
Four to six unique data points per message, minimum. Usually more.
No human CSM at scale was ever doing this. It’s impossible to maintain that level of detail across 100 accounts every week. But it’s trivial for an agent with clean data pipes.
The bar for “personalized” is way higher than most teams realize. And that’s why the sponsors didn’t know or at least case it was AI. They assumed it was a human because no AI tool had ever written them something that contextual before. The tell of AI used to be that it sounded generic. The tell of good AI now is that it knows more about your account than your old human CSM did. And this isn’t that high of a bar in many cases.
4. Agent Hop for Security. Minimize Sensitive Data Stored in the Agent.
QBee does not store sensitive customer data directly. We call this “agent hopping.” Sensitive data lives in the system built to secure it. The agent calls the API to assemble the picture.
QBee’s customer database lives in Salesforce. Contracts, contacts, deal details, sponsorship tier, booth assignments. All in Salesforce. User authentication lives in Clerk. Registration links come from the Bizzabo API. Email delivery runs through Resend.
QBee has no contracts sitting in her knowledge base. She hops between systems to assemble the full picture per sponsor, per message.
Amelia built a custom Salesforce Connected App to make this work. Had she done that before? No. She asked Claude and the Replit agent how to do it, got it working in about 20 minutes, and the integration has been rock solid since.
The more sensitive data you store directly in your agent, the more you have to become a security expert whether you wanted to or not. Constant audits, pen testing, break-it exercises. Most of us don’t want that job. Keep sensitive data in established systems. Make the agent hop.
5. Write the Spec in / with Claude Before You Open Replit / Lovable / etc.
Before opening Replit, Amelia wrote a spec. User flows, a dashboard, checklists, an asset library, upload functionality, single sign-on. It was maybe 60% of what QBee does today. That was fine.
If writing a spec from scratch seems intimidating, start in Claude. Just say “I need help writing a spec for a customer success portal” and iterate. You don’t need to be a prompt engineer in 2026. Those days are over. Talk to Claude, describe what you want, iterate until the spec makes sense, then give it to your vibe coding platform.
The more granular your spec, the less you’ll iterate later and the lower your token costs will be. But don’t let perfectionism stop you from shipping. Amelia’s first spec wasn’t that detailed. QBee turned out fine. The goal is to get to production, not to have a perfect spec.
You can literally give saastrsponsors.com to your vibe coding agent and say “I want something like this for my business.” That works.
6. Deploy to One Customer Per Tier First. Not All 100+ at Once.
We did not roll QBee out to all 100+ sponsors on day one. Amelia picked one customer at each sponsorship tier: Diamond, Platinum, Gold, Silver. Four test accounts.
Things broke. The Salesforce integration disconnected twice the first week. Edge cases around pending users in Clerk caused some emails to fail silently. A session timeout issue meant one sponsor stayed logged in for 5 days straight and then couldn’t upload anything.
We learned, fixed, expanded. One tier at a time.
Rolling out to all 100 sponsors on day one would have been a disaster. Rolling out to 4 meant we had real production signal with contained blast radius. We fixed what broke before most of the customer base ever saw it.
Phased rollout isn’t just an enterprise software concept. It matters even more when your product is an autonomous agent acting on your customers’ behalf without a human in the loop.
7. Build the Agentic Layer One Step at a Time.
Don’t try to make your agent fully autonomous from day one. That’s how you blow things up in production.
QBee’s agentic capabilities evolved in layers:
- First, personalized weekly emails to each sponsor
- Then, triggered actions when customers did or didn’t complete tasks
- Then, internal team reporting with real-time visibility and gap analysis
- Then, proactive outreach for deadline enforcement, collections, and escalations with full context
Each layer built on the last. Each was tested in production before the next one got added. Each required Amelia to verify the data was clean, the actions were accurate, and the customer experience was right.
Trying to ship all four layers on day one would have meant all four were half-broken at once. Shipping them sequentially meant each one was fully working before the next went live.
8. When a Customer Asks for a Feature, Ship It That Day.
This is the superpower you don’t get from off-the-shelf software, and it’s the reason our sponsor / customer satisfaction scores went up so much.
Sponsors kept asking for things. A networking information section. An activation submission flow. A full speaker submission workflow. Custom email marketing copy built into the portal. Every week, new requests.
Off-the-shelf CS software would have put those on a roadmap. Maybe Q3. Maybe next year. Most likely, never.
With QBee, we open Replit and just built it. Often the same day the customer asks. We’re not engineers. That doesn’t matter. The feature ships.
The real unlock of vibe coding isn’t cost. It’s shipping velocity on customer requests.
9. There Is No Set-and-Forget. Daily Maintenance Is Non-Negotiable.
Every time we share one of these stories, we say the same thing: these agents require daily attention. Not weekly. Daily.
You have to review their outputs. As you add features, things that used to work can break. Regressions are real and constant. Adding a new page might break an upload button for no obvious reason. Our Slack integration once sent triple updates instead of one. In fact, it keeps doing that. We know why it happens. We fix it. It’s life.
The hack that saves us every time: have the agent send you a status email / Slack every single day. (Anthropic in essence does the same with its sales team, see below). You’ll see stuff break in your inbox before customers tell you. Build that in from day one. Between Amelia and me, we check on QBee daily. And with a status email, Qbee and 10K also check in with us each, day, too. That’s the real ongoing cost of running an agent in production.
This is also why “buy 90%, build 10%” still matters. We will happily replace QBee with a third-party AI agent the moment one exists that does this job better. It doesn’t exist yet. That’s the only reason we built Qbee. If your off-the-shelf CS platform is actually an agent that does the work (not a dashboard that reminds humans to do the work), use it. If not, build.
10. 100% of the Time, Your Customer Success Is Not as Good as You Think It Is.
This is the most important learning. Go audit your own CS flow right now. Qbee if nothing else is the best customer success we’ve ever had in the history of SaaStr. By far. No human wanted to deal with 100+ customers with 20+ custom needs and assets. That’s 1000s of pieces of endless work. They all just wanted to “check in”. No one wanted to do the follow-up.
There is always something broken in your onboarding, retention, follow-up, or customer education process. Find it. Walk through your flow as a customer. See where only 50% of your accounts are actually covered. Or 30%. Or 20%. I’ve never seen a team where it’s 100%. Not once.
Then think about what you would build to get that number to 100%. Not to replace the human CSMs. To augment them with an agent that handles the operational coverage gap they physically can’t cover alone. One CSM managing 50 accounts isn’t viable solo. One CSM plus an agent is.
The gap between what customers need and what CSMs can humanly deliver is the single most valuable place to deploy AI in your B2B business right now. It’s the highest-ROI, lowest-risk, easiest-to-build use case in the entire company. And almost every B2B company is still running it on humans alone.
We built QBee because off-the-shelf didn’t exist. Your version won’t look exactly like ours, and it shouldn’t. But the gap is there. Go find it. Go build.
You Can Do It, Too
If we built this with zero engineers, you can too. It just takes someone who cares enough to manage the agent every day. That’s the real moat.
