The Importance of Human in the Loop for Agentforce

Описание: Today on the Salesforce Admins Podcast, we talk to Joshua Birk, Senior Director of Admin Evangelism at Salesforce.


Join us as we chat about how the human in the loop is key to building reliable, predictable AI.


You should subscribe (https://itunes.apple.com/us/podcast/b...) for the full episode, but here are a few takeaways from our conversation with Joshua Birk.
Understanding the guardrails around AI

It seems like every week, there's a new headline about an AI agent doing something it shouldn't. As Josh explains, that's because we're still in the process of understanding AI as a tool. That's why we sat down to discuss how to build predictable, reliable solutions in Agentforce.


When an agent behaves non-deterministically, it's usually because there weren't enough guardrails in place. The thing is, if you're building an AI agent to do everything, it's hard to control what it can and cannot do.


Josh's advice is to narrow the scope of your agent and build it for a very specific purpose. This makes it easier to build guardrails and also allows you to test it thoroughly before release.
A QA engineer walks into a bar…

When it comes to testing, there's an old programming joke that comes to mind. A QA engineer walks into a bar. He orders a drink. He orders five drinks. He orders zero drinks. He orders infinite drinks. He orders a horse. However, when the first real customer walks in and asks where the bathroom is, the entire bar bursts into flames.


As Josh explains, it's important to test for all sorts of weird edge cases and make sure your agent performs predictably. But it's even more important to think things through from the user's perspective so you don't miss something that should be obvious. AI can do extraordinary things, but you still need a human in the loop.
The first part of testing is planning

Josh emphasizes that the first part of testing is planning: "What are the Ifs? What are the Thens? What are the things you absolutely don't want it to do?" The more specifically you can answer these questions, the easier it will be to build and test agentic solutions that are predictable and reliable.


The most effective AI agents aren't autonomous solutions. They're tools that give the humans who use them superpowers. You still need a human in the loop to make sure they're used for good.


Be sure to listen to my full conversation with Josh for more about testing and building in Agentforce. And don't forget to subscribe to the Salesforce Admins Podcast to catch a new episode every Thursday.
Podcast swag

•

Salesforce Admins on the Trailhead Store (https://trailheadstoreamer.com/catego...)

Learn more

•

Salesforce Admin Blog: How Agentforce Service Assistant Helps Salesforce Admins Become AI Leaders (https://admin.salesforce.com/blog/202...)


•

Salesforce Admin Blog: Metadata Is Your Admin Blueprint for Building Better Agents (https://admin.salesforce.com/blog/202...)


•

Salesforce Admins Podcast Episode: Exploring Agentforce Vibes Through Real-World Admin Use Cases with Daryl Moon (https://admin.salesforce.com/blog/202...)

Admin Trailblazers Group

•

Admin Trailblazers Community Group (https://sforce.co/4977GHH)

Social

•

Josh on LinkedIn (  / joshuabirk  )


•

Salesforce Admins on LinkedIn (  / salesforce-admins  )


•

Salesforce Admins on X (https://x.com/SalesforceAdmns)


•

Mike on Bluesky social (https://bsky.app/profile/mikegerholdt...)


•

Mike on Threads (https://www.threads.net/@mikegerholdt/)


•

Mike on X (https://x.com/MikeGerholdt)

Full show transcript

Mike: This week on the Salesforce Admins Podcast, we're welcoming back our good friend, Josh Birk, to kick off February with a conversation. Well, it's part podcast, part social experiment. Josh and I sat down to talk AI, specifically how admins can plan, test, and build with confidence using guardrails in Agentforce. We cover everything from deterministic responses to chaotic desktops and why designing with trust, maybe a little touch of humor, matters most. So whether you're rolling out your first agent or refining your AI game plan, this episode's got insights for you. So give it a listen and let me know if you like the format or not because, hey, maybe we just might make this a regular thing. With that, let's get Josh on the podcast. So, J...