Post

What too many Agent Builder experiments teach about Copilot Studio

Diesen Beitrag auf Deutsch lesen

Agent Builder experiments reveal practical lessons about grounding, instructions, skills, lifecycle and when to move a use case into a larger tool.

TL;DR

Agent Builder experiments show that strong knowledge sources matter more than clever instructions, linked SharePoint pages are not automatically included, custom skills remain in preview, and an 8,000 character instruction limit makes many roles messy. Power Automate, Teams adaptive cards and the Graph API can support lightweight agent inventory and follow-up.

Original by Karl-Johan Spiik, on Karlex. Read the original

This is our own summary, not a republication or full translation.

Why it matters

  • Makers: Test grounding and instructions early, because an agent based on one SharePoint page will not automatically understand pages linked from it.
  • Makers: Treat custom skills and interface details as changeable, because the tool was renamed, buttons moved, and preview features appeared differently across Teams and the app.
  • Admins/IT: Use Agent 365 visibility and a lightweight Graph API, SharePoint, Power Automate and Teams pattern to identify new or unused agents and prompt owners to review them.
  • Leadership/Business: Encourage inexpensive experiments while recognising that the resulting agents teach reusable skills about roles, grounding, ownership and lifecycle.

Frequently asked questions

How does Agent Builder use SharePoint pages linked from a knowledge source?

Agent Builder does not automatically understand pages linked from a grounded SharePoint page. Each relevant knowledge source must be considered separately.

What is the status of custom skills in Agent Builder?

Custom skills are in preview and may appear differently depending on whether Copilot is opened through Teams or the app.

How can Power Automate track unused Agent Builder agents?

The described pattern uses Graph API detection, a SharePoint list, Power Automate and Teams adaptive cards to contact owners after 60 days of inactivity.

This post is licensed under CC BY 4.0 by the author.