Key Engineer Agentic AI Developer - MS Copilot Studio

Technology · Remote

Apply for this Job

Description

About the Role:


As an Agentic AI Developer specializing in Microsoft 365 Copilot and knowledge platforms, you will play a critical role in designing, configuring, and building the AI agent, search, and persona-based experience of the Polyphonic Data System. You will collaborate closely with the program lead, governance document authors, the Data Literacy Academy team, and engineering teams to deliver a Copilot-based agent that understands a large, connected governance document estate. Your work will span agent configuration, RAG implementation, content architecture, dependency visualization, and document lifecycle workflows, with a strong emphasis on accuracy, citation integrity, and platform-agnostic design.


General Responsibilities

  • Collaborate with the program lead, governance document authors, and engineering teams to understand platform requirements and agent behavior expectations
  • Analyze governance documentation, requirements, and technical specifications to create clear, accurate, and well-cited agent configurations
  • Design, configure, and maintain Copilot agents covering functional and persona-based aspects of the platform
  • Implement comprehensive RAG strategies to validate answer accuracy, citation reliability, and security of grounded responses
  • Develop and maintain content architecture, metadata, and taxonomy with appropriate chunking and tagging to support AI consumption
  • Plan, execute, and analyze search relevance tuning and agent quality measures to assess accuracy, adoption, and user feedback
  • Identify, document, and report agent quality issues with detailed evidence, logs, and remediation recommendations
  • Work closely with product, engineering, and governance stakeholders to anticipate and support upcoming platform changes
  • Develop and maintain reusable agent configurations, runbooks, and documentation, focusing on efficiency, portability, and quality gates
  • Communicate actively with stakeholders to clarify requirements, review designs, and verify implementations
  • Maintain organized and traceable configuration artifacts, prompts, and runbooks, ensuring compliance with governance and audit standards
  • Proactively identify risks, escalate critical issues, and suggest mitigation strategies to ensure high-quality, compliant deployments
  • Participate actively in Agile ceremonies, including stand-ups, sprint planning, retrospectives, and backlog grooming


Technical Responsibilities

  • Design, implement, and maintain declarative and custom agents in Microsoft Copilot Studio and Microsoft 365 Copilot, grounded on SharePoint libraries, Agile QMS copies, and partner SharePoint sites
  • Write and tune agent instructions, topics, actions, and knowledge sources so answers remain accurate, cited, and consistent across audiences
  • Configure persona-specific agents or behaviors for commercial, functional, engineering, customer, and auditor audiences
  • Build retrieval-augmented generation (RAG) patterns where Copilot alone is insufficient, using Azure AI Search, Azure OpenAI/Azure AI Foundry, or Microsoft Graph connectors
  • Enable on-demand generation of PowerPoint, Word, Excel, and PDF outputs from platform content using approved brand templates
  • Apply Microsoft Purview sensitivity labels, permissions, and data loss prevention controls so the agent only surfaces content each user is authorized to see, supportin


Requirements

Must Have:

  • Strong experience in software/platform/data solution development (8–12 years), including 3+ years delivering AI/LLM solutions to production
  • With hands-on expertise in Microsoft 365 Copilot and Copilot Studio (declarative/custom agents, knowledge sources, actions, plugins, Graph connectors)
  • Solid understanding of platform-agnostic design, building agents and content models portable across platforms using open APIs and decoupled architecture
  • Experience with generative AI and RAG patterns (prompt engineering, grounding, chunking, embeddings, hallucination control) using Azure AI Search and Azure OpenAI/Azure AI Foundry
  • Familiarity with AWS services (S3, Lambda, API Gateway) and awareness of Amazon Bedrock and Amazon Kendra
  • Experience with SharePoint Online architecture, metadata, taxonomy, and Power Platform (Power Automate, Power Apps, Dataverse)
  • Proficiency in Agile delivery and effective cross-team communication with distributed, multi-vendor stakeholders
  • Experience with front-end development (SPFx, React, TypeScript) and knowledge graph/data modeling is a plus