Microsoft Copilot offerings use state-of-the-art generative AI technology to empower people and help them fulfill their tasks. This technology includes prompt-based methods utilizing some of the largest language models to date. Crafting system prompts is difficult and time-consuming and requires considerable human labor. It is needed not only when updating the experience or when introducing new capabilities, but also with each incremental update of the underlying language models. In this project, we build an effective pipeline of AI agents for the automated tuning and optimization of the Copilot system prompts. AI is used to evaluate prompts and prompt-generated content, reason, and generate new and improved prompts.