{"id":9031,"date":"2021-07-29T09:00:02","date_gmt":"2021-07-29T16:00:02","guid":{"rendered":"https:\/\/www.microsoft.com\/insidetrack\/blog\/?p=9031"},"modified":"2026-04-06T06:32:41","modified_gmt":"2026-04-06T13:32:41","slug":"generating-great-results-administering-search-at-microsoft","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/","title":{"rendered":"Generating great results: Administering search at Microsoft"},"content":{"rendered":"
Microsoft has more than 300,000 employees working around the globe, and collectively, our employees use or access many petabytes of content as they move through their workday. Within our employee base, there are many different personas who have widely varying search interests and use hundreds of content sources. Those content sources can be file shares, Microsoft SharePoint sites, documents and other files, and internal websites. Our employees also frequently access external websites, such as our Human Resource websites.<\/p>\n At Microsoft, personas are commonly clustered based on three factors: the major organization within the company, the employee\u2019s profession, and the employee\u2019s geographic location. A Microsoft seller working in Latin America has different search interests than an engineer working in China, for example. As a result, it can be challenging to accommodate the markedly different interests of these two employees while enabling them to search efficiently.<\/p>\n In parallel, Microsoft separates search activities into two logical sets.<\/p>\n The first is enterprise-wide search, in which search users don\u2019t know the exact source for the content they\u2019re seeking but want to find appropriate content from across the company. The second is tool-specific search, when users search within Microsoft Outlook, Microsoft SharePoint, and other applications or tools they\u2019re using, and they\u2019re expecting to find the content they want within that application or tool.<\/p>\n Microsoft\u2019s central search administration team focuses on enterprise-wide search, striving to make it as effective as possible. The scale of enterprise-wide search within Microsoft is 1.1 million enterprise-wide searches per month on our corporate SharePoint site plus Bing\u2019s work vertical. Central search administration doesn\u2019t currently configure search in other tools such as Outlook, internally developed applications, or individual SharePoint sites.<\/p>\n Microsoft Search is bringing enterprise-wide search capabilities to many different endpoints, such as the Outlook app, Microsoft Word, and Windows Search Box. Any enterprise-wide search in those endpoints is also of interest to search administration.<\/p>\n Based on the findings of several surveys of our employee community, we\u2019ve categorized searches into two broad sets:<\/p>\n [Explore how we\u2019re monitoring end-to-end enterprise health with Microsoft Azure.<\/a> | Read more about instrumenting ServiceNow with Microsoft Azure Monitor.<\/a> | Discover how we\u2019re making content more accessible and searches more efficient at Microsoft.<\/a>]<\/em><\/p>\n Based on survey findings and other internal data on search activities, search administration set a primary goal: enabling employees to find the information that they need as quickly as possible.<\/p>\n Industry research conducted by firms such as McKinsey & Company, in its report \u201cThe social economy: Unlocking value and productivity through social technologies,\u201d and Gartner, in \u201cImproving the Employee Experience Improves the Customer Experience,\u201d has revealed that that the average employee spends an estimated 6 to 25 hours per month searching for information. Employees use this information to perform current work, provide better-quality answers to customers, and other purposes. So, the benefits of search start with direct productivity gains and extend to indirect benefits that result when employees have the appropriate information available when they need it.<\/p>\n To deliver the best possible search experience, Microsoft search admin uses most of the capabilities that Microsoft Search provides via the Microsoft 365 admin center. These capabilities include:<\/p>\n Search admin also uses two additional mechanisms outside the admin portal\u2014the SharePoint hybrid crawler and a custom content export\/import process that our internal IT team\u2014Microsoft Digital Employee Experience (MDEE)\u2014built several years ago, before connectors were introduced.<\/p>\n By aggregating a variety of telemetry, some of it custom developed, search administration has determined that nearly half of all searches benefit from one of the search admin capabilities. Our employees who receive such benefits average a one-minute faster search completion time than those whose searches don\u2019t use those capabilities.<\/p>\n Across 1.1 million monthly searches at Microsoft, that time savings amounts to more than 6,000 hours a month of direct employee-productivity benefit. The indirect benefits that McKinsey & Company and Gartner research identified can multiply that productivity benefit, doubling or tripling it depending on how the calculation is performed.<\/p>\n At Microsoft, we achieve these results through an investment of 300 hours per month in search admin time.<\/p>\n To manage and continually streamline employee search activity across Microsoft, search admin conducts a broad range of activities on a daily, monthly, and quarterly basis, as depicted in the graphic below.<\/p>\n Because resources are always limited, lessons from the Microsoft experience can help organizations when they\u2019re deciding where to invest search admin effort. The table below shows the user benefit we were able to measure associated with the activities described in earlier sections.<\/p>\n <\/p>\n Benefits of search admin activity. <\/em><\/p>\n Given these benefits, our experience leads to a sequence of three steps to take when beginning search administration, starting with the one that has the greatest user impact. The following paragraphs describe the scope of each step and the intended benefit.<\/p>\n 1. Implement active-bookmark management.<\/strong> Bookmarks are the best way to support Quick Find (re-find) use cases. For instance, by defining a bookmark along with a friendly name and entering keywords for common misspellings, the search admin staff can provide a bookmark when a user attempts a quick navigation in a browser but misspells a term. Search admin can also ensure that the correct authoritative content is placed at the top of search results.<\/p>\n Other suggestions follow:<\/p>\n 2. Connect additional content.<\/strong> Microsoft Search, by default, covers SharePoint and Microsoft OneDrive and is working to enable additional content to be brought in from across Microsoft 365. There likely are many other content sources in any organization\u2014internally developed applications, third-party apps, internal websites, and others. Identify the most important content sources for your company and create a way to add them to search. Multiple mechanisms can help you do this, from using the SharePoint hybrid crawler, to using Microsoft connectors, to creating custom connectors and entirely custom processes.<\/p>\n One way that Microsoft search admin identifies such content is from Microsoft Azure Active Directory authentication reports. Identify the application registrations that receive the most authentication activity. Another way is to ask users what they\u2019re seeking when they search.<\/p>\n 3. Provide<\/strong> search support.<\/strong> Within Microsoft, our search admin team has partnered with our internal library services so that any search feedback that indicates a desire for help with searching can enlist a librarian\u2019s help with that search. That option is also available from the search self-help site.<\/p>\n Although search is generally intuitive, many aspects of it aren\u2019t, such as using Keyword Query Language (KQL) to better target a query. Therefore, providing information to employees about how and where to search for popular types of content is appreciated. Especially with new employees, it\u2019s valuable to provide a quick-reference card or equivalent resource to help them during their first weeks of employment.<\/p>\n While return on investment (ROI) on this service is low, users are very appreciative of it. In addition, a few times a year Microsoft has found that the content that the user accessed has directly and positively affected corporate revenue and customer service.<\/p>\n Active administration of search is worth doing for any large enterprise. For Microsoft, our investment of 300 hours per month yields a benefit of more than 8,000 hours of productivity gain per month. Exactly how to administer search will vary for every enterprise, but at a minimum, creating and maintaining bookmarks to popular sites and covering popular topics will provide significant benefit to your company.<\/p>\n We provide some minimum activity and related numbers used in the details that follow. Internally, Microsoft logs more than 1 million enterprise searches per month, and those searches use more than 80,000 unique search terms. You can adjust any of the thresholds to be more appropriate to your organization.<\/p>\n SharePoint Search and Bing incorporate feedback options that enable employees to submit bookmark suggestions. Whenever one is submitted, it\u2019s reviewed for:<\/p>\n If the suggested bookmark meets the established criteria, it\u2019s added to the enterprise bookmarks.<\/p>\n Whenever possible, search staff capture the name of the content owner that the bookmark points to, because the staff sometimes need this information to perform future administrative work.<\/p>\n Within Microsoft, we\u2019ve created a Microsoft Search self-help site to provide guidance on where to search for what kind of content. In addition, there\u2019s an option to request help from our search staff to find a specific topic. Whenever those requests are received, the search staff perform their own search actions to find the desired content. Because the staff are very knowledgeable about how to use search, they typically find content that the employee hadn\u2019t found. In sharing the results with the employee, the search staff highlight what kind of search they found most beneficial, so that the employee gains insight into how they might improve their search the next time.<\/p>\n Depending on the nature of the request, our search staff might also update a bookmark\u2019s keywords or description to improve search results for the topic.<\/p>\n Review the Microsoft corporate SharePoint portal and internal newsfeeds for any new products, new internal sites, or other announcements. For each, perform a search to check the organic search results, and then create a bookmark if necessary.<\/p>\n Because of our established process for removing unused bookmarks, will typically create a bookmark for major new items if they appear to be of interest to a large portion of Microsoft.<\/p>\n When current search-health telemetry is available from the product, search staff will review health metrics there. In the meantime, some custom telemetry capabilities have been created to enable monitoring of search performance. Any spikes or drops are reported to the appropriate team.<\/p>\n Additionally, search staff perform several searches on SharePoint and Bing manually, timing how long it takes for search results to display in each search platform and ensuring that all search functions (bookmarks, filters, and added content) are performing as expected.<\/p>\n Search staff evaluate each search connector connection defined in our environment, making sure that the connectors are listed as healthy. So far, there have been few errors\u2014much better performance than the SharePoint hybrid crawler, which has a high error rate. Highlights from errors that have occurred include:<\/p>\n This activity reviews popular search terms from the previous month and ensures that either good-quality natural search results appear or that a bookmark or other search aid already exists. \u00a0Beginning with the search logs, the process includes:<\/p>\n Keeping bookmarks and other admin-configured links accurate is a constant challenge at Microsoft. User feedback, as described earlier, is one mechanism that we use to learn about these issues. Another is the monthly broken-links check process. That process includes the following activities:<\/p>\n If a \u201cNot Found\u201d error was returned. <\/strong>First, manually research the topic to determine if a replacement site has been created. If so, update the bookmark with the new URL. This manual research includes performing searches and investigating the results returned or contacting the site owner\u2014if search staff has that information or can locate it easily. Otherwise, remove the bookmark.<\/p>\n If a \u201cRedirect\u201d error was returned.<\/strong> If the bookmark URL is a registered friendly name, ignore this error. If the redirect URL simply adds \u201c\/EN-US\/\u201d (or something similar), ignore the error. Finally, if the redirect URL only adds query parameters, ignore the error.<\/p>\n Otherwise,, manually navigate to the original URL, follow it to the new URL, and then validate that the new URL content matches the bookmark. If so, update the bookmark with the new URL.<\/p>\n If a \u201cRestricted Access\u201d error was returned.<\/strong> Ignore the error, because even though search administration doesn\u2019t have access to the content, the URL exists.<\/p>\n To help our user community work more efficiently when they\u2019re searching for information across the company, we\u2019ve created a SharePoint portal specific to search. That portal has a few major components, which are structured as sections within the portal:<\/p>\n What to use when. <\/strong>This section provides brief descriptions of the major search tools available within Microsoft and the type of content that they encompass. This covers our primary enterprise-wide search portal, Bing\u2019s work search, and other search tools specific to individual personas or divisions within the company.<\/p>\n How to use major search tools. <\/strong>This section provides tips on how to use major search tools (SharePoint, Outlook, and Microsoft Teams, for example). It also includes a subsection on how to make content more visible, targeted to content owners.<\/p>\n Help me find something. <\/strong>This section enables anyone in the company to ask the search-support team to help them find information on a topic. Employees can also use this tool to make suggestions or provide feedback.<\/p>\n At Microsoft, this activity involves using the SharePoint Term Store to maintain an overall corporate taxonomy. This repository includes a large set of acronyms, which are loaded into the search admin portal. Search admin staff manages acronym refresh as follows:<\/p>\n Every company stages major corporate events that occur on a regular basis, perhaps annually, quarterly, or monthly. Bookmarks for these events are very popular in the weeks leading up to and following such events but aren\u2019t needed outside of that timeframe.<\/p>\n Search admin maintains a simple spreadsheet of these events and their frequency\/active dates.<\/p>\n When this telemetry is available from the product, search staff review existing bookmark usage data. In the meantime, it\u2019s possible to export the search logs and merge them with bookmarks by using the keywords.<\/p>\n When telemetry allows, search admin wants to:<\/p>\n The Microsoft Real Estate and Facilities\u00a0(RE&F) team maintains a database of all corporate locations, which search admin accesses via a Microsoft Excel add-in. Search admin filters the locations to only those to which employees are likely to travel\u2014that is, locations that aren\u2019t inactive or under construction.<\/p>\n The search administration portal has a location import capability, which accommodates loading this information. Because location loading is more complex than acronym loading, our steps are:<\/p>\n Within Microsoft, friendly URL names are very popular, and we\u2019ve developed an application to manage them. As a result, search staff can ask the friendly-name apps team for a periodic export that includes the friendly name and how often the name has been used in the previous 30 days.<\/p>\n Any friendly name meeting the following conditions will have a bookmark created for it:<\/p>\n We periodically update our stories, but we can\u2019t verify that they represent the full picture of our current situation at Microsoft. We leave them on the site so you can see what our thinking and experience was at the time. Microsoft has more than 300,000 employees working around the globe, and collectively, our employees use […]<\/p>\n","protected":false},"author":133,"featured_media":9041,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_hide_featured_on_single":false,"_show_featured_caption_on_single":true,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[90],"coauthors":[646],"class_list":["post-9031","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","tag-sharepoint","program-microsoft-digital-technical-stories","m-blog-post"],"yoast_head":"\n
We periodically update our stories, but we can\u2019t verify that they represent the full picture of our current situation at Microsoft. We leave them on the site so you can see what our thinking and experience was at the time.<\/em><\/p>\n\n
Enabling optimal search<\/h2>\n
\n
Business impact of search<\/h2>\n

Daily activities<\/h3>\n
\n
Monthly activities<\/h3>\n
\n
Quarterly activities<\/h3>\n
\n
Where to start<\/h2>\n
\n\n
\n \nSearch admin activity<\/th>\n User benefit<\/th>\n<\/tr>\n<\/thead>\n \n Bookmarks and loading acronyms and locations from other sources<\/td>\n 45% of all searches utilize this information<\/p>\n \n Connect more content<\/td>\n 3% of all searches utilize this information<\/p>\n \n Search How-to site and Help Me Find It<\/td>\n 1% of Microsoft users visit the site\/month<\/p>\n \n
<\/p>\nSteps to take every day<\/h2>\n
Process bookmark requests<\/h3>\n
\n
\n
Process support requests<\/h3>\n
Review new sites<\/h3>\n
Perform search health check<\/h3>\n
Monitor connections<\/h3>\n
\n
Steps to take monthly<\/h2>\n
Review search log<\/h3>\n
\n
\n
Fix broken links<\/h3>\n
\n
Update search help site<\/h3>\n
Reload acronyms<\/h3>\n
\n
Review recurring events<\/h3>\n
\n
Steps to take quarterly<\/h2>\n
Tune bookmarks<\/h3>\n
\n
\n
Reload locations<\/h3>\n
\n
Review friendly URLs<\/h3>\n
\n
\n
<\/p>\n\n