{"id":9031,"date":"2024-02-23T09:00:02","date_gmt":"2024-02-23T17:00:02","guid":{"rendered":"https:\/\/www.microsoft.com\/insidetrack\/blog\/?p=9031"},"modified":"2024-02-23T15:13:09","modified_gmt":"2024-02-23T23:13:09","slug":"generating-great-results-administering-search-at-microsoft","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/","title":{"rendered":"Generating great results: Administering search at Microsoft"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"112\" class=\"size-medium wp-image-7498 alignright\" style=\"margin-top: 0px;\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2021\/10\/ms-digital-technical-stories-300x112.png\" alt=\"Microsoft Digital technical stories\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2021\/10\/ms-digital-technical-stories-300x112.png 300w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2021\/10\/ms-digital-technical-stories.png 500w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/>Microsoft has more than 300,000 employees working around the globe, and collectively, our employees use or access many petabytes of content as they move through their workday. Within our employee base, there are many different personas who have widely varying search interests and use hundreds of content sources. Those content sources can be file shares, Microsoft SharePoint sites, documents and other files, and internal websites. Our employees also frequently access external websites, such as our Human Resource websites.<\/p>\n<p>At Microsoft, personas are commonly clustered based on three factors: the major organization within the company, the employee\u2019s profession, and the employee\u2019s geographic location. A Microsoft seller working in Latin America has different search interests than an engineer working in China, for example. As a result, it can be challenging to accommodate the markedly different interests of these two employees while enabling them to search efficiently.<\/p>\n<p>In parallel, Microsoft separates search activities into two logical sets.<\/p>\n<p>The first is enterprise-wide search, in which search users don\u2019t know the exact source for the content they\u2019re seeking but want to find appropriate content from across the company. The second is tool-specific search, when users search within Microsoft Outlook, Microsoft SharePoint, and other applications or tools they\u2019re using, and they\u2019re expecting to find the content they want within that application or tool.<\/p>\n<p>Microsoft\u2019s central search administration team focuses on enterprise-wide search, striving to make it as effective as possible. The scale of enterprise-wide search within Microsoft is 1.1 million enterprise-wide searches per month on our corporate SharePoint site plus Bing\u2019s work vertical. Central search administration doesn\u2019t currently configure search in other tools such as Outlook, internally developed applications, or individual SharePoint sites.<\/p>\n<p>Microsoft Search is bringing enterprise-wide search capabilities to many different endpoints, such as the Outlook app, Microsoft Word, and Windows Search Box. Any enterprise-wide search in those endpoints is also of interest to search administration.<\/p>\n<p>Based on the findings of several surveys of our employee community, we\u2019ve categorized searches into two broad sets:<\/p>\n<ul class=\"c-list\">\n<li>Quick find (re-find). The employee knows that something exists and just wants to get to that content. This activity accounts for approximately 70 percent of our enterprise-wide search volume.<\/li>\n<li>Research (investigate). The employee needs information or an answer requiring some in-depth content reading, analysis, or review. This search type accounts for approximately 30 percent of our enterprise-wide search volume.<a name=\"_Toc66725988\"><\/a><\/li>\n<\/ul>\n<p><em>[<a href=\"\/en-us\/insidetrack\/monitoring-endtoend-enterprise-health-with-azure\">Explore how we\u2019re monitoring end-to-end enterprise health with Microsoft Azure.<\/a> | <a href=\"\/en-us\/insidetrack\/instrumenting-servicenow-with-azure-monitor\">Read more about instrumenting ServiceNow with Microsoft Azure Monitor.<\/a> | <a href=\"\/insidetrack\/blog\/making-content-more-accessible-and-searches-more-efficient-at-microsoft\/\">Discover how we\u2019re making content more accessible and searches more efficient at Microsoft.<\/a>]<\/em><\/p>\n<h2>Enabling optimal search<\/h2>\n<p>Based on survey findings and other internal data on search activities, search administration set a primary goal: enabling employees to find the information that they need as quickly as possible.<\/p>\n<p>Industry research conducted by firms such as McKinsey &amp; Company, in its report \u201cThe social economy: Unlocking value and productivity through social technologies,\u201d and Gartner, in \u201cImproving the Employee Experience Improves the Customer Experience,\u201d has revealed that that the average employee spends an estimated 6 to 25 hours per month searching for information. Employees use this information to perform current work, provide better-quality answers to customers, and other purposes. So, the benefits of search start with direct productivity gains and extend to indirect benefits that result when employees have the appropriate information available when they need it.<\/p>\n<p>To deliver the best possible search experience, Microsoft search admin uses most of the capabilities that Microsoft Search provides via the Microsoft 365 admin center. These capabilities include:<\/p>\n<ul class=\"c-list\">\n<li>Bookmarks<\/li>\n<li>Q&amp;A<\/li>\n<li>Locations<\/li>\n<li>Acronyms<\/li>\n<li>Connectors<\/li>\n<\/ul>\n<p>Search admin also uses two additional mechanisms outside the admin portal\u2014the SharePoint hybrid crawler and a custom content export\/import process that our internal IT team\u2014Microsoft Digital Employee Experience (MDEE)\u2014built several years ago, before connectors were introduced.<\/p>\n<h2>Business impact of search<\/h2>\n<p>By aggregating a variety of telemetry, some of it custom developed, search administration has determined that nearly half of all searches benefit from one of the search admin capabilities. Our employees who receive such benefits average a one-minute faster search completion time than those whose searches don\u2019t use those capabilities.<\/p>\n<p>Across 1.1 million monthly searches at Microsoft, that time savings amounts to more than 6,000 hours a month of direct employee-productivity benefit. The indirect benefits that McKinsey &amp; Company and Gartner research identified can multiply that productivity benefit, doubling or tripling it depending on how the calculation is performed.<\/p>\n<p>At Microsoft, we achieve these results through an investment of 300 hours per month in search admin time.<\/p>\n<p>To manage and continually streamline employee search activity across Microsoft, search admin conducts a broad range of activities on a daily, monthly, and quarterly basis, as depicted in the graphic below.<\/p>\n<figure id=\"attachment_9043\" aria-describedby=\"caption-attachment-9043\" style=\"width: 817px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-9043 size-full\" style=\"margin-top: 20px;\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-figure1.png\" alt=\"Graphic showing daily, monthly, and quarterly Microsoft search admin activities.\" width=\"817\" height=\"350\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-figure1.png 817w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-figure1-300x129.png 300w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-figure1-768x329.png 768w\" sizes=\"(max-width: 817px) 100vw, 817px\" \/><figcaption id=\"caption-attachment-9043\" class=\"wp-caption-text\">Microsoft search admin activities and schedule.<\/figcaption><\/figure>\n<h3>Daily activities<\/h3>\n<ul class=\"c-list\">\n<li><strong>Process bookmark requests:<\/strong> SharePoint Search and Bing provide feedback options that enable employees to submit bookmark suggestions. Review bookmark requests as they arrive and add to the collection if appropriate.<\/li>\n<li><strong>Process support requests:<\/strong> SharePoint Search provides a form that employees can use to ask for help with their search. Review and answer search-support requests.<\/li>\n<li><strong>Review new sites:<\/strong> Brief check of Microsoft\u2019s internal news site for any new products, new internal sites, or other announcements that may warrant proactively creating a bookmark.<\/li>\n<li><strong>Perform search health check:<\/strong> Review the search-health monitoring dashboard, note any major incidents, and appropriately forward notifications of failovers or other outages.<\/li>\n<li><strong>Monitor connections:<\/strong> Review connector job logs. Resolve any errors and resubmit.<\/li>\n<\/ul>\n<h3>Monthly activities<\/h3>\n<ul class=\"c-list\">\n<li><strong>Review search log:<\/strong> Review logs to locate queries that have sufficient usage but produce sub-par organic results. Create bookmarks or Q&amp;A blocks as appropriate.<\/li>\n<li><strong>Fix broken links:<\/strong> Run a third-party link-checking tool to locate any broken links in the bookmarks. Replace or remove broken links.<\/li>\n<li><strong>Update search help site:<\/strong> Update search help site to reflect new features and services.<\/li>\n<li><strong>Reload acronyms:<\/strong> Obtain an updated list of acronyms from the corporate taxonomy. Remove the existing acronyms and replace with the updated acronym list.<\/li>\n<li><strong>Review recurring events:<\/strong> Review bookmarks related to reoccurring events. Deactivate bookmarks in the off months and reactivate bookmarks for upcoming events.<\/li>\n<\/ul>\n<h3>Quarterly activities<\/h3>\n<ul class=\"c-list\">\n<li><strong>Tune bookmarks:<\/strong> Review usage metrics to locate bookmarks that aren\u2019t receiving minimum usage. For us, minimum usage is three or more clicks per month, but that threshold could vary for other enterprises.<\/li>\n<li><strong>Reload locations:<\/strong> Obtain an updated list of company locations from our real-estate organization, Microsoft Global Workplace Services. Erase the existing location data in the admin portal and replace it with the updated information.<\/li>\n<li><strong>Review friendly URLs:<\/strong> Review the shortened links that receive the most usage and add any that meet our criteria. <a name=\"_Toc66725994\"><\/a><\/li>\n<\/ul>\n<h2>Where to start<\/h2>\n<p>Because resources are always limited, lessons from the Microsoft experience can help organizations when they\u2019re deciding where to invest search admin effort. The table below shows the user benefit we were able to measure associated with the activities described in earlier sections.<\/p>\n<p>&nbsp;<\/p>\n<table style=\"border: 1px solid black; border-collapse: collapse; padding: 5px; max-width: 100%; margin-top: 20px;\">\n<thead>\n<tr>\n<th style=\"border: 1px solid black; padding: 5px; text-align: center; width: 50%;\">Search admin activity<\/th>\n<th style=\"border: 1px solid black; padding: 5px; text-align: center; width: 50%;\">User benefit<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td style=\"border: 1px solid black; padding: 5px;\">Bookmarks and loading acronyms and locations from other sources<\/td>\n<td style=\"border: 1px solid black; padding: 5px;\">45% of all searches utilize this information<\/p>\n<div>Approximately 8,000 hours of benefit\/month<\/div>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border: 1px solid black; padding: 5px;\">Connect more content<\/td>\n<td style=\"border: 1px solid black; padding: 5px;\">3% of all searches utilize this information<\/p>\n<div>Approximately 700 hours of benefit\/month<\/div>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border: 1px solid black; padding: 5px;\">Search How-to site and Help Me Find It<\/td>\n<td style=\"border: 1px solid black; padding: 5px;\">1% of Microsoft users visit the site\/month<\/p>\n<div>40 user requests assisted\/month<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><em>Benefits of search admin activity. <\/em><\/p>\n<p>Given these benefits, our experience leads to a sequence of three steps to take when beginning search administration, starting with the one that has the greatest user impact. The following paragraphs describe the scope of each step and the intended benefit.<\/p>\n<p><strong>1. Implement active-bookmark management.<\/strong> Bookmarks are the best way to support Quick Find (re-find) use cases. For instance, by defining a bookmark along with a friendly name and entering keywords for common misspellings, the search admin staff can provide a bookmark when a user attempts a quick navigation in a browser but misspells a term. Search admin can also ensure that the correct authoritative content is placed at the top of search results.<\/p>\n<p>Other suggestions follow:<\/p>\n<ul class=\"c-list\">\n<li>In partnership with bookmark management, including acronyms and locations provides good value, but only if your search admin can import this content from other sources.<\/li>\n<li>Where bookmarks exist for a particular search term or topic, define a Q&amp;A. The answer text lists the most common links to be followed and it describes and groups them in a logical manner based on the different personas. For instance, if <em>cloud<\/em> is a common search term, sellers might have a very different set of content they\u2019re seeking than IT technicians would. So, creating an answer showing five to 10 potential links, with a description of the focus of each one and how they fit together as a whole, is beneficial.<\/li>\n<\/ul>\n<p><strong>2. Connect additional content.<\/strong> Microsoft Search, by default, covers SharePoint and Microsoft OneDrive and is working to enable additional content to be brought in from across Microsoft 365. There likely are many other content sources in any organization\u2014internally developed applications, third-party apps, internal websites, and others. Identify the most important content sources for your company and create a way to add them to search. Multiple mechanisms can help you do this, from using the SharePoint hybrid crawler, to using Microsoft connectors, to creating custom connectors and entirely custom processes.<\/p>\n<p>One way that Microsoft search admin identifies such content is from Microsoft Azure Active Directory authentication reports. Identify the application registrations that receive the most authentication activity. Another way is to ask users what they\u2019re seeking when they search.<\/p>\n<p><strong>3. Provide<\/strong> <strong>search support.<\/strong> Within Microsoft, our search admin team has partnered with our internal library services so that any search feedback that indicates a desire for help with searching can enlist a librarian\u2019s help with that search. That option is also available from the search self-help site.<\/p>\n<p>Although search is generally intuitive, many aspects of it aren\u2019t, such as using Keyword Query Language (KQL) to better target a query. Therefore, providing information to employees about how and where to search for popular types of content is appreciated. Especially with new employees, it\u2019s valuable to provide a quick-reference card or equivalent resource to help them during their first weeks of employment.<\/p>\n<p>While return on investment (ROI) on this service is low, users are very appreciative of it. In addition, a few times a year Microsoft has found that the content that the user accessed has directly and positively affected corporate revenue and customer service.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"74\" class=\"alignnone size-medium wp-image-7448\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2021\/10\/key-takeaways-300x74.png\" alt=\"Key Takeaways\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2021\/10\/key-takeaways-300x74.png 300w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2021\/10\/key-takeaways.png 500w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>Active administration of search is worth doing for any large enterprise. For Microsoft, our investment of 300 hours per month yields a benefit of more than 8,000 hours of productivity gain per month. Exactly how to administer search will vary for every enterprise, but at a minimum, creating and maintaining bookmarks to popular sites and covering popular topics will provide significant benefit to your company.<\/p>\n<h2>Steps to take every day<\/h2>\n<p>We provide some minimum activity and related numbers used in the details that follow. Internally, Microsoft logs more than 1 million enterprise searches per month, and those searches use more than 80,000 unique search terms. You can adjust any of the thresholds to be more appropriate to your organization.<\/p>\n<h3>Process bookmark requests<\/h3>\n<p>SharePoint Search and Bing incorporate feedback options that enable employees to submit bookmark suggestions. Whenever one is submitted, it\u2019s reviewed for:<\/p>\n<ul class=\"c-list\">\n<li>Accuracy \u2013 the suggested page provides accurate, current information that isn\u2019t already covered by another bookmark.<\/li>\n<li>Access \u2013 the suggested page is accessible to all Microsoft full-time employees, at a minimum.<\/li>\n<li>Query usage \u2013 the suggested or potential keywords associated with the bookmark have been searched at least 20 times in one month before they\u2019re added to the bookmark collection.\n<ul class=\"c-list\">\n<li>There are exceptions, such as new products, technologies, and initiatives, for example, which may not currently appear in query logs but have the potential of becoming popular search terms.<\/li>\n<li>The SharePoint Search logs can be used to review the query frequency.<\/li>\n<\/ul>\n<\/li>\n<li>Current visibility in search results is poor \u2013 the suggested page doesn\u2019t appear in the first page of search results for the bookmark\u2019s suggested or potential keywords.<\/li>\n<\/ul>\n<p>If the suggested bookmark meets the established criteria, it\u2019s added to the enterprise bookmarks.<\/p>\n<p>Whenever possible, search staff capture the name of the content owner that the bookmark points to, because the staff sometimes need this information to perform future administrative work.<\/p>\n<h3>Process support requests<\/h3>\n<p>Within Microsoft, we\u2019ve created a Microsoft Search self-help site to provide guidance on where to search for what kind of content. In addition, there\u2019s an option to request help from our search staff to find a specific topic. Whenever those requests are received, the search staff perform their own search actions to find the desired content. Because the staff are very knowledgeable about how to use search, they typically find content that the employee hadn\u2019t found. In sharing the results with the employee, the search staff highlight what kind of search they found most beneficial, so that the employee gains insight into how they might improve their search the next time.<\/p>\n<p>Depending on the nature of the request, our search staff might also update a bookmark\u2019s keywords or description to improve search results for the topic.<\/p>\n<h3>Review new sites<\/h3>\n<p>Review the Microsoft corporate SharePoint portal and internal newsfeeds for any new products, new internal sites, or other announcements. For each, perform a search to check the organic search results, and then create a bookmark if necessary.<\/p>\n<p>Because of our established process for removing unused bookmarks, will typically create a bookmark for major new items if they appear to be of interest to a large portion of Microsoft.<\/p>\n<h3>Perform search health check<\/h3>\n<p>When current search-health telemetry is available from the product, search staff will review health metrics there. In the meantime, some custom telemetry capabilities have been created to enable monitoring of search performance. Any spikes or drops are reported to the appropriate team.<\/p>\n<p>Additionally, search staff perform several searches on SharePoint and Bing manually, timing how long it takes for search results to display in each search platform and ensuring that all search functions (bookmarks, filters, and added content) are performing as expected.<\/p>\n<h3>Monitor connections<\/h3>\n<p>Search staff evaluate each search connector connection defined in our environment, making sure that the connectors are listed as healthy. So far, there have been few errors\u2014much better performance than the SharePoint hybrid crawler, which has a high error rate. Highlights from errors that have occurred include:<\/p>\n<ul class=\"c-list\">\n<li>Permissions to the content source have been lost or expired. We resolve this by getting those permissions renewed.<\/li>\n<li>A new version of the connector has been received. This tends to be a problem unique to internal Microsoft, as the company is commonly an early adopter of such releases. In these cases, search admin typically must delete and re-create the connection.<\/li>\n<\/ul>\n<h2>Steps to take monthly<\/h2>\n<h3>Review search log<\/h3>\n<p>This activity reviews popular search terms from the previous month and ensures that either good-quality natural search results appear or that a bookmark or other search aid already exists. \u00a0Beginning with the search logs, the process includes:<\/p>\n<ol class=\"c-list\">\n<li>Excluding search terms that the organization has blocked. These include things like <em>confidential<\/em> and <em>Attorney\/Client Privileged<\/em>.<\/li>\n<li>Excluding search terms that have a frequency below a certain threshold. Our current minimum threshold is 50; other companies may set a different value.<\/li>\n<li>Excluding search terms that are in quotation marks or that indicate testing or monitoring, such as <em>aaaaaaa<\/em>.<\/li>\n<li>Exporting the current bookmark list and all associated keywords. Exclude search terms that already exist as keywords.<\/li>\n<li>For the search terms that remain, consider the following:\n<ol class=\"c-list\" style=\"list-style-type: lower-alpha;\">\n<li>Perform a search using that search term and evaluate the results.<\/li>\n<li>If the results are fine as they are, no action is needed.<\/li>\n<li>If the content that\u2019s the best fit for that search term isn\u2019t positioned near the top of the first page, create a bookmark or add to an existing bookmark so that the term is positioned appropriately.<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<h3>Fix broken links<\/h3>\n<p>Keeping bookmarks and other admin-configured links accurate is a constant challenge at Microsoft. User feedback, as described earlier, is one mechanism that we use to learn about these issues. Another is the monthly broken-links check process. That process includes the following activities:<\/p>\n<ol class=\"c-list\">\n<li>All bookmark URLs are exported to a plain text list.<\/li>\n<li>Search staff process the list through a third-party link checker and review each URL that returns an error code or redirect notification. The decision-making guideline follows; note that you may need refinements and exceptions for your organization.<\/li>\n<\/ol>\n<p><strong>If a \u201cNot Found\u201d error was returned. <\/strong>First, manually research the topic to determine if a replacement site has been created. If so, update the bookmark with the new URL. This manual research includes performing searches and investigating the results returned or contacting the site owner\u2014if search staff has that information or can locate it easily. Otherwise, remove the bookmark.<\/p>\n<p><strong>If a \u201cRedirect\u201d error was returned.<\/strong> If the bookmark URL is a registered friendly name, ignore this error. If the redirect URL simply adds \u201c\/EN-US\/\u201d (or something similar), ignore the error. Finally, if the redirect URL only adds query parameters, ignore the error.<\/p>\n<p>Otherwise,, manually navigate to the original URL, follow it to the new URL, and then validate that the new URL content matches the bookmark. If so, update the bookmark with the new URL.<\/p>\n<p><strong>If a \u201cRestricted Access\u201d error was returned.<\/strong> Ignore the error, because even though search administration doesn\u2019t have access to the content, the URL exists.<\/p>\n<h3>Update search help site<\/h3>\n<p>To help our user community work more efficiently when they\u2019re searching for information across the company, we\u2019ve created a SharePoint portal specific to search. That portal has a few major components, which are structured as sections within the portal:<\/p>\n<p><strong>What to use when. <\/strong>This section provides brief descriptions of the major search tools available within Microsoft and the type of content that they encompass. This covers our primary enterprise-wide search portal, Bing\u2019s work search, and other search tools specific to individual personas or divisions within the company.<\/p>\n<p><strong>How to use major search tools. <\/strong>This section provides tips on how to use major search tools (SharePoint, Outlook, and Microsoft Teams, for example). It also includes a subsection on how to make content more visible, targeted to content owners.<\/p>\n<p><strong>Help me find something. <\/strong>This section enables anyone in the company to ask the search-support team to help them find information on a topic. Employees can also use this tool to make suggestions or provide feedback.<\/p>\n<h3>Reload acronyms<\/h3>\n<p>At Microsoft, this activity involves using the SharePoint Term Store to maintain an overall corporate taxonomy. This repository includes a large set of acronyms, which are loaded into the search admin portal. Search admin staff manages acronym refresh as follows:<\/p>\n<ul class=\"c-list\">\n<li>Corporate exports acronyms from SharePoint Term Store.<\/li>\n<li>Search admin checks the layout, adjusting it as needed, and then imports it by using the acronym import capability in the search admin portal. This process performs a complete overwrite of existing acronyms, because it\u2019s easier to eliminate incorrect or outdated acronyms than it is to selectively identify needed changes.<\/li>\n<\/ul>\n<h3>Review recurring events<\/h3>\n<p>Every company stages major corporate events that occur on a regular basis, perhaps annually, quarterly, or monthly. Bookmarks for these events are very popular in the weeks leading up to and following such events but aren\u2019t needed outside of that timeframe.<\/p>\n<p>Search admin maintains a simple spreadsheet of these events and their frequency\/active dates.<\/p>\n<ul class=\"c-list\">\n<li>If an event is coming up and has reached its appropriate timeframe, search admin confirms that the event is still happening, locates the official information site, and creates a bookmark.<\/li>\n<li>If the event is coming up, but there doesn\u2019t appear to be an official site or the event has been canceled, the spreadsheet is updated appropriately by updating or removing the event.<\/li>\n<li>If the event has passed and has reached its appropriate timeframe, search admin removes the bookmark. Disabling the bookmark is another option.<\/li>\n<li>It\u2019s rare, but possible, for an event to become more frequent, such that the bookmark can remain active indefinitely. In that case, remove the event from the spreadsheet.<\/li>\n<\/ul>\n<h2>Steps to take quarterly<\/h2>\n<h3>Tune bookmarks<\/h3>\n<p>When this telemetry is available from the product, search staff review existing bookmark usage data. In the meantime, it\u2019s possible to export the search logs and merge them with bookmarks by using the keywords.<\/p>\n<ul class=\"c-list\">\n<li>Search admin only reviews bookmarks that have been active for the previous 90 days. This allows new bookmarks, especially for new events or content, to have time to generate usage.<\/li>\n<li>Bookmarks receiving fewer than three searches in the previous 90 days are removed.<\/li>\n<\/ul>\n<p>When telemetry allows, search admin wants to:<\/p>\n<ul class=\"c-list\">\n<li>Remove bookmarks receiving fewer than three clickthroughs in the previous 90 days.<\/li>\n<li>Remove bookmarks that were displayed fewer than 100 times in the previous 90 days AND were clicked less than 25 percent of the time.<\/li>\n<\/ul>\n<h3>Reload locations<\/h3>\n<p>The Microsoft Real Estate and Facilities\u00a0(RE&amp;F) team maintains a database of all corporate locations, which search admin accesses via a Microsoft Excel add-in. Search admin filters the locations to only those to which employees are likely to travel\u2014that is, locations that aren\u2019t inactive or under construction.<\/p>\n<p>The search administration portal has a location import capability, which accommodates loading this information. Because location loading is more complex than acronym loading, our steps are:<\/p>\n<ol class=\"c-list\">\n<li>Get the current list of official corporate buildings from our building management system.<\/li>\n<li>Reconcile to the current list in search administration.<\/li>\n<li>Make appropriate changes.<\/li>\n<\/ol>\n<h3>Review friendly URLs<\/h3>\n<p>Within Microsoft, friendly URL names are very popular, and we\u2019ve developed an application to manage them. As a result, search staff can ask the friendly-name apps team for a periodic export that includes the friendly name and how often the name has been used in the previous 30 days.<\/p>\n<p>Any friendly name meeting the following conditions will have a bookmark created for it:<\/p>\n<ul class=\"c-list\">\n<li>More than 1000 uses in the previous 30 days.<\/li>\n<li>Links whose destinations are:\n<ul class=\"c-list\">\n<li>Associated with the company<\/li>\n<li>Information pages (versus files, download pages, or videos)<\/li>\n<li>Not already indexed or bookmarked<\/li>\n<li>URLs that provide a clear indicator of their title or purpose<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"81\" class=\"alignnone size-medium wp-image-7482\" src=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2021\/10\/related_links-300x81.png\" alt=\"Related links\" srcset=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2021\/10\/related_links-300x81.png 300w, https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2021\/10\/related_links.png 500w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<ul class=\"c-list\">\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/insidetrack\/monitoring-endtoend-enterprise-health-with-azure\">Explore how we\u2019re monitoring end-to-end enterprise health with Microsoft Azure.<\/a><\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/insidetrack\/instrumenting-servicenow-with-azure-monitor\">Read more about instrumenting ServiceNow with Microsoft Azure Monitor.<\/a><\/li>\n<li><a href=\"\/insidetrack\/blog\/making-content-more-accessible-and-searches-more-efficient-at-microsoft\/\">Discover how we\u2019re making content more accessible and searches more efficient at Microsoft.<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Microsoft has more than 300,000 employees working around the globe, and collectively, our employees use or access many petabytes of content as they move through their workday. Within our employee base, there are many different personas who have widely varying search interests and use hundreds of content sources. Those content sources can be file shares, [&hellip;]<\/p>\n","protected":false},"author":133,"featured_media":9041,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"_hide_featured_on_single":false,"_show_featured_caption_on_single":true,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2}},"categories":[1],"tags":[332,90],"coauthors":[646],"class_list":["post-9031","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","tag-business-applications","tag-sharepoint","program-microsoft-digital-technical-stories","m-blog-post"],"jetpack_publicize_connections":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Generating Great Results: Administering Search at Microsoft<\/title>\n<meta name=\"description\" content=\"Transforming search administration has improved how Microsoft reviews new sites, performs search health checks, and monitors search-related connections.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Generating Great Results: Administering Search at Microsoft\" \/>\n<meta property=\"og:description\" content=\"Transforming search administration has improved how Microsoft reviews new sites, performs search health checks, and monitors search-related connections.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/\" \/>\n<meta property=\"og:site_name\" content=\"Inside Track Blog\" \/>\n<meta property=\"article:published_time\" content=\"2024-02-23T17:00:02+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-02-23T23:13:09+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-hero.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1040\" \/>\n\t<meta property=\"og:image:height\" content=\"585\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Inside Track staff\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Inside Track staff\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"18 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/\",\"url\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/\",\"name\":\"Generating Great Results: Administering Search at Microsoft\",\"isPartOf\":{\"@id\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-hero.jpg\",\"datePublished\":\"2024-02-23T17:00:02+00:00\",\"dateModified\":\"2024-02-23T23:13:09+00:00\",\"author\":{\"@id\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/#\/schema\/person\/d87d5d73eed76dd055086299c842c17e\"},\"description\":\"Transforming search administration has improved how Microsoft reviews new sites, performs search health checks, and monitors search-related connections.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/#primaryimage\",\"url\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-hero.jpg\",\"contentUrl\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-hero.jpg\",\"width\":1040,\"height\":585,\"caption\":\"Transforming search administration at Microsoft is helping the company improve how it reviews new sites, performs search health checks, and monitors search-related connections.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Generating great results: Administering search at Microsoft\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/#website\",\"url\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/\",\"name\":\"Inside Track Blog\",\"description\":\"How Microsoft does IT\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/#\/schema\/person\/d87d5d73eed76dd055086299c842c17e\",\"name\":\"Inside Track staff\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/#\/schema\/person\/image\/fb338dea806293f999356f7d8a399348\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/3788032f4762be09ee17b2ec39f3d75b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/3788032f4762be09ee17b2ec39f3d75b?s=96&d=mm&r=g\",\"caption\":\"Inside Track staff\"},\"description\":\"Questions? Send us a note: msitstaff@microsoft.com\",\"url\":\"https:\/\/www.microsoft.com\/insidetrack\/blog\/author\/insidetrack\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Generating Great Results: Administering Search at Microsoft","description":"Transforming search administration has improved how Microsoft reviews new sites, performs search health checks, and monitors search-related connections.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/","og_locale":"en_US","og_type":"article","og_title":"Generating Great Results: Administering Search at Microsoft","og_description":"Transforming search administration has improved how Microsoft reviews new sites, performs search health checks, and monitors search-related connections.","og_url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/","og_site_name":"Inside Track Blog","article_published_time":"2024-02-23T17:00:02+00:00","article_modified_time":"2024-02-23T23:13:09+00:00","og_image":[{"width":1040,"height":585,"url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-hero.jpg","type":"image\/jpeg"}],"author":"Inside Track staff","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Inside Track staff","Est. reading time":"18 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/","url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/","name":"Generating Great Results: Administering Search at Microsoft","isPartOf":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/#primaryimage"},"image":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/#primaryimage"},"thumbnailUrl":"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-hero.jpg","datePublished":"2024-02-23T17:00:02+00:00","dateModified":"2024-02-23T23:13:09+00:00","author":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/#\/schema\/person\/d87d5d73eed76dd055086299c842c17e"},"description":"Transforming search administration has improved how Microsoft reviews new sites, performs search health checks, and monitors search-related connections.","breadcrumb":{"@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/#primaryimage","url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-hero.jpg","contentUrl":"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-hero.jpg","width":1040,"height":585,"caption":"Transforming search administration at Microsoft is helping the company improve how it reviews new sites, performs search health checks, and monitors search-related connections."},{"@type":"BreadcrumbList","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/generating-great-results-administering-search-at-microsoft\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.microsoft.com\/insidetrack\/blog\/"},{"@type":"ListItem","position":2,"name":"Generating great results: Administering search at Microsoft"}]},{"@type":"WebSite","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/#website","url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/","name":"Inside Track Blog","description":"How Microsoft does IT","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.microsoft.com\/insidetrack\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/#\/schema\/person\/d87d5d73eed76dd055086299c842c17e","name":"Inside Track staff","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/insidetrack\/blog\/#\/schema\/person\/image\/fb338dea806293f999356f7d8a399348","url":"https:\/\/secure.gravatar.com\/avatar\/3788032f4762be09ee17b2ec39f3d75b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/3788032f4762be09ee17b2ec39f3d75b?s=96&d=mm&r=g","caption":"Inside Track staff"},"description":"Questions? Send us a note: msitstaff@microsoft.com","url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/author\/insidetrack\/"}]}},"jetpack_featured_media_url":"https:\/\/www.microsoft.com\/insidetrack\/blog\/uploads\/prod\/2022\/11\/10282-hero.jpg","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9hcZA-2lF","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/posts\/9031"}],"collection":[{"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/users\/133"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/comments?post=9031"}],"version-history":[{"count":14,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/posts\/9031\/revisions"}],"predecessor-version":[{"id":13534,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/posts\/9031\/revisions\/13534"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/media\/9041"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/media?parent=9031"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/categories?post=9031"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/tags?post=9031"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.microsoft.com\/insidetrack\/blog\/wp-json\/wp\/v2\/coauthors?post=9031"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}