{"id":642132,"date":"2020-03-10T11:07:55","date_gmt":"2020-03-10T18:07:55","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-blog-post&#038;p=642132"},"modified":"2020-03-10T11:13:10","modified_gmt":"2020-03-10T18:13:10","slug":"impact-of-covid-19-on-computer-science-research-community","status":"publish","type":"msr-blog-post","link":"https:\/\/www.microsoft.com\/en-us\/research\/articles\/impact-of-covid-19-on-computer-science-research-community\/","title":{"rendered":"Impact of COVID-19 on the Computer Science Research Community"},"content":{"rendered":"<p>By March 10<sup>th<\/sup>, 2020 the novel coronavirus (COVID-19) has infected ~117k and been responsible for the deaths of over 4k people worldwide. The World Health Organization (WHO) has not yet classified the COVID-19 outbreak as a pandemic, however, COVID-19 has resulted in a significant impact on individual lives and global economics. Following the Microsoft Academic team&#8217;s goal to \u201chelp researchers stay on top of their game\u201d, we are providing an analysis of the COVID-19 impact on the computer science (CS) research community to help enable conference organizers and institutions to respond accordingly and manage the impact.<\/p>\n<p>Our analysis shows that:<\/p>\n<ul>\n<li>There is increasing author participation in both CS and AI conferences from the COVID-19 impacted regions in the past ten years, from about 6% to over 20% in 2019.<\/li>\n<li>The disease could impact one-fifth of conference attendees in both AI and CS (21.3%).<\/li>\n<li>May to early September is the period most CS conferences occur, controlling COVID-19 by May will help to reduce the impact in CS research to a minimum.<\/li>\n<\/ul>\n<h2>Background<\/h2>\n<ul>\n<li>As of this article date, the US Center for Disease Control and Prevention (CDC) has issued a <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.cdc.gov\/coronavirus\/2019-ncov\/travelers\/index.html\">travel warning and alert<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> recommending travelers avoid or postpone nonessential travel to areas including: China, South Korea, Iran, Italy and Japan. A handful of airlines have reduced or suspended flights to these areas. Also, some cities have imposed lockdowns to contain the virus.<\/li>\n<li>On the other hand, CS conference publications rely heavily on authors\u2019 physical presentations during the conference. Since the travel interruption could potentially prevent researchers from attending conferences and thus affecting the publications, this analysis considers the areas above as COVID-19 impacted.<\/li>\n<li>In computer science, conference publication is often preferred over other publications for its higher visibility, greater impact, and faster turnaround time. The COVID-19 impact is most likely to affect the CS research community through conference publications, hence our focus.<\/li>\n<\/ul>\n<h2>Method<\/h2>\n<ul>\n<li>We have picked the 105 most impactful CS conferences for this analysis. Among these 105 CS conferences, 32 are related to artificial intelligence (AI) and used to analyze the COVID-19 impact on AI research<\/li>\n<li>Two scenarios are evaluated for impact:\n<ul>\n<li>2020 conferences being hosting in the impacted areas<\/li>\n<li>Authors located in the impacted area. Headquarter locations for each authors\u2019 last known affiliation are used to determine their location<\/li>\n<\/ul>\n<\/li>\n<li>Two indicators are used to estimate the impact:\n<ul>\n<li>The number of publications for each CS conferences in 2019 (2018 if it\u2019s biennial)<\/li>\n<li>The share of publications from COVID-19 affected areas for the past 10 years<\/li>\n<\/ul>\n<\/li>\n<li>A publication is considered from the COVID-19 affected areas if the headquarter of the first author\u2019s affiliation is located in those areas. Please find the discussion of this approach in section \u201cHow to Determine a Publication is Impacted by COVID-19\u201d below<\/li>\n<li>All publication data is sourced from the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/microsoft-academic-graph\/\">Microsoft Academic Graph<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n<h2>Analysis and Discussion<\/h2>\n<h3>1. CS and AI Conference Publication Statistics<\/h3>\n<p>The graph below (Figure 1a) shows the total number of CS and AI conference publications in 2019. Only the top 20 regions are shown here. The US followed by the EU, China, Japan and Canada had the highest volume of published papers among the 105 selected CS conferences as well as in the 32 AI conferences.<\/p>\n<h3><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-642156\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-01.png\" alt=\"\" width=\"1075\" height=\"986\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-01.png 1075w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-01-300x275.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-01-1024x939.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-01-768x704.png 768w\" sizes=\"(max-width: 1075px) 100vw, 1075px\" \/><\/h3>\n<p>The table below shows the number of 2019 publications and percentages for the CDC warning\/alert areas. Regions are categorized according to the US CDC travel risk assessment, please refer to the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.cdc.gov\/coronavirus\/2019-ncov\/travelers\/index.html\">CDC<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> for the description of each level. \u00a0China, Iran, South Korea, Italy, Japan and Hong Kong together contributed 21.25% and 21.33% to CS and AI publications in 2019. This could be the rate of authors who couldn\u2019t attend the conferences in 2020 due to the travel interruption by COVID-19 in these areas.<\/p>\n<h3><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-642135\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-02.png\" alt=\"\" width=\"1396\" height=\"119\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-02.png 1396w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-02-300x26.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-02-1024x87.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-02-768x65.png 768w\" sizes=\"(max-width: 1396px) 100vw, 1396px\" \/><\/h3>\n<p>To further confirm the rate of publications from impacted areas, we gathered data between 2000 and 2019. As shown in Figure 1b, there is clearly an increase in publications from the COVID-19 impacted areas. The impacted publication rate for both CS and AI conferences are above 21% in 2019 and possibly higher in 2020.<\/p>\n<h3><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-642138\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-03.png\" alt=\"\" width=\"1412\" height=\"664\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-03.png 1412w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-03-300x141.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-03-1024x482.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-03-768x361.png 768w\" sizes=\"(max-width: 1412px) 100vw, 1412px\" \/><\/h3>\n<h3>2. 2020 CS Conference Publications Impact \u2013 by Conference Location<\/h3>\n<p>The graph below (Figure 2) shows the estimated impact on 2020 CS conferences hosting in COVID-19 impacted areas. The number of publications from 2019 is used to estimate the number of publications in 2020. The solid blue line shows the accumulated number of impacted publications over time.<\/p>\n<h3><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-642141\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-04.png\" alt=\"\" width=\"1550\" height=\"621\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-04.png 1550w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-04-300x120.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-04-1024x410.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-04-768x308.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-04-1536x615.png 1536w\" sizes=\"(max-width: 1550px) 100vw, 1550px\" \/><\/h3>\n<h3>3. 2020 CS and AI Conference Publications Impact \u2013 by Author Location<\/h3>\n<p>The graph below (Figure 3) shows 2020 CS and AI conferences which are hosting outside COVID-19 impacted areas. The numbers of publications for each impacted conference are estimated by the number of publications in 2019 (2018 if it\u2019s biennial) from COVID-19 impacted areas. According to our analysis, among the CS conferences scheduled in the coming four months, ICC, IMTC, ICDE and ISCAS have the most publications contributed from the COVID-19 impacted areas (each above 30%). We listed the conferences in the next four months with the 2019 publication statistics in Appendix 1 at the end. \u00a0A majority of the AI conferences for the next four months have 10% to 20% impact rate based on 2019 data (Appendix 2).<\/p>\n<h3>\u00a0 \u00a0<img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-642144\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-05.png\" alt=\"\" width=\"1107\" height=\"543\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-05.png 1107w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-05-300x147.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-05-1024x502.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-05-768x377.png 768w\" sizes=\"(max-width: 1107px) 100vw, 1107px\" \/><\/h3>\n<h3>4. 2020 CS and AI Conference Publications Impact \u2013 Total<\/h3>\n<p>The graph below (Figure 4) shows the COVID-19 impact estimates in CS and AI conferences combining the impact from both conference location and author location. The impact has a similar pattern in CS and AI conferences. Starting from May 2019, the impact increases considerably as many conferences occur during the summer months (northern meteorological). If COVID-19 can be contained and the travel interruption is lifted before May 2020, the impact on CS conferences should be minimal. On the contrary, if the outbreak situation cannot be improved by September, there could be significant impact to the CS research community.<\/p>\n<h3><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-642147\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-06.png\" alt=\"\" width=\"1243\" height=\"640\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-06.png 1243w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-06-300x154.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-06-1024x527.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-06-768x395.png 768w\" sizes=\"(max-width: 1243px) 100vw, 1243px\" \/><\/h3>\n<h3>5. How to Determine if a Publication is Impacted by COVID-19<\/h3>\n<p>As mentioned earlier, we consider a publication to be impacted by COVID-19 if the headquarters of the first author\u2019s affiliation is in one of the affected areas.<\/p>\n<p>We choose the first author\u2019s affiliation location instead of all authors because 1) first author normally is the presenter of the paper and 2) it simplifies our analysis while not significantly impacting the result. <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/paper\/2610002097\/reference\/search?q=A%20Century%20of%20Science%3A%20Globalization%20of%20Scientific%20Collaborations%2C%20Citations%2C%20and%20Innovations&qe=Or(Id%253D2128438887%252CId%253D2125315567%252CId%253D1965631677%252CId%253D2022322548%252CId%253D2124689612%252CId%253D2168190036%252CId%253D2151866568%252CId%253D1932742904%252CId%253D2066752129%252CId%253D1968900087%252CId%253D2096523843%252CId%253D1975563293%252CId%253D2127201730%252CId%253D2037997493%252CId%253D2032884174%252CId%253D2192866431%252CId%253D2150607630%252CId%253D2037859435%252CId%253D2026950120%252CId%253D2237216255%252CId%253D2085563128%252CId%253D1981551213%252CId%253D2161219828%252CId%253D1979423019%252CId%253D2556576511%252CId%253D628012024%252CId%253D2271477464%252CId%253D2291666778%252CId%253D2264728004%252CId%253D2069656088)&f=&orderBy=0\">A previous paper<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> pointed out there are 25-fold increases in international collaborations for scientific development. For the CS publications we analyzed, the cross-region collaboration increases from 7.8% to 23.9% in the past 20 years. Although the cross-region rate is high, only 4% of publications have authors from non-impacted regions while first author is located in impacted regions. Therefore, we believe the first author\u2019s location is a good representation of the publication\u2019s locations.<\/p>\n<p>In the case that the first author is associated with multiple affiliations and one affiliation is in affected areas, we count the publication as affected. Only 0.17% of CS publications have first authors associated with multiple affiliations.<\/p>\n<p>Some affiliations could have multiple locations, such as Microsoft. The headquarter location is used in this scenario. And we estimate there are less than 2% such cases.<\/p>\n<h2>Conclusion<\/h2>\n<p>All the above estimates are based on the the most current information we could obtain using MAG. If the current situation continues, the data shows the potential for significant impact on CS conferences unless conference organizers take actions to mitigate the impact.<\/p>\n<p>Some conference organizers have already taken actions, such as:<\/p>\n<ul>\n<li><span style=\"text-decoration: underline\"><strong>Postpone and change location<\/strong><\/span>. INFOCOM 2020, which was originally planned to be in Beijing China in late April, is moving to Toronto Canada in July.<\/li>\n<\/ul>\n<ul>\n<li><span style=\"text-decoration: underline\"><strong>Create backup plans<\/strong><\/span>. The ACM SIGIR Executive Committee is preparing a backup plan for SIGIR 2020 for potential worst case scenarios, e.g. moving from Xi\u2019an China to Toronto Canada if the WHO extend the \u201cPublic Health Emergency of International Concern\u201d by the end of April.<\/li>\n<\/ul>\n<ul>\n<li><span style=\"text-decoration: underline\"><strong>Extend deadlines<\/strong><\/span>. The Web Conference 2020 is extending the early bird deadline by four weeks to give attendees more flexibility to plan their trip.<\/li>\n<\/ul>\n<ul>\n<li><span style=\"text-decoration: underline\"><strong>Enable remote and video presentations<\/strong><\/span>. AAAI 2020 enabled authors to present remotely using teleconferencing or by submitting a video presentation.<\/li>\n<\/ul>\n<h2>Additional CS Conference Updates regarding COVID-19<\/h2>\n<p>In an effort to help the CS community we will continue to monitor CS conference announcements regarding COVID-19 and provide updates below:<\/p>\n<ul>\n<li>2020-03-10: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/iclr.cc\/Conferences\/2020\">ICLR 2020<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> is working through potential methods to hold a remote conference this year.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p>Stay healthy and research on!<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<h2>Appendix 1<\/h2>\n<p>2020 March to June, Non-AI CS Conferences.<\/p>\n<h3><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-642150\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-07.png\" alt=\"\" width=\"1259\" height=\"726\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-07.png 1259w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-07-300x173.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-07-1024x590.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-07-768x443.png 768w\" sizes=\"(max-width: 1259px) 100vw, 1259px\" \/><\/h3>\n<h2>Appendix 2<\/h2>\n<p>2020 March to June, AI Conferences.<\/p>\n<h3><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-642153\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-08.png\" alt=\"\" width=\"1314\" height=\"263\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-08.png 1314w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-08-300x60.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-08-1024x205.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2020\/03\/COVID-19-Impact-08-768x154.png 768w\" sizes=\"(max-width: 1314px) 100vw, 1314px\" \/><\/h3>\n","protected":false},"excerpt":{"rendered":"<p>Following the Microsoft Academic team&#8217;s goal to \u201chelp researchers stay on top of their game\u201d, we are providing an analysis of the COVID-19 impact on the computer science (CS) research community to help enable conference organizers and institutions to respond accordingly and manage the impact.<\/p>\n","protected":false},"author":36554,"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-content-parent":170262,"footnotes":""},"research-area":[],"msr-locale":[268875],"msr-post-option":[],"class_list":["post-642132","msr-blog-post","type-msr-blog-post","status-publish","hentry","msr-locale-en_us"],"msr_assoc_parent":{"id":170262,"type":"project"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/642132"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-blog-post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/36554"}],"version-history":[{"count":4,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/642132\/revisions"}],"predecessor-version":[{"id":642186,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/642132\/revisions\/642186"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=642132"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=642132"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=642132"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=642132"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}