{"id":474486,"date":"2018-03-22T09:23:26","date_gmt":"2018-03-22T16:23:26","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=474486"},"modified":"2018-03-22T09:23:26","modified_gmt":"2018-03-22T16:23:26","slug":"microsoft-tsinghua-university-work-together-open-academic-data-research","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/microsoft-tsinghua-university-work-together-open-academic-data-research\/","title":{"rendered":"Microsoft and Tsinghua University Work Together on Open Academic Data Research"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-474564\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/OpenAcademicGraph_AI_BPHead_03_2018_1000x400.jpg\" alt=\"\" width=\"1000\" height=\"400\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/OpenAcademicGraph_AI_BPHead_03_2018_1000x400.jpg 1000w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/OpenAcademicGraph_AI_BPHead_03_2018_1000x400-300x120.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/OpenAcademicGraph_AI_BPHead_03_2018_1000x400-768x307.jpg 768w\" sizes=\"(max-width: 1000px) 100vw, 1000px\" \/><\/p>\n<p>In a recent collaboration, Microsoft and China\u2019s Tsinghua University released an academic graph, named <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.openacademic.ai\/oag\/\">Open Academic Graph<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (OAG). This billion-scale academic graph integrates the current <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/microsoft-academic-graph\/\">Microsoft Academic Graph<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (MAG) and Tsinghua&#8217;s <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/aminer.org\/\">AMiner<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> academic graph. Specifically, it contains the metadata information of 155 million academic paper metadata from AMiner and 166 million papers from MAG. By consolidating metadata information of each, it generates nearly 65 million matching relationships between the two academic graphs [1].<\/p>\n<div id=\"attachment_474846\" style=\"width: 1034px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-474846\" class=\"wp-image-474846 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture1_updated-1024x359.png\" alt=\"\" width=\"1024\" height=\"359\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture1_updated-1024x359.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture1_updated-300x105.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture1_updated-768x269.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture1_updated.png 1885w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><p id=\"caption-attachment-474846\" class=\"wp-caption-text\">Picture 1: Connections between Tsinghua University AMiner and Microsoft Academic Graph<\/p><\/div>\n<p>The construction of the billion-scale OAG is challenging, because of the heterogeneous distribution of academic data that exists in the different academic graphs, challenges in terms of homonyms and synonyms, and the need for accuracy in data matching. Some examples:<\/p>\n<ul>\n<li>Heterogeneous data. Because the data is distributed in different data sources, it faces a heterogeneous data problem. For example, paper authors may publish in different formats, such as Quoc le and Le, Quoc; or a journal or conference uses either a full name or an abbreviation.<\/li>\n<li>Disambiguation problem with the same name. The same name can represent multiple entities. For example, in China, one common name might be used by more than 200,000 people. Similarly, one topic, such as \u201cdata,\u201d may correspond to multiple articles.<\/li>\n<\/ul>\n<p>In addition, to achieve the billion-level of data integration, efficient computing is key. In the case of AMiner, there are 155 million published papers, while MAG has public data of 160 million papers. Calculating the algorithmic complexity of two map-matching relationships is generally O (N2), which requires a lot of computation. We designed a compromise approach that uses a hashing algorithm to improve efficiency. This approach completed matches for approximately 300 million papers automatically, while still ensuring high matching accuracy.<\/p>\n<p>OAG is an important project of <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.openacademic.ai\/\">Open Academic Society<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (OAS), which is a consortium of 20 global institutions\u2014including Microsoft, Tsinghua, the Allen Institute for Artificial Intelligence, the University of Arizona, the University of Washington, the University of California, Los Angeles, and the Australian National University\u2014to promote the open sharing of academic data and strengthen academic exchanges and cooperation. The OAG aims to integrate the global atlas of academic knowledge, publicly share academic atlas data, and provide relevant academic search and mining services. Specifically, OAS activities include:<\/p>\n<ul>\n<li>The integration of rich academic knowledge data. At present, the core data of OAG is from MAG and AMiner. The next step will be to integrate additional academic data, including the semantic data of different types of entities such as authors and papers. Data integration and data mining algorithms will link more entities to more accurate and richer data, including metadata, concept networks, research field, full text and author biographical information.<\/li>\n<li>Data sharing. By sharing different academic knowledge maps and their links, we hope to benefit academic research in the fields of knowledge atlases, scholar cooperative relationships, and academic topic mining.<\/li>\n<li>Service sharing. We want to design more intelligent academic atlas connectivity systems and provide relevant services (such as APIs) to encourage more people to use the services and join open academic communities.<\/li>\n<\/ul>\n<p>In another collaboration, this time between Microsoft Academic, Tsinghua and the Documentation and Information Center of the Chinese Academy of Sciences, more than 1000 students in 400 teams participated in the \u201cOpen Academic Precision Portrait Competition.\u201d Students from Peking University, University of Science and Technology of China, and Harbin Institute of Technology took home the top prizes.<\/p>\n<div id=\"attachment_474495\" style=\"width: 984px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-474495\" class=\"wp-image-474495 size-full\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture2.png\" alt=\"\" width=\"974\" height=\"241\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture2.png 974w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture2-300x74.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture2-768x190.png 768w\" sizes=\"(max-width: 974px) 100vw, 974px\" \/><p id=\"caption-attachment-474495\" class=\"wp-caption-text\">Picture 2: Poster and Awarding Ceremony of \u201cOpen Academic Precision Portrait Competition\u201d<\/p><\/div>\n<p><span style=\"display: inline !important; float: none; background-color: transparent; color: #333333; cursor: text; font-family: Georgia,'Times New Roman','Bitstream Charter',Times,serif; font-size: 16px; font-style: normal; font-variant: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: left; text-decoration: none; text-indent: 0px; text-transform: none; -webkit-text-stroke-width: 0px; white-space: normal; word-spacing: 0px;\">\u00a0One last collaboration of note is a contract between Professor Jie Tang, (of Tsinghua University and the founder of AMiner) and Microsoft, where AMiner [2] will be deployed on Azure. This, together with OAG, will further enlarge the impact of Azure on academic research.<\/span><\/p>\n<div id=\"attachment_474504\" style=\"width: 1034px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-474504\" class=\"wp-image-474504 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture3-1024x676.png\" alt=\"\" width=\"1024\" height=\"676\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture3-1024x676.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture3-300x198.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture3-768x507.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/Picture3.png 1408w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><p id=\"caption-attachment-474504\" class=\"wp-caption-text\">Picture 3: Global coverage of AMiner<\/p><\/div>\n<p>The future of the collaboration between Microsoft and Tsinghua will include integrating different types of entities (such as authors and conferences) in a large-scale heterogeneous academic atlas, publishing more academic atlas connectivity data, and designing more intelligent academic atlas connectivity systems.<\/p>\n<p><strong>Reference:<\/strong><br \/>\n[1] Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec Jiezhong Qiu, Yuxiao Dong, Hao Ma, Jian Li, Kuansan Wang, Jie Tang WSDM 2018, February 5\u20139, 2018, Marina Del Rey, CA, USA ACM February 5, 2018 (https:\/\/dl.acm.org\/citation.cfm?doid=3159652.3159706)<\/p>\n<p>[2] Jie Tang, Jing Zhang, Limin Yao, Juanzi Li, Li Zhang, and Zhong Su. ArnetMiner: Extraction and Mining of Academic Social Networks. In Proceedings of the Fourteenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD&#8217;2008). pp.990-998.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In a recent collaboration, Microsoft and China\u2019s Tsinghua University released an academic graph, named Open Academic Graph (OAG). This billion-scale academic graph integrates the current Microsoft Academic Graph (MAG) and Tsinghua&#8217;s AMiner academic graph. Specifically, it contains the metadata information of 155 million academic paper metadata from AMiner and 166 million papers from MAG. By [&hellip;]<\/p>\n","protected":false},"author":37074,"featured_media":474561,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"categories":[194453,194474,194475],"tags":[],"research-area":[13563],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-474486","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-science","category-data-visulalization","category-database-data-analytics-platforms","msr-research-area-data-platform-analytics","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[199561,199565],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[363722],"related-groups":[],"related-projects":[170262],"related-events":[],"related-researchers":[],"msr_type":"Post","featured_image_thumbnail":"<img width=\"480\" height=\"280\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/OpenAcademicGraph_AI_Carosel_03_2018_480x280.jpg\" class=\"img-object-cover\" alt=\"\" decoding=\"async\" loading=\"lazy\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/OpenAcademicGraph_AI_Carosel_03_2018_480x280.jpg 480w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/03\/OpenAcademicGraph_AI_Carosel_03_2018_480x280-300x175.jpg 300w\" sizes=\"(max-width: 480px) 100vw, 480px\" \/>","byline":"","formattedDate":"March 22, 2018","formattedExcerpt":"In a recent collaboration, Microsoft and China\u2019s Tsinghua University released an academic graph, named Open Academic Graph (OAG). This billion-scale academic graph integrates the current Microsoft Academic Graph (MAG) and Tsinghua&#039;s AMiner academic graph. Specifically, it contains the metadata information of 155 million academic paper&hellip;","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/474486"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/37074"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=474486"}],"version-history":[{"count":5,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/474486\/revisions"}],"predecessor-version":[{"id":475689,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/474486\/revisions\/475689"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/474561"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=474486"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=474486"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=474486"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=474486"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=474486"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=474486"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=474486"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=474486"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=474486"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=474486"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=474486"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}