{"id":714646,"date":"2020-12-30T02:54:35","date_gmt":"2020-12-30T10:54:35","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=714646"},"modified":"2021-10-13T21:15:01","modified_gmt":"2021-10-14T04:15:01","slug":"vert-versatile-entity-recognition-disambiguation-toolkit","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/vert-versatile-entity-recognition-disambiguation-toolkit\/","title":{"rendered":"VERT: Versatile Entity Recognition & Disambiguation Toolkit"},"content":{"rendered":"<p>While knowledge about entities is a key building block in the mentioned systems, creating effective\/efficient models for real-world scenarios remains a challenge (tech\/data\/real workloads).<\/p>\n<p>Based on such needs, we&#8217;ve created <strong>VERT<\/strong> &#8211; a <strong>V<\/strong>ersatile <strong>E<\/strong>ntity <strong>R<\/strong>ecognition & Disambiguation <strong>T<\/strong>oolkit. <strong>VERT<\/strong> is a pragmatic toolkit that combines rules and ML, offering both powerful pretrained models for core entity types (recognition and linking) and the easy creation of custom models. Custom models use our deep learning-based NER\/EL models that minimizes the needs for handcrafted features to quickly create deployeable models with state-of-the-art quality and performance, as well as facilitate refining pre-trained models.<\/p>\n<p><strong>VERT<\/strong> emphasizes requirements from real world use cases and it&#8217;s composed of 4 main modules:<\/p>\n<ul>\n<li>Prebuilt models to recognize common <em>base types<\/em> (date\/number\/units\/phone-number). These support extraction, normalization, and resolution of such entities; in a form easy to use by developers (tagged entity, semantic expression, resolution).<br \/>\nThis module is publicly available as a deterministic rule-based system designed for extensibility (<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/microsoft\/Recognizers-Text\"><strong>Recognizers-Text<\/strong><span class=\"sr-only\"> (opens in new tab)<\/span><\/a>) supporting multiple languages. Moreover, vNext is on the way.<\/li>\n<li><strong>LoReO<\/strong>, a logical-operations layer to help handle entity lists\/ranges\/alternatives, where entity tagging is not enough and basic relationship parsing is necessary for consumers. Comparative and Superlative Adjectives, or Adjective Phrases like &#8220;not so expensive&#8221;.<\/li>\n<li><strong>NERPlus<\/strong>, a pipeline for NER. <strong>VERT<\/strong> offers deep learning models with two model structures depending on perf requirements.<br \/>\nThis module includes pre-trained models for typical entity types and available in 5 languages, as well as tools to train or refine new models.<\/li>\n<li>Entity linking to knowledge bases (called <strong>ELIS<\/strong>), which both helps bring additional &#8220;types&#8221;, as well as additional information that can be used by systems in downstream tasks. VERT includes pre-trained entity linking against Wikipedia in English and Spanish and easy data refresh as knowledge bases are always being updated.<\/li>\n<\/ul>\n<p><strong>VERT<\/strong> research also target cross-lingual scenarios and its modules are under continuous research and release across different platforms.<br \/>\nYou can find related papers and their source code in the VERT repo on GitHub: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/microsoft\/vert-papers\/\"><strong>https:\/\/github.com\/microsoft\/vert-papers\/<\/strong><span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>While knowledge about entities is a key building block in the mentioned systems, creating effective\/efficient models for real-world scenarios remains a challenge (tech\/data\/real workloads). Based on such needs, we&#8217;ve created VERT &#8211; a Versatile Entity Recognition & Disambiguation Toolkit. VERT is a pragmatic toolkit that combines rules and ML, offering both powerful pretrained models for [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"footnotes":""},"research-area":[13556,13545,13555],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-714646","msr-project","type-msr-project","status-publish","hentry","msr-research-area-artificial-intelligence","msr-research-area-human-language-technologies","msr-research-area-search-information-retrieval","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2012-07-01","related-publications":[944742,714379,716161,168543,1043472,714400,735946,294959,714409,735964,295007,714631,751540,331316,714655,763942,554907,714673,784855,614520,714679,784864,636348,714694,840871,654678,714718,854748,654684,714724,921747,713086,714772],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Chin-Yew Lin","user_id":31493,"people_section":"Section name 0","alias":"cyl"},{"type":"user_nicename","display_name":"Guoxin Wang","user_id":37089,"people_section":"Section name 0","alias":"guow"},{"type":"user_nicename","display_name":"Zhiwei Yu","user_id":39937,"people_section":"Section name 0","alias":"zhiwyu"}],"msr_research_lab":[199560],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/714646"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":6,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/714646\/revisions"}],"predecessor-version":[{"id":715345,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/714646\/revisions\/715345"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=714646"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=714646"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=714646"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=714646"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=714646"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}