{"id":6976,"date":"2008-10-25T21:57:00","date_gmt":"2008-10-26T05:57:00","guid":{"rendered":"https:\/\/blogs.msdn.microsoft.com\/translation\/2008\/10\/25\/politically-incorrect-machines\/"},"modified":"2008-10-25T21:57:00","modified_gmt":"2008-10-26T05:57:00","slug":"politically-incorrect-machines","status":"publish","type":"post","link":"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/","title":{"rendered":"Politically Incorrect Machines"},"content":{"rendered":"

While we at the Machine Translation team have been seeing increasing traffic to our various offerings over the past few months, we noticed a sudden bump in traffic yesterday. Having grown up on Agatha Christie and Sherlock Holmes, such mysteries are irresistible for me \u2013 and a number of other folks on the team were just as curious to find out what caused this sudden bump. We figured that the IE8 Activity<\/a>\/Accelerator<\/a>, the Messenger Bot<\/a>, Search translations<\/a>, Office translations<\/a> were all showing the same upward trend as the days before and thus were not the specific reason for this bump.<\/p>\n

Eventually, we were able to identify one potential reason why we were seeing this spike. Our user community found an oddity in how the machine translation engine processed the translation for several names from English to German. It was to be expected that when the engine translates the name of the candidate of one party to someone from the other party, given the current political atmosphere in the run up to US elections, that it would end up as news. While we certainly welcome all the new users that came by to check this phenomenon out \u2013 we wanted to share with our users the reason why such things seem to happen from time to time with statistically trained machine translation systems from us and others.<\/p>\n

A Statistical Machine Translation engine is trained on lots and lots of parallel data, that is, data that exists in both a source language (e.g., English) and a target language (e.g., German), where the source and target are translations of one another. Our engine is trained on millions of sentences for each language pair we support. In order to train on a particular corpus of data\u2014maybe a large number of newswire articles in English which have been translated into German\u2014we first have to break that corpus down into sentences. After the corpus is sentence broken, we feed the resulting sentences into a sentence aligner, the sole purpose of which is to find what sentences on the source side align with sentences on the target side. This is no trivial task, since a sentence on one side could conceivably align with one or more sentences on the target (or possibly none at all!). The aligner will sometimes make mistakes, and misalign one sentence with another that is in fact not a translation. This can lead to some mistranslations, especially if there are words in the source and target that are infrequently occurring. Since our translation engine is statistical, it is highly reliant on co-occurrence frequencies between words in the source and target data. If certain words are infrequently occurring\u2014people\u2019s names, for instance, may only occur a few times across a corpus of millions of sentences\u2014the lack of frequency can lead to mistranslations resulting from incorrect \u201cguesses\u201d between source and target (i.e., low probabilities assigned to particular source and target words). This can lead to some comical gaffes in our translation system.<\/p>\n

So, that is how the \u201cmachine\u201d decided to translate in a way that ended up with the community attributing it to the sense of humor of our team. While we continue to work hard to ensure proper alignments, it is to be expected from a statistical system that is built on millions to billions of words that such a situation could repeat. <\/p>\n

The current issue with alignment should now be resolved but we urge our community of users to keep helping us identify any such situations by contacting us through this blog.<\/p>\n

-Vikram<\/p>\n

Vikram Dendi leads Business Strategy & Product Planning for the Microsoft Translator team<\/h6>\n","protected":false},"excerpt":{"rendered":"

While we at the Machine Translation team have been seeing increasing traffic to our various offerings over the past few months, we noticed a sudden bump in traffic yesterday. Having grown up on Agatha Christie and Sherlock Holmes, such mysteries are irresistible for me \u2013 and a number of other folks on the team were just as curious to find….<\/span><\/p>\n

CONTINUE READING \"Politically Incorrect Machines\"<\/span><\/a><\/p>","protected":false},"author":54,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[5],"tags":[17,19],"acf":[],"yoast_head":"Politically Incorrect Machines - Microsoft Translator Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Politically Incorrect Machines - Microsoft Translator Blog\" \/>\n<meta property=\"og:description\" content=\"While we at the Machine Translation team have been seeing increasing traffic to our various offerings over the past few months, we noticed a sudden bump in traffic yesterday. Having grown up on Agatha Christie and Sherlock Holmes, such mysteries are irresistible for me \u2013 and a number of other folks on the team were just as curious to find....\" \/>\n<meta property=\"og:url\" content=\"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft Translator Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/microsofttranslator\" \/>\n<meta property=\"article:published_time\" content=\"2008-10-26T05:57:00+00:00\" \/>\n<meta name=\"author\" content=\"Microsoft Translator\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@mstranslator\" \/>\n<meta name=\"twitter:site\" content=\"@mstranslator\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Microsoft Translator\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/#article\",\"isPartOf\":{\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/\"},\"author\":{\"name\":\"Microsoft Translator\",\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/#\/schema\/person\/0a163e1bf796b3bb651085032849cf37\"},\"headline\":\"Politically Incorrect Machines\",\"datePublished\":\"2008-10-26T05:57:00+00:00\",\"dateModified\":\"2008-10-26T05:57:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/\"},\"wordCount\":612,\"publisher\":{\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/#organization\"},\"keywords\":[\"Live Translator\",\"Research\"],\"articleSection\":[\"Developers\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/\",\"url\":\"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/\",\"name\":\"Politically Incorrect Machines - Microsoft Translator Blog\",\"isPartOf\":{\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/#website\"},\"datePublished\":\"2008-10-26T05:57:00+00:00\",\"dateModified\":\"2008-10-26T05:57:00+00:00\",\"breadcrumb\":{\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https://www.microsoft.com\/en-us\/translator/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Politically Incorrect Machines\"}]},{\"@type\":\"WebSite\",\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/#website\",\"url\":\"https://www.microsoft.com\/en-us\/translator/blog\/\",\"name\":\"Microsoft Translator Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https://www.microsoft.com\/en-us\/translator/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/#organization\",\"name\":\"Microsoft Corporation\",\"url\":\"https://www.microsoft.com\/en-us\/translator/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/#\/schema\/logo\/image\/\",\"url\":\"https://www.microsoft.com\/en-us\/translator/blog\/wp-content\/uploads\/sites\/13\/2021\/05\/microsoft_logo_element-300x300-1.png\",\"contentUrl\":\"https://www.microsoft.com\/en-us\/translator/blog\/wp-content\/uploads\/sites\/13\/2021\/05\/microsoft_logo_element-300x300-1.png\",\"width\":300,\"height\":300,\"caption\":\"Microsoft Corporation\"},\"image\":{\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.youtube.com\/playlist?list=PLD7HFcN7LXRd4kd2XgZjIbQ8TwTC32Zc9\",\"https:\/\/www.facebook.com\/microsofttranslator\",\"https:\/\/twitter.com\/mstranslator\"]},{\"@type\":\"Person\",\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/#\/schema\/person\/0a163e1bf796b3bb651085032849cf37\",\"name\":\"Microsoft Translator\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https://www.microsoft.com\/en-us\/translator/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/978e1fd70e1a6177e5cb285daa5ad026?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/978e1fd70e1a6177e5cb285daa5ad026?s=96&d=mm&r=g\",\"caption\":\"Microsoft Translator\"},\"url\":\"https://www.microsoft.com\/en-us\/translator/blog\/author\/mtteam\/\"}]}<\/script>","yoast_head_json":{"title":"Politically Incorrect Machines - Microsoft Translator Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/","og_locale":"en_US","og_type":"article","og_title":"Politically Incorrect Machines - Microsoft Translator Blog","og_description":"While we at the Machine Translation team have been seeing increasing traffic to our various offerings over the past few months, we noticed a sudden bump in traffic yesterday. Having grown up on Agatha Christie and Sherlock Holmes, such mysteries are irresistible for me \u2013 and a number of other folks on the team were just as curious to find....","og_url":"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/","og_site_name":"Microsoft Translator Blog","article_publisher":"https:\/\/www.facebook.com\/microsofttranslator","article_published_time":"2008-10-26T05:57:00+00:00","author":"Microsoft Translator","twitter_card":"summary_large_image","twitter_creator":"@mstranslator","twitter_site":"@mstranslator","twitter_misc":{"Written by":"Microsoft Translator","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/#article","isPartOf":{"@id":"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/"},"author":{"name":"Microsoft Translator","@id":"https://www.microsoft.com\/en-us\/translator/blog\/#\/schema\/person\/0a163e1bf796b3bb651085032849cf37"},"headline":"Politically Incorrect Machines","datePublished":"2008-10-26T05:57:00+00:00","dateModified":"2008-10-26T05:57:00+00:00","mainEntityOfPage":{"@id":"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/"},"wordCount":612,"publisher":{"@id":"https://www.microsoft.com\/en-us\/translator/blog\/#organization"},"keywords":["Live Translator","Research"],"articleSection":["Developers"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/","url":"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/","name":"Politically Incorrect Machines - Microsoft Translator Blog","isPartOf":{"@id":"https://www.microsoft.com\/en-us\/translator/blog\/#website"},"datePublished":"2008-10-26T05:57:00+00:00","dateModified":"2008-10-26T05:57:00+00:00","breadcrumb":{"@id":"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/"]}]},{"@type":"BreadcrumbList","@id":"https://www.microsoft.com\/en-us\/translator/blog\/2008\/10\/25\/politically-incorrect-machines\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://www.microsoft.com\/en-us\/translator/blog\/"},{"@type":"ListItem","position":2,"name":"Politically Incorrect Machines"}]},{"@type":"WebSite","@id":"https://www.microsoft.com\/en-us\/translator/blog\/#website","url":"https://www.microsoft.com\/en-us\/translator/blog\/","name":"Microsoft Translator Blog","description":"","publisher":{"@id":"https://www.microsoft.com\/en-us\/translator/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://www.microsoft.com\/en-us\/translator/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https://www.microsoft.com\/en-us\/translator/blog\/#organization","name":"Microsoft Corporation","url":"https://www.microsoft.com\/en-us\/translator/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https://www.microsoft.com\/en-us\/translator/blog\/#\/schema\/logo\/image\/","url":"https://www.microsoft.com\/en-us\/translator/blog\/wp-content\/uploads\/sites\/13\/2021\/05\/microsoft_logo_element-300x300-1.png","contentUrl":"https://www.microsoft.com\/en-us\/translator/blog\/wp-content\/uploads\/sites\/13\/2021\/05\/microsoft_logo_element-300x300-1.png","width":300,"height":300,"caption":"Microsoft Corporation"},"image":{"@id":"https://www.microsoft.com\/en-us\/translator/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.youtube.com\/playlist?list=PLD7HFcN7LXRd4kd2XgZjIbQ8TwTC32Zc9","https:\/\/www.facebook.com\/microsofttranslator","https:\/\/twitter.com\/mstranslator"]},{"@type":"Person","@id":"https://www.microsoft.com\/en-us\/translator/blog\/#\/schema\/person\/0a163e1bf796b3bb651085032849cf37","name":"Microsoft Translator","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https://www.microsoft.com\/en-us\/translator/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/978e1fd70e1a6177e5cb285daa5ad026?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/978e1fd70e1a6177e5cb285daa5ad026?s=96&d=mm&r=g","caption":"Microsoft Translator"},"url":"https://www.microsoft.com\/en-us\/translator/blog\/author\/mtteam\/"}]}},"_links":{"self":[{"href":"https://www.microsoft.com\/en-us\/translator/blog\/wp-json\/wp\/v2\/posts\/6976"}],"collection":[{"href":"https://www.microsoft.com\/en-us\/translator/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https://www.microsoft.com\/en-us\/translator/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https://www.microsoft.com\/en-us\/translator/blog\/wp-json\/wp\/v2\/users\/54"}],"replies":[{"embeddable":true,"href":"https://www.microsoft.com\/en-us\/translator/blog\/wp-json\/wp\/v2\/comments?post=6976"}],"version-history":[{"count":0,"href":"https://www.microsoft.com\/en-us\/translator/blog\/wp-json\/wp\/v2\/posts\/6976\/revisions"}],"wp:attachment":[{"href":"https://www.microsoft.com\/en-us\/translator/blog\/wp-json\/wp\/v2\/media?parent=6976"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https://www.microsoft.com\/en-us\/translator/blog\/wp-json\/wp\/v2\/categories?post=6976"},{"taxonomy":"post_tag","embeddable":true,"href":"https://www.microsoft.com\/en-us\/translator/blog\/wp-json\/wp\/v2\/tags?post=6976"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}