{"id":346139,"date":"2017-03-14T06:55:13","date_gmt":"2017-03-14T13:55:13","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-academic-program&#038;p=346139"},"modified":"2022-03-16T10:51:46","modified_gmt":"2022-03-16T17:51:46","slug":"collaborative-ai-challenge","status":"publish","type":"msr-academic-program","link":"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/collaborative-ai-challenge\/","title":{"rendered":"The Malmo Collaborative AI Challenge"},"content":{"rendered":"\n\n<p><em><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/malmo-collaborative-ai-challenge-winners\/\" target=\"_blank\" rel=\"noopener noreferrer\">Presenting the winners of the Project Malmo Collaborative AI Challenge ><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/em><\/p>\n<p>A long-standing goal of researchers in <strong>Artificial\u00a0Intelligence (AI)<\/strong> is to develop technology that collaborates with humans to achieve their goals. But, research in <strong>Collaborative AI<\/strong> poses unique challenges:<\/p>\n<ul>\n<li>How can AI agents learn to recognize someone\u2019s intent (that is, what they are trying to achieve)?<\/li>\n<li>How can AI agents learn what behaviors are helpful when working toward a common goal?<\/li>\n<li>And, how can they coordinate or communicate with another agent to agree on a shared strategy for problem-solving?<\/li>\n<\/ul>\n<p>While these and other challenges in Collaborative AI remain unsolved, we believe that recent advances have created unique opportunities for finding answers to key questions.<\/p>\n<p>That&#8217;s the thinking behind the <strong>Malmo Collaborative AI Challenge<\/strong>, designed to\u00a0encourage research relating to various problems in Collaborative AI. The Challenge takes the form of a collaborative mini-game in which players need to work together to achieve a common goal. Challenge participants are invited to develop and train collaborative AI solutions that learn to achieve high scores across a range of partners.<\/p>\n<div class=\"video-wrapper margin-bottom-sp1\"><iframe loading=\"lazy\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube-nocookie.com\/embed\/iOWbeMvml3M?feature=oembed&rel=0\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/div>\n<p>Innovative AI solutions to the Challenge can lead to breakthroughs in Collaborative AI technology, and we&#8217;d like your help!<\/p>\n<h2>Are you interested\u00a0in developing innovative AI solutions? Read how it works!<\/h2>\n<p>The Malmo Collaborative AI Challenge uses\u00a0<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-malmo\/\" target=\"_blank\" rel=\"noopener noreferrer\">Project Malmo<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> [1], an artificial intelligence experimentation and research platform that is built on top of the popular <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/minecraft.net\/en-us\/\" target=\"_blank\" rel=\"noopener noreferrer\">Minecraft<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>\u00a0game. Project Malmo was created to inspire a new generation of research into problems presented by this unique environment.<\/p>\n<p>The Malmo Collaborative AI Challenge takes the form of a collaborative mini-game, based on an extension [2] of the game theoretic \u201c<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/en.wikipedia.org\/wiki\/Stag_hunt\" target=\"_blank\" rel=\"noopener noreferrer\">stag hunt<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.\u201d The stag hunt is a classic example modeling the trade-offs between choosing to collaborate and going solo. We have implemented this concept in the form of the Malmo Pig Chase. The task and sample code are freely available on GitHub.<\/p>\n<h2>And what&#8217;s in it for you?<\/h2>\n<p>Besides the joy of problem-solving, Microsoft is offering the following prizes:<\/p>\n<ul>\n<li><strong>Microsoft Research AI Summer School Placement Prize<\/strong><br \/>\nThree winning teams will be awarded placements at the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/event\/ai-summer-school-2017\/\" target=\"_blank\" rel=\"noopener noreferrer\">AI Summer School at Microsoft Research Cambridge, UK<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/li>\n<li><strong>Microsoft Azure for Research Grant Prize<\/strong><br \/>\nThree winning teams will be awarded <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/microsoft-azure-for-research\/\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Azure for Research<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> grants with a maximum value of $20,000 USD.<\/li>\n<\/ul>\n<p>During registration, Challenge participants can sign up for either or both prizes. Note that your participation is subject to Challenge Rules (see separate tab on this page).<\/p>\n<h2>Here&#8217;s how to participate!<\/h2>\n<ol>\n<li>Check the\u00a0Challenge\u00a0Rules\u00a0(see separate tab on this page). Note that the Challenge is targeted at participants\u00a0affiliated with a university or nonprofit research organization.<\/li>\n<li>Form a team (of up to\u00a0three participants), decide on a team lead, and create a GitHub repository for your submission. Note that you will need to provide a valid link to the GitHub repository at the time of registration. We recommend that you\u00a0start by creating a fork of <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/Microsoft\/malmo-challenge\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/github.com\/Microsoft\/malmo-challenge<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/li>\n<li>Decide on whether you want to use Microsoft Azure\u00a0for developing and training your agent.\u00a0If you do,\u00a0note that we\u00a0will make available, at no charge, Microsoft Azure\u00a0Passes (market value $1,500 USD) to the first 150 entries (subject to requirements outlined in the Challenge Rules). Please indicate this\u00a0during registration.<\/li>\n<li>Register your team <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.surveygizmo.com\/s3\/3299773\/The-Collaborative-AI-Challenge\" target=\"_blank\" rel=\"noopener noreferrer\">here<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. Please make sure that your team\u2019s registration form is complete before submitting. Once submitted to Microsoft via your registration form, accepting any changes to your GitHub repository and registration details will be at the sole discretion of Microsoft.<\/li>\n<li>Write code and train your agent, who will take the role of one of two players. You can update your submission on your GitHub repository\u00a0until the entry submission deadline.<\/li>\n<li>Before the entry submission deadline,\u00a0create a one-page summary of your GitHub submission that describes your approach, and create a one-to-three-minute\u00a0video that shows off your agent. Include the summary\u00a0and link to\u00a0the video\u00a0on your GitHub overview page.<\/li>\n<\/ol>\n<p>After the entry submission deadline, we will assess\u00a0all Challenge submissions. The best agent is the one who plays best with all other players. Check the winner selection section in the\u00a0Challenge Rules for further details. We will notify the finalist\u00a0on June 5, 2017.<\/p>\n<p><strong>Before you sign up, please make sure to study the\u00a0<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/collaborative-ai-challenge\/#!challenge-rules\">Challenge Rules<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>\u00a0carefully.<\/strong><\/p>\n<h3>GitHub<\/h3>\n<ul>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/Microsoft\/malmo-challenge\" target=\"_blank\" rel=\"noopener noreferrer\">Tasks and example code on GitHub<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/malmo-leaderboard.azurewebsites.net\/\" target=\"_blank\" rel=\"noopener noreferrer\">Leaderboard showing current team scores<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/gitter.im\/Microsoft\/malmo\" target=\"_blank\" rel=\"noopener noreferrer\">Malmo Gitter forum<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n<h3>Important dates<\/h3>\n<ul>\n<li>Registration deadline: April 21, 2017, 23:59 UK Time<\/li>\n<li>Entry submission deadline: May 22, 2017 23:59 UK Time<\/li>\n<li>Finalists notified: June 5, 2017<\/li>\n<\/ul>\n<h3>Useful links<\/h3>\n<ul>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-malmo\/\" target=\"_blank\" rel=\"noopener noreferrer\">Project Malmo<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/microsoft-azure-for-research\/\" target=\"_blank\" rel=\"noopener noreferrer\">Azure4Research<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/event\/ai-summer-school-2017\/\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Research AI Summer School<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/microsoft-challenge-minecraft-collaborative-ai\/\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft challenge: Build a collaborative AI in Minecraft<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n<h3>Contact us<\/h3>\n<p>For any queries please see our FAQ section or send email to\u00a0<a href=\"mailto:MalmoAdm@microsoft.com\">MalmoAdm@microsoft.com<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. For technical questions please use the\u00a0<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/gitter.im\/Microsoft\/malmo\" target=\"_blank\" rel=\"noopener noreferrer\">Malmo Forum<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/p>\n<div style=\"height: 20px\"><\/div>\n<h4>References<\/h4>\n<p>[1] Johnson M., Hofmann K., Hutton T., Bignell D. (2016) <em><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.ijcai.org\/Proceedings\/16\/Papers\/643.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">The Malmo Platform for Artificial Intelligence Experimentation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/em>. <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.ijcai.org\/Proceedings\/2016\" target=\"_blank\" rel=\"noopener noreferrer\">Proc. 25th International Joint Conference on Artificial Intelligence<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, Ed. Kambhampati S., p. 4246. AAAI Press, Palo Alto, California USA.<\/p>\n<p>[2] Yoshida, W., Dolan, R.J. and Friston, K.J., (2008) <em><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/journals.plos.org\/ploscompbiol\/article?id=10.1371\/journal.pcbi.1000254\" target=\"_blank\" rel=\"noopener noreferrer\">Game Theory of Mind<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/em>. <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/journals.plos.org\/ploscompbiol\/\" target=\"_blank\" rel=\"noopener noreferrer\">PLoS Computational Biology<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, 4 (12), Article e1000254.<\/p>\n<h2>Malmo Collaborative AI Challenge Rules (\u201cChallenge Rules\u201d)<\/h2>\n<h3>What is the Challenge?<\/h3>\n<p>The Malmo Collaborative AI Challenge (\u201cChallenge\u201d) aims to encourage research in collaborative AI. It takes the form of one or more mini-games in which players need to work together\u00a0to achieve a goal. Challenge participants are invited to develop and train AI solutions to learn to collaborate to achieve high scores when playing with a range of artificial or human players.<\/p>\n<p>Microsoft will make the Challenge tasks and sample code available via GitHub on or before the Challenge start date. Entries will be judged by Microsoft according to the criteria outlined in the \u201cWinner Selection\u201d section below.<\/p>\n<p>Microsoft is offering the following prizes: (1) three winning teams will be awarded placements at its <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/event\/ai-summer-school-2017\/\" target=\"_blank\" rel=\"noopener noreferrer\">AI Summer School at Microsoft Research Cambridge, UK<\/a>,\u00a0and (2) three winning teams will be awarded Microsoft Azure for Research grants with a maximum value of $20,000 USD. Please see the \u201cChallenge Prizes\u201d section below for further details.<\/p>\n<h3>What are the start and end dates?<strong>\u00a0 <\/strong><\/h3>\n<p>The Challenge starts at 00:01 UK time, on March 14, 2017, and ends at 23:59 UK Time, on May 22, 2017 (\u201cEntry Period\u201d). Entries must be received within the Entry Period to be eligible.<\/p>\n<h3>Can my team enter?<strong>\u00a0 <\/strong><\/h3>\n<p><strong>Microsoft Research AI Summer School Placement Prize<\/strong><\/p>\n<p>To be eligible to win the Microsoft Research AI Summer School placement prize your team must meet the following criteria at the time of entry and at the time of award of any prize:<\/p>\n<ul>\n<li>Each team member must be enrolled in undergraduate or post-graduate studies (that is,\u00a0PhD or Masters level) at an accredited college or university and the team lead must be registered in a PhD program at an accredited college or university. In the event that your team includes one or more undergraduates, these individuals will not be allowed to participate in the Microsoft Research AI Summer School should your team be successful in winning this prize.<\/li>\n<li>Although teams may include team members from countries other than those within the European Economic Area (EEA) or Switzerland, only team members from countries within the EEA or Switzerland are eligible to attend the Microsoft Research AI Summer School.<\/li>\n<\/ul>\n<p><strong>Microsoft Azure for Research Grant Prize<\/strong><\/p>\n<p>To be eligible to win the Microsoft Azure for Research Grant prize each team member must meet any criteria that may be imposed by Microsoft to qualify to receive a Microsoft Azure for Research Grant at the time of entry and at the time of award of any prize.<\/p>\n<p><strong>General Requirements<\/strong><\/p>\n<p>To be eligible to win either prize each team member must meet the following criteria at the time of entry and at the time of award of any prize:<\/p>\n<ul>\n<li>18 years of age or older. If any team member is 18 years of age or older, but is considered a minor in their place of residence, they should ask their parent\u2019s or legal guardian\u2019s permission prior to submitting an entry into the Challenge; and<\/li>\n<li>Not an employee of Microsoft Corporation or of any Microsoft subsidiary; and<\/li>\n<li>Not an immediate family (parent, sibling, spouse\/domestic partner, child) or household member of a Microsoft employee, an employee of a Microsoft subsidiary, or any person involved in any part of the administration and execution of this promotion.<\/li>\n<\/ul>\n<p>Subject to meeting the relevant eligibility criteria, teams are permitted to enter to win one or both prizes. Teams will be required to indicate on their registration form which prize(s), if any, they are applying to win. In the event that your team decides that it would like to apply to win a different, or additional, prize, your team lead must notify Microsoft before the end of the Entry Period by sending an email to <a href=\"mailto:MalmoAdm@microsoft.com\">MalmoAdm@microsoft.com<\/a>. Only emails actually received by Microsoft before the end of the Entry Period will be considered.<\/p>\n<p>This promotion is void where prohibited by law. No purchase necessary.<\/p>\n<h3>How does my team enter?<\/h3>\n<p>To participate in the Challenge your team will first need to set up a GitHub repository for your Challenge entry. You will then need to complete a registration form providing certain required information, such as your team name, details of your team members, and a valid link to the GitHub repository that will contain your Challenge entry and submit this to Microsoft via GitHub. Once submitted to Microsoft via your registration form, any changes to your GitHub repository will only be accepted\u00a0at Microsoft&#8217;s\u00a0sole discretion.<\/p>\n<p>Your team can submit its Challenge entry by uploading it to the GitHub location specified on your registration form at any time during the Entry Period. Entries must include all code used to obtain the results submitted by a team and a \u201cReadme\u201d file of no more than 2,500 characters explaining the team\u2019s approach, design decisions and instructions on how to run the submitted code. You will also need to submit a short video (approximately 1\u20133 minutes) describing your solution. A team may change and\/or update its entry at any time before the end of the Entry Period. Only one GitHub entry per team.<\/p>\n<p>Teams can choose to make their entry (code on GitHub) publicly available. If they choose to do so, other teams can reuse material from these public entries to improve their submissions. All material taken from these or other sources needs to be clearly labeled as such. Teams are responsible for verifying and honoring any legal requirements that such reuse would entail. If teams choose not to make their entry publicly accessible, we require that access be provided to Microsoft representatives. Detailed instructions will be provided to teams who choose to keep their submissions private.<\/p>\n<p>We are not responsible for entries that we do not receive for any reason, or for entries that we receive but are not decipherable for any reason. We will automatically disqualify any incomplete or illegible entries.<\/p>\n<p><strong>Microsoft Azure Passes<\/strong><\/p>\n<p>We will make Microsoft Azure\u00a0Passes available to the first 150 teams that enter the Challenge and have indicated in their registration form that they wish to be considered to receive a Microsoft Azure Pass and meet the relevant eligibility criteria (including Microsoft verifying that your team\u2019s registration form is complete). A Microsoft Azure\u00a0Pass has an estimated total market value of $1,500 USD over three months and is limited to a $500 USD usage cap per month. Any additional cost, above this limit, will be charged to the relevant team lead in accordance with standard Microsoft Azure usage rates. Only teams affiliated with a university or nonprofit organization are eligible to receive a Microsoft Azure Pass. The award of Microsoft Azure\u00a0Passes is also subject to\u00a0the applicable <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/azure.microsoft.com\/en-us\/offers\/azure-pass\/\" target=\"_blank\" rel=\"noopener noreferrer\">Azure Pass requirements<\/a>.<\/p>\n<h3>Winner Selection<\/h3>\n<p>At the close of the Entry Period, the judges will select winning teams from eligible entries based upon the following criteria:<\/p>\n<ol>\n<li>Innovativeness\/originality of the solution; and<\/li>\n<li>Overall performance on the Challenge tasks (i.e. game score); and<\/li>\n<li>Quality of code developed; and<\/li>\n<li>Public voting on GitHub (i.e. GitHub \u201cstars\u201d).<\/li>\n<\/ol>\n<p>The judges will give equal weighting to each of the above criteria.<\/p>\n<p>The decisions of the judges are final and binding. If we do not receive a sufficient number of entries meeting the entry requirements, we may, at our discretion, select fewer winning teams than available prizes.<\/p>\n<p>If any team member is a potential winner and is 18 years of age or older, but is considered a minor in their place of legal residence, we may require that person\u2019s parent or legal guardian to sign all required forms on their behalf. If that person does not complete the required forms as instructed and\/or return the required forms within the time period listed on the winner notification message, we may disqualify the relevant team and select a runner-up.<\/p>\n<p>If your team is confirmed as a winner of the Challenge:<\/p>\n<ul>\n<li>It may not designate someone else as the winner. If your team is unable or unwilling to accept its prize, we may award it to a runner-up; and<\/li>\n<li>Team members will be solely responsible for any taxes that may be payable in connection with the award of any prize.<\/li>\n<\/ul>\n<h3>Challenge Prizes<\/h3>\n<ul>\n<li><strong>Microsoft Research AI Summer School Placement<\/strong>\u2014Three teams will each be awarded a place at the Microsoft Research AI Summer School at Microsoft Research in Cambridge, UK, between July 3, 2017, and\u00a0July 6, 2017. Microsoft will reimburse the following reasonably and necessarily incurred travel expenses of team members in attending the AI Summer School: (1) public transport to and from Microsoft Research, Cambridge; and (2) economy class return airfares from your nearest airport to London (only if team members are located outside the UK). Microsoft will also provide accommodation and meals, except for one evening meal, during your placement.<\/li>\n<li><strong>Microsoft Azure for Research Grant\u2014<\/strong>Three teams will each win an Azure for Research grant with a maximum value of $20,000 USD. The Azure for Research grant will be awarded to the team lead nominated by the relevant team. Team leads will be solely responsible for allocation of the grant between the relevant team members. The award of a Microsoft Azure for Research grant will be subject to each team member agreeing to comply with such terms and conditions of use or other requirements that Microsoft may impose.<\/li>\n<\/ul>\n<h3>What other conditions is my team agreeing to by entering?<\/h3>\n<p>By entering the Challenge each team member agrees:<\/p>\n<ul>\n<li>To abide by these Challenge Rules; and<\/li>\n<li>To release and hold harmless Microsoft and its respective parents, subsidiaries, affiliates, employees, and agents from any and all liability or any injury, loss, or damage of any kind arising from or in connection with the Challenge, or any prize won; and<\/li>\n<li>That decisions by Microsoft will be final and binding on all matters related to the Challenge; and<\/li>\n<li>That, by accepting a prize, Microsoft may use your team name, country of residence, and team photo online and in print, or in any other media, in connection with the Challenge, without payment or compensation to you, except where prohibited by law.<\/li>\n<\/ul>\n<h3>How will my team&#8217;s entry be potentially used?<\/h3>\n<p>Except as set out below, we are not claiming any ownership rights to your team\u2019s entry. However, by submitting your entry, each team member: 1. Grants Microsoft an irrevocable, non-exclusive, royalty-free, worldwide right and license to: (i) use, review, assess, test, and otherwise analyze your entry and all its content in connection with the Challenge; and (ii) feature your entry and all content in connection with the marketing, sale, or promotion of the Challenge (including but not limited to internal and external sales meetings, conference presentations, tradeshows, and screen shots of the Challenge entry in press releases) in all media (now known or later developed); and 2. agrees to sign any necessary documentation that may be required for us and our designees to make use of the rights you granted above; and 3. understands and acknowledges that Microsoft may have developed or commissioned materials similar or identical to your team\u2019s submission and you waive any claims you may have resulting from any similarities to your entry; and 4. understands that we cannot control the incoming information you will disclose to our representatives in the course of entering, or what our representatives will remember about your entry. You also understand that we will not restrict work assignments of representatives who have had access to your entry. By entering the Challenge, you agree that use of information in our representatives\u2019 unaided memories in the development or deployment of our products or services does not create liability for us under this agreement or copyright or trade secret law; and 5. understands that you will not receive any compensation or credit for use of your entry, other than what is described in these Challenge Rules.<\/p>\n<p>If your team does not want to grant us these rights to your entry, please do not enter the Challenge.<\/p>\n<h3>What laws govern the way the Challenge is administered?<\/h3>\n<p>This Challenge is governed by the laws of England and Wales, and you consent to the exclusive jurisdiction and venue of the Courts of England and Wales for any disputes arising out of the Challenge.<\/p>\n<h3>What if something unexpected happens and the Challenge can&#8217;t run as planned?<\/h3>\n<p>If someone cheats, or a virus, bug, bot, catastrophic event, or any other unforeseen or unexpected event that cannot be reasonably anticipated or controlled (also referred to as force majeure), affects the fairness and\/or integrity of the Challenge, we reserve the right to cancel, change, or suspend the Challenge. This right is reserved whether the event is due to human or technical error. If a solution cannot be found to restore the integrity of the Challenge, we reserve the right to select winning teams from among all eligible entries received before we had to cancel, change, or suspend the Challenge.<\/p>\n<p>If any team member attempts to, or we have strong reason to believe that a team member has, compromised the integrity or the legitimate operation of the Challenge by cheating, or through any other illegal, unlawful, or unfair activity, we may seek damages from that team member to the fullest extent permitted by law. Further, we may disqualify your team, and ban any team member from participating in any of our future Challenges, so please play fairly.<\/p>\n<h3>Winner\u2019s List and Sponsor<\/h3>\n<p>We will notify winning teams by June 5, 2017. We will also post a leaderboard detailing the top 20 team entries online at <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/collaborative-ai-challenge\/\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/collaborative-ai-challenge\/<\/a>. Please note that we will only post team names and we will not post the names of any individual team members. This list will remain posted for a period of at least 12 calendar months.<\/p>\n<p>If your team\u2019s entry is in a public repository we may also post a link to that repository. Please check your GitHub settings to ensure that this will not result in individual team members becoming identifiable, unless this is intended by the individual(s) in question.<\/p>\n<p>This promotion is sponsored by Microsoft Research Limited, 21 Station Road, Cambridge, United Kingdom, CB1 2FB.<\/p>\n<h3>Privacy Statement<\/h3>\n<p>At Microsoft, we are committed to protecting your privacy. Microsoft uses the information you provide to notify prize winners, and to send you information about other Microsoft products and services, if requested by you. Microsoft will not share the information you provide with third parties without your permission except where necessary to complete the services or transactions you have requested, or as required by law. Microsoft is committed to protecting the security of your personal information. We use a variety of security technologies and procedures to help protect your personal information from unauthorized access, use, or disclosure. Your personal information is never shared outside the company without your permission, except under conditions explained above.<\/p>\n<p>If you believe that Microsoft has not adhered to this statement, please notify us by sending an email to <a href=\"mailto:MalmoAdm@microsoft.com\">MalmoAdm@microsoft.com<\/a> or postal mail to Malmo Collaborative AI Challenge, Microsoft Research Limited, 21 Station Road, Cambridge CB1 2FB, United Kingdom, and we will use commercially reasonable efforts to remedy the situation.<\/p>\n<p>            <div class=\"js-accordion\" data-accordion-prefix-classes=\"msr-accordion\" data-accordion-expandall=\"true\">\n                                                <h4 class=\"js-accordion__header\">\n            \tHow do I register?            <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p>Please complete the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.surveygizmo.com\/s3\/3299773\/The-Collaborative-AI-Challenge\" target=\"_blank\" rel=\"noopener noreferrer\">registration form<\/a>.\u00a0Before submitting your registration, you will need to set up a repository on GitHub because you will have to provide a valid link during the registration process.<\/p>\n<p>Make sure that your team\u2019s registration form is complete before submitting. Once submitted to Microsoft via your registration form, any changes to your GitHub repository and registration details will be accepted at the sole discretion of Microsoft.\u00a0<\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tHow should I submit my entry to the Challenge?            <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p> Your Challenge submission\u00a0will\u00a0be\u00a0the version of the code on your GitHub repository branch master at the time of the entry submission deadline. Your submission needs to contain code in working order and be accompanied by\u00a0a one-page description of your approach and a link to a one-to-three-minute video that shows off your agent. <\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tDo I have to use the example code?            <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p> The example code is provided as an optional starting point, and you do not need to use it in your submission. However, note that the Challenge task definition cannot be changed.\u00a0<\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tWhat platforms\/languages can I use?            <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p>Malmo clients can be run on Windows,\u00a0Linux, and Mac. We also provide ready-to-build\u00a0Docker images that can be run on any platform supported by docker.io. The Challenge has been developed around Python\u2014both 2.7 and >= 3.4 are compatible.\u00a0\u00a0<\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tCan I publish results of my experiments with the Malmo Collaborative AI Challenge?            <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p> Yes, we encourage academic publications relating to the Malmo Collaborative AI Challenge. If you do decide to publish results, please cite the Malmo Platform\u00a0as:<\/p>\n<p>Johnson M., Hofmann K., Hutton T., Bignell D. (2016)\u00a0<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.ijcai.org\/Proceedings\/16\/Papers\/643.pdf\" target=\"_blank\" rel=\"noopener noreferrer\"><em>The Malmo Platform for Artificial Intelligence Experimentation<\/em><\/a>.\u00a0<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.ijcai.org\/Proceedings\/2016\" target=\"_blank\" rel=\"noopener noreferrer\">Proc. 25th International Joint Conference on Artificial Intelligence<\/a>, Ed. Kambhampati S., p. 4246. AAAI Press, Palo Alto, California USA.<\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tWhat can I win?            <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p>Microsoft is offering the following prizes: (1) three winning teams will be awarded placements at its AI Summer School at Microsoft Research Cambridge, UK, and (2) three winning teams will be awarded Microsoft Azure for Research grants with a maximum value of $20,000 USD. Please\u00a0read the\u00a0Challenge Rules\u00a0on this page for further details.\u00a0<\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tWhere can I get help?            <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p>You can direct administrative questions to <a href=\"mailto:MalmoAdm@microsoft.com\">MalmoAdm@microsoft.com<\/a>. For technical questions, we encourage you to use the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/gitter.im\/Microsoft\/malmo\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Malmo forum<\/a>. We endeavor to respond within two business days. <\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tWhat is Microsoft Azure?             <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/azure.microsoft.com\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Azure<\/a> is the Microsoft cloud computing service. Azure provides a wide range of services and supports a wide variety of popular platforms, tools and programming languages. It\u00a0is ideal for deep learning using GPUs and for running\u00a0machine learning models.\u00a0As part of the Malmo Collaborative AI Challenge we provide example code for running experiments using <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.docker.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">Docker<\/a>\u00a0on Azure.<\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tWhat is Microsoft Azure for Research?            <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p>The <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/microsoft-azure-for-research\/\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Azure for Research program<\/a> awards cloud computing time, training, and resources for the purpose of conducting cloud-based research. Qualified applicants must be affiliated with a university or nonprofit research organization.<\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tHow do I get a free Microsoft Azure Pass?             <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p>During registration, you\u2019ll be asked \u201cDo you want to use a FREE Microsoft Azure\u00a0Pass?\u201d If you choose \u201cYes,\u201d we will contact you within\u00a0two business days\u00a0to set this up. Note that these\u00a0passes are available only to the first 150 entries under the precondition that your team\u2019s registration form is complete and the terms and conditions stated in the Challenge Rules apply.<\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tWhich countries are in the EEA?            <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p>The EEA (European Economic Area) includes EU countries and also Iceland, Liechtenstein, and Norway. The EU countries are: Austria, Belgium, Bulgaria, Croatia, Republic of Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, and the UK.<\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tHow can I sign up for the prizes?            <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p>During registration, you will be asked whether you wish to apply to win the respective prize. Please answer accordingly. Note that the AI Summer School prize is restricted to participants from EEA countries plus Switzerland and the Azure for Research Grant prize is restricted to participants who are affiliated with a university or nonprofit research organization. Please check the Challenge Rules tab on this page.<\/p>\n                <\/p>\n            <\/div>\n                                            <h4 class=\"js-accordion__header\">\n            \tHow will my submission be evaluated?            <\/h4>\n                            <div class=\"js-accordion__panel\">\n                <p class=\"msr-accordion-content\">\n\t\t\t\t\t\t\t\t\t\t<p>At the close of the Entry Period, the judges will select winning teams from eligible entries based upon the following criteria:<\/p>\n<ol>\n<li>Innovativeness\/originality of the solution; and<\/li>\n<li>Overall performance on the Challenge tasks (i.e. game score); and<\/li>\n<li>Quality of code developed; and<\/li>\n<li>Public voting on GitHub (i.e.\u00a0GitHub \u201cstars\u201d).<\/li>\n<\/ol>\n<p>The judges will give equal weighting to each of the above criteria. The judges will be employees of Microsoft Corporation or one of\u00a0its affiliated companies. For further details please check the Challenge Rules.<\/p>\n                <\/p>\n            <\/div>\n                                <\/div>\n        <\/p>\n<h3>Meet the team behind the Malmo Collaborative AI Challenge<\/h3>\n<p><strong>Lead<\/strong><\/p>\n<p><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/kahofman\/\" target=\"_blank\" rel=\"noopener noreferrer\">Katja Hofmann<\/a>, Researcher, Microsoft Research Cambridge<\/p>\n<p><strong>Development and design<\/strong><\/p>\n<p>David Bignell, Engineer, Microsoft Research Cambridge<br \/>\nGame development<\/p>\n<p>Morgan Funtowicz, Research Intern, Microsoft Research Cambridge<br \/>\nGame development and technical support<\/p>\n<p>Michael Golembewski, Postdoctoral Researcher, Microsoft Research Cambridge<br \/>\nScientific advisor<\/p>\n<p><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/nkushman\/\" target=\"_blank\" rel=\"noopener noreferrer\">Nate Kushman<\/a>, Researcher, Microsoft Research Cambridge<br \/>\nScientific advisor<\/p>\n<p><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/cecilym\/\" target=\"_blank\" rel=\"noopener noreferrer\">Cecily Morrison<\/a>, Researcher, Microsoft Research Cambridge<br \/>\nScientific advisor<\/p>\n<p><strong>Program management<\/strong><\/p>\n<p>Noburo Kuno, Senior Research Program Manager, Microsoft Research Redmond<\/p>\n<p><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/scarlets\/\" target=\"_blank\" rel=\"noopener noreferrer\">Scarlet Schwiderski-Grosche<\/a>, Senior Research Program Manager, Microsoft Research Cambridge<\/p>\n<p><strong>Support<\/strong><\/p>\n<p>Neeltje Berger, Graphic Designer<br \/>\nWebsite design and support<\/p>\n<p>Sue Flanders, Program Coordinator, Microsoft Research Cambridge<br \/>\nAdministrative support<\/p>\n<table style=\"border-spacing: inherit;border-collapse: collapse;width: 100%;padding: 6px;text-align: center;border-bottom: 1px solid #000000\">\n<tbody>\n<tr>\n<td style=\"width: 5%;padding: 6px;border-bottom: 1px solid #000000\"><strong>Id<\/strong><\/td>\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>Team<\/strong><\/td>\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>Date<\/strong><\/td>\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>100k Mean<\/strong><\/td>\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>100k Var<\/strong><\/td>\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>100k Count<\/strong><\/td>\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>500k Mean<\/strong><\/td>\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>500k Var<\/strong><\/td>\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>500k Count<\/strong><\/td>\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>Experiment Name<\/strong><\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">18<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">The Danish Puppeteers<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/21\/2017 21:40<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2.18922663<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">70.03464<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">724<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2.43484855<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">73.86394<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">660<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">Guided Danish Puppet vs PigChase<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">26<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">HogRider<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 13:25<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1.74024224<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">59.3497543<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">743<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2.19602275<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">68.80533<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">704<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">HogRider<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">15<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">ParSys<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/19\/2017 23:22<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.75202155<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">58.50724<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">742<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2.11304355<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">65.8278046<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">690<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">E_AStar vs AStar (Final)<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">25<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">HogRider<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 13:01<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1.80218279<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">59.8067055<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">733<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2.03385043<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">65.08489<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">709<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">HogRiderA<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">33<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">HogRider<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 16:31<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2.41074252<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">71.5722046<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">633<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.89413452<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">61.5710526<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">699<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">HogRiderD<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">35<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">Bacon Gulch<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 21:14<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1.51408446<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">47.795578<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">568<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1.68065691<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">51.0969238<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">548<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">UCT_budget_1000_exploration_15.00<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">7<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">HogRider<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/18\/2017 5:55<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.373262<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">53.1045265<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">935<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.66896546<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">59.3731766<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">870<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My Exp 1<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">14<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">ParSys<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/19\/2017 22:45<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1.4073199<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">51.9131927<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">847<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1.48886144<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">53.33651<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">808<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">E_AStar vs AStar<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">27<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">Bacon Gulch<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 13:35<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.49820149<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">46.9766159<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">556<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.35951138<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">43.8428268<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">573<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">UCT_budget_1000_exploration_40.00<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">39<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">Village People<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/23\/2017 13:34<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1.61760461<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">54.04858<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">693<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1.31812418<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">48.9089355<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">789<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">My Exp 1<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">AASMA<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/2\/2017 13:08<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.917197466<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">38.05047<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">157<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.27745664<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">50.61666<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">173<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My Exp 1<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">12<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">AASMA<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/19\/2017 7:38<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1.44220567<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">54.84475<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">943<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1.24795914<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">50.9089241<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">980<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">AASMA vs Astar<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">9<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">ParSys<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/18\/2017 15:09<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.08771932<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">47.42444<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1083<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.19844353<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">49.4080925<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1028<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">Enhanced AStar Exp 2<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">8<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">ParSys<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/18\/2017 11:29<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">0.8790614<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">43.6099243<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1108<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1.137931<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">49.051857<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1044<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">Enhanced AStar Exp 1<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">29<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">bacon-reloaded<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 14:15<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.851714551<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">3.481255<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2158<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.504816949<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">18.8357182<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">519<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My experiment 2<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">13<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">AASMA<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/19\/2017 8:06<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">0.5913793<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">36.46406<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1160<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">0.498736322<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">34.5852966<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1187<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">AASMA vs Default<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">21<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">bacon-reloaded<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 9:38<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.46981132<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">19.1773911<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">530<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.48<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">19.1562672<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">525<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My experiment 1<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">34<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">bacon-reloaded<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 18:06<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">0.123076923<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">11.3489542<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">585<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">0.4163701<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">18.9120445<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">562<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">final<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">30<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">bacon-reloaded<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 15:41<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.02097902<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">8.57998<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">572<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.167293236<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">11.0453215<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">532<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My experiment 3<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">17<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">Pathfinder<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/20\/2017 18:51<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">0.134094149<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">15.4114056<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">701<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">0.159057438<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">15.2648335<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">679<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">Lapisjunkie<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">11<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">AutoMagico<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/18\/2017 19:58<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.151986182<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">12.3637743<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">579<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.090056285<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">8.100708<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">533<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">FirstExperiment2<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">19<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">Pathfinder<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 0:16<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.07680835<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">20.4437656<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1341<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">0.04491726<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">22.6559811<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1269<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">Final<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">24<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">HelloJason<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 11:07<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.374222726<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">15.3557177<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1769<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.159561515<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">20.3837967<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1642<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">HiDDeN Vs PigChaseChallenger 2<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">3<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">RoyalPuzzle<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/16\/2017 13:35<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.0854902<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">19.246809<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1275<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.213001385<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">16.5507584<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1446<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">qlearning100000Exp<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">16<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">RoyalPuzzle<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/20\/2017 14:26<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.5792812<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">9.593609<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1892<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.5305024<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">9.740696<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1672<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">q-learning<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">10<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">AutoMagico<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/18\/2017 18:52<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.66284287<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">7.78457928<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2005<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.7344951<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5.776765<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1951<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">FirstExperiment<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">CollaMind<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/17\/2017 21:50<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.7892399<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">4.68756437<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2026<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.777398944<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5.04397058<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2053<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My experiment 2<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">36<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">CollaMind<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 22:37<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.8674641<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2.66520929<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2090<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.7974867<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">4.530762<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2069<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">avg_failed!<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">6<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">CollaMind<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/17\/2017 22:17<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.8081485<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">4.131321<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1939<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.803180933<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">4.35291243<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2012<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My experiment 3<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">4<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">CollaMind<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/17\/2017 21:21<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.7367647<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5.407178<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1360<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.81155616<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">3.65260458<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">1523<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">My experiment 1<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">MSRC-Admin<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">4\/11\/2017 17:11<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.778490365<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">4.962774<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2027<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.8477952<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">3.23951745<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2109<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">Random vs Random<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">38<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">CollaMind<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 23:20<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.8102941<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">4.25665855<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2040<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.854942858<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2.751934<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2013<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">avg-greedy_failed!<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">37<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">CollaMind<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 22:55<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.8169014<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">3.942677<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2059<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.8649688<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2.66365027<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2081<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">greedy_failed!<\/td>\n<\/tr>\n<tr>\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">20<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">HelloJason<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 0:16<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.816409767<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">4.61498<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2206<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.89<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2.77181315<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">2300<\/td>\n<td style=\"padding: 6px;border: 1px solid #000000\">HiDDeN Vs PigChaseChallenger<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"featured_media":346142,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"footnotes":""},"msr-opportunity-type":[187426],"msr-region":[256048],"msr-locale":[268875],"msr-program-audience":[],"msr-impact-theme":[],"class_list":["post-346139","msr-academic-program","type-msr-academic-program","status-publish","has-post-thumbnail","hentry","msr-opportunity-type-challenges","msr-region-global","msr-locale-en_us"],"msr_description":"The Malmo Collaborative AI Challenge takes the form of a collaborative mini-game in which players need to work together to achieve a common goal.","msr_social_media":[],"related-researchers":[],"tab-content":[{"id":0,"name":"About","content":"<em><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/malmo-collaborative-ai-challenge-winners\/\" target=\"_blank\" rel=\"noopener noreferrer\">Presenting the winners of the Project Malmo Collaborative AI Challenge &gt;<\/a><\/em>\r\n\r\nA long-standing goal of researchers in <strong>Artificial\u00a0Intelligence (AI)<\/strong> is to develop technology that collaborates with humans to achieve their goals. But, research in <strong>Collaborative AI<\/strong> poses unique challenges:\r\n<ul>\r\n \t<li>How can AI agents learn to recognize someone\u2019s intent (that is, what they are trying to achieve)?<\/li>\r\n \t<li>How can AI agents learn what behaviors are helpful when working toward a common goal?<\/li>\r\n \t<li>And, how can they coordinate or communicate with another agent to agree on a shared strategy for problem-solving?<\/li>\r\n<\/ul>\r\nWhile these and other challenges in Collaborative AI remain unsolved, we believe that recent advances have created unique opportunities for finding answers to key questions.\r\n\r\nThat's the thinking behind the <strong>Malmo Collaborative AI Challenge<\/strong>, designed to\u00a0encourage research relating to various problems in Collaborative AI. The Challenge takes the form of a collaborative mini-game in which players need to work together to achieve a common goal. Challenge participants are invited to develop and train collaborative AI solutions that learn to achieve high scores across a range of partners.\r\n\r\nhttps:\/\/youtu.be\/iOWbeMvml3M\r\n\r\nInnovative AI solutions to the Challenge can lead to breakthroughs in Collaborative AI technology, and we'd like your help!\r\n<h2>Are you interested\u00a0in developing innovative AI solutions? Read how it works!<\/h2>\r\nThe Malmo Collaborative AI Challenge uses\u00a0<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-malmo\/\" target=\"_blank\" rel=\"noopener noreferrer\">Project Malmo<\/a> [1], an artificial intelligence experimentation and research platform that is built on top of the popular <a href=\"https:\/\/minecraft.net\/en-us\/\" target=\"_blank\" rel=\"noopener noreferrer\">Minecraft<\/a>\u00a0game. Project Malmo was created to inspire a new generation of research into problems presented by this unique environment.\r\n\r\nThe Malmo Collaborative AI Challenge takes the form of a collaborative mini-game, based on an extension [2] of the game theoretic \u201c<a href=\"https:\/\/en.wikipedia.org\/wiki\/Stag_hunt\" target=\"_blank\" rel=\"noopener noreferrer\">stag hunt<\/a>.\u201d The stag hunt is a classic example modeling the trade-offs between choosing to collaborate and going solo. We have implemented this concept in the form of the Malmo Pig Chase. The task and sample code are freely available on GitHub.\r\n<h2>And what's in it for you?<\/h2>\r\nBesides the joy of problem-solving, Microsoft is offering the following prizes:\r\n<ul>\r\n \t<li><strong>Microsoft Research AI Summer School Placement Prize<\/strong>\r\nThree winning teams will be awarded placements at the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/event\/ai-summer-school-2017\/\" target=\"_blank\" rel=\"noopener noreferrer\">AI Summer School at Microsoft Research Cambridge, UK<\/a>.<\/li>\r\n \t<li><strong>Microsoft Azure for Research Grant Prize<\/strong>\r\nThree winning teams will be awarded <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/microsoft-azure-for-research\/\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Azure for Research<\/a> grants with a maximum value of $20,000 USD.<\/li>\r\n<\/ul>\r\nDuring registration, Challenge participants can sign up for either or both prizes. Note that your participation is subject to Challenge Rules (see separate tab on this page).\r\n<h2>Here's how to participate!<\/h2>\r\n<ol>\r\n \t<li>Check the\u00a0Challenge\u00a0Rules\u00a0(see separate tab on this page). Note that the Challenge is targeted at participants\u00a0affiliated with a university or nonprofit research organization.<\/li>\r\n \t<li>Form a team (of up to\u00a0three participants), decide on a team lead, and create a GitHub repository for your submission. Note that you will need to provide a valid link to the GitHub repository at the time of registration. We recommend that you\u00a0start by creating a fork of <a href=\"https:\/\/github.com\/Microsoft\/malmo-challenge\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/github.com\/Microsoft\/malmo-challenge<\/a>.<\/li>\r\n \t<li>Decide on whether you want to use Microsoft Azure\u00a0for developing and training your agent.\u00a0If you do,\u00a0note that we\u00a0will make available, at no charge, Microsoft Azure\u00a0Passes (market value $1,500 USD) to the first 150 entries (subject to requirements outlined in the Challenge Rules). Please indicate this\u00a0during registration.<\/li>\r\n \t<li>Register your team <a href=\"https:\/\/www.surveygizmo.com\/s3\/3299773\/The-Collaborative-AI-Challenge\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>. Please make sure that your team\u2019s registration form is complete before submitting. Once submitted to Microsoft via your registration form, accepting any changes to your GitHub repository and registration details will be at the sole discretion of Microsoft.<\/li>\r\n \t<li>Write code and train your agent, who will take the role of one of two players. You can update your submission on your GitHub repository\u00a0until the entry submission deadline.<\/li>\r\n \t<li>Before the entry submission deadline,\u00a0create a one-page summary of your GitHub submission that describes your approach, and create a one-to-three-minute\u00a0video that shows off your agent. Include the summary\u00a0and link to\u00a0the video\u00a0on your GitHub overview page.<\/li>\r\n<\/ol>\r\nAfter the entry submission deadline, we will assess\u00a0all Challenge submissions. The best agent is the one who plays best with all other players. Check the winner selection section in the\u00a0Challenge Rules for further details. We will notify the finalist\u00a0on June 5, 2017.\r\n\r\n<strong>Before you sign up, please make sure to study the\u00a0<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/collaborative-ai-challenge\/#!challenge-rules\">Challenge Rules<\/a>\u00a0carefully.<\/strong>\r\n<h3>GitHub<\/h3>\r\n<ul>\r\n \t<li><a href=\"https:\/\/github.com\/Microsoft\/malmo-challenge\" target=\"_blank\" rel=\"noopener noreferrer\">Tasks and example code on GitHub<\/a><\/li>\r\n \t<li><a href=\"https:\/\/malmo-leaderboard.azurewebsites.net\/\" target=\"_blank\" rel=\"noopener noreferrer\">Leaderboard showing current team scores<\/a><\/li>\r\n \t<li><a href=\"https:\/\/gitter.im\/Microsoft\/malmo\" target=\"_blank\" rel=\"noopener noreferrer\">Malmo Gitter forum<\/a><\/li>\r\n<\/ul>\r\n<h3>Important dates<\/h3>\r\n<ul>\r\n \t<li>Registration deadline: April 21, 2017, 23:59 UK Time<\/li>\r\n \t<li>Entry submission deadline: May 22, 2017 23:59 UK Time<\/li>\r\n \t<li>Finalists notified: June 5, 2017<\/li>\r\n<\/ul>\r\n<h3>Useful links<\/h3>\r\n<ul>\r\n \t<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-malmo\/\" target=\"_blank\" rel=\"noopener noreferrer\">Project Malmo<\/a><\/li>\r\n \t<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/microsoft-azure-for-research\/\" target=\"_blank\" rel=\"noopener noreferrer\">Azure4Research<\/a><\/li>\r\n \t<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/event\/ai-summer-school-2017\/\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Research AI Summer School<\/a><\/li>\r\n \t<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/microsoft-challenge-minecraft-collaborative-ai\/\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft challenge: Build a collaborative AI in Minecraft<\/a><\/li>\r\n<\/ul>\r\n<h3>Contact us<\/h3>\r\nFor any queries please see our FAQ section or send email to\u00a0<a href=\"mailto:MalmoAdm@microsoft.com\">MalmoAdm@microsoft.com<\/a>. For technical questions please use the\u00a0<a href=\"https:\/\/gitter.im\/Microsoft\/malmo\" target=\"_blank\" rel=\"noopener noreferrer\">Malmo Forum<\/a>.\r\n<div style=\"height: 20px\"><\/div>\r\n<h4>References<\/h4>\r\n[1] Johnson M., Hofmann K., Hutton T., Bignell D. (2016) <em><a href=\"http:\/\/www.ijcai.org\/Proceedings\/16\/Papers\/643.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">The Malmo Platform for Artificial Intelligence Experimentation<\/a><\/em>. <a href=\"http:\/\/www.ijcai.org\/Proceedings\/2016\" target=\"_blank\" rel=\"noopener noreferrer\">Proc. 25th International Joint Conference on Artificial Intelligence<\/a>, Ed. Kambhampati S., p. 4246. AAAI Press, Palo Alto, California USA.\r\n\r\n[2] Yoshida, W., Dolan, R.J. and Friston, K.J., (2008) <em><a href=\"http:\/\/journals.plos.org\/ploscompbiol\/article?id=10.1371\/journal.pcbi.1000254\" target=\"_blank\" rel=\"noopener noreferrer\">Game Theory of Mind<\/a><\/em>. <a href=\"http:\/\/journals.plos.org\/ploscompbiol\/\" target=\"_blank\" rel=\"noopener noreferrer\">PLoS Computational Biology<\/a>, 4 (12), Article e1000254."},{"id":1,"name":"Challenge Rules","content":"<h2>Malmo Collaborative AI Challenge Rules (\u201cChallenge Rules\u201d)<\/h2>\r\n<h3>What is the Challenge?<\/h3>\r\nThe Malmo Collaborative AI Challenge (\u201cChallenge\u201d) aims to encourage research in collaborative AI. It takes the form of one or more mini-games in which players need to work together\u00a0to achieve a goal. Challenge participants are invited to develop and train AI solutions to learn to collaborate to achieve high scores when playing with a range of artificial or human players.\r\n\r\nMicrosoft will make the Challenge tasks and sample code available via GitHub on or before the Challenge start date. Entries will be judged by Microsoft according to the criteria outlined in the \u201cWinner Selection\u201d section below.\r\n\r\nMicrosoft is offering the following prizes: (1) three winning teams will be awarded placements at its <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/event\/ai-summer-school-2017\/\" target=\"_blank\" rel=\"noopener noreferrer\">AI Summer School at Microsoft Research Cambridge, UK<\/a>,\u00a0and (2) three winning teams will be awarded Microsoft Azure for Research grants with a maximum value of $20,000 USD. Please see the \u201cChallenge Prizes\u201d section below for further details.\r\n<h3>What are the start and end dates?<strong>\u00a0 <\/strong><\/h3>\r\nThe Challenge starts at 00:01 UK time, on March 14, 2017, and ends at 23:59 UK Time, on May 22, 2017 (\u201cEntry Period\u201d). Entries must be received within the Entry Period to be eligible.\r\n<h3>Can my team enter?<strong>\u00a0 <\/strong><\/h3>\r\n<strong>Microsoft Research AI Summer School Placement Prize<\/strong>\r\n\r\nTo be eligible to win the Microsoft Research AI Summer School placement prize your team must meet the following criteria at the time of entry and at the time of award of any prize:\r\n<ul>\r\n \t<li>Each team member must be enrolled in undergraduate or post-graduate studies (that is,\u00a0PhD or Masters level) at an accredited college or university and the team lead must be registered in a PhD program at an accredited college or university. In the event that your team includes one or more undergraduates, these individuals will not be allowed to participate in the Microsoft Research AI Summer School should your team be successful in winning this prize.<\/li>\r\n \t<li>Although teams may include team members from countries other than those within the European Economic Area (EEA) or Switzerland, only team members from countries within the EEA or Switzerland are eligible to attend the Microsoft Research AI Summer School.<\/li>\r\n<\/ul>\r\n<strong>Microsoft Azure for Research Grant Prize<\/strong>\r\n\r\nTo be eligible to win the Microsoft Azure for Research Grant prize each team member must meet any criteria that may be imposed by Microsoft to qualify to receive a Microsoft Azure for Research Grant at the time of entry and at the time of award of any prize.\r\n\r\n<strong>General Requirements<\/strong>\r\n\r\nTo be eligible to win either prize each team member must meet the following criteria at the time of entry and at the time of award of any prize:\r\n<ul>\r\n \t<li>18 years of age or older. If any team member is 18 years of age or older, but is considered a minor in their place of residence, they should ask their parent\u2019s or legal guardian\u2019s permission prior to submitting an entry into the Challenge; and<\/li>\r\n \t<li>Not an employee of Microsoft Corporation or of any Microsoft subsidiary; and<\/li>\r\n \t<li>Not an immediate family (parent, sibling, spouse\/domestic partner, child) or household member of a Microsoft employee, an employee of a Microsoft subsidiary, or any person involved in any part of the administration and execution of this promotion.<\/li>\r\n<\/ul>\r\nSubject to meeting the relevant eligibility criteria, teams are permitted to enter to win one or both prizes. Teams will be required to indicate on their registration form which prize(s), if any, they are applying to win. In the event that your team decides that it would like to apply to win a different, or additional, prize, your team lead must notify Microsoft before the end of the Entry Period by sending an email to <a href=\"mailto:MalmoAdm@microsoft.com\">MalmoAdm@microsoft.com<\/a>. Only emails actually received by Microsoft before the end of the Entry Period will be considered.\r\n\r\nThis promotion is void where prohibited by law. No purchase necessary.\r\n<h3>How does my team enter?<\/h3>\r\nTo participate in the Challenge your team will first need to set up a GitHub repository for your Challenge entry. You will then need to complete a registration form providing certain required information, such as your team name, details of your team members, and a valid link to the GitHub repository that will contain your Challenge entry and submit this to Microsoft via GitHub. Once submitted to Microsoft via your registration form, any changes to your GitHub repository will only be accepted\u00a0at Microsoft's\u00a0sole discretion.\r\n\r\nYour team can submit its Challenge entry by uploading it to the GitHub location specified on your registration form at any time during the Entry Period. Entries must include all code used to obtain the results submitted by a team and a \u201cReadme\u201d file of no more than 2,500 characters explaining the team\u2019s approach, design decisions and instructions on how to run the submitted code. You will also need to submit a short video (approximately 1\u20133 minutes) describing your solution. A team may change and\/or update its entry at any time before the end of the Entry Period. Only one GitHub entry per team.\r\n\r\nTeams can choose to make their entry (code on GitHub) publicly available. If they choose to do so, other teams can reuse material from these public entries to improve their submissions. All material taken from these or other sources needs to be clearly labeled as such. Teams are responsible for verifying and honoring any legal requirements that such reuse would entail. If teams choose not to make their entry publicly accessible, we require that access be provided to Microsoft representatives. Detailed instructions will be provided to teams who choose to keep their submissions private.\r\n\r\nWe are not responsible for entries that we do not receive for any reason, or for entries that we receive but are not decipherable for any reason. We will automatically disqualify any incomplete or illegible entries.\r\n\r\n<strong>Microsoft Azure Passes<\/strong>\r\n\r\nWe will make Microsoft Azure\u00a0Passes available to the first 150 teams that enter the Challenge and have indicated in their registration form that they wish to be considered to receive a Microsoft Azure Pass and meet the relevant eligibility criteria (including Microsoft verifying that your team\u2019s registration form is complete). A Microsoft Azure\u00a0Pass has an estimated total market value of $1,500 USD over three months and is limited to a $500 USD usage cap per month. Any additional cost, above this limit, will be charged to the relevant team lead in accordance with standard Microsoft Azure usage rates. Only teams affiliated with a university or nonprofit organization are eligible to receive a Microsoft Azure Pass. The award of Microsoft Azure\u00a0Passes is also subject to\u00a0the applicable <a href=\"https:\/\/azure.microsoft.com\/en-us\/offers\/azure-pass\/\" target=\"_blank\" rel=\"noopener noreferrer\">Azure Pass requirements<\/a>.\r\n<h3>Winner Selection<\/h3>\r\nAt the close of the Entry Period, the judges will select winning teams from eligible entries based upon the following criteria:\r\n<ol>\r\n \t<li>Innovativeness\/originality of the solution; and<\/li>\r\n \t<li>Overall performance on the Challenge tasks (i.e. game score); and<\/li>\r\n \t<li>Quality of code developed; and<\/li>\r\n \t<li>Public voting on GitHub (i.e. GitHub \u201cstars\u201d).<\/li>\r\n<\/ol>\r\nThe judges will give equal weighting to each of the above criteria.\r\n\r\nThe decisions of the judges are final and binding. If we do not receive a sufficient number of entries meeting the entry requirements, we may, at our discretion, select fewer winning teams than available prizes.\r\n\r\nIf any team member is a potential winner and is 18 years of age or older, but is considered a minor in their place of legal residence, we may require that person\u2019s parent or legal guardian to sign all required forms on their behalf. If that person does not complete the required forms as instructed and\/or return the required forms within the time period listed on the winner notification message, we may disqualify the relevant team and select a runner-up.\r\n\r\nIf your team is confirmed as a winner of the Challenge:\r\n<ul>\r\n \t<li>It may not designate someone else as the winner. If your team is unable or unwilling to accept its prize, we may award it to a runner-up; and<\/li>\r\n \t<li>Team members will be solely responsible for any taxes that may be payable in connection with the award of any prize.<\/li>\r\n<\/ul>\r\n<h3>Challenge Prizes<\/h3>\r\n<ul>\r\n \t<li><strong>Microsoft Research AI Summer School Placement<\/strong>\u2014Three teams will each be awarded a place at the Microsoft Research AI Summer School at Microsoft Research in Cambridge, UK, between July 3, 2017, and\u00a0July 6, 2017. Microsoft will reimburse the following reasonably and necessarily incurred travel expenses of team members in attending the AI Summer School: (1) public transport to and from Microsoft Research, Cambridge; and (2) economy class return airfares from your nearest airport to London (only if team members are located outside the UK). Microsoft will also provide accommodation and meals, except for one evening meal, during your placement.<\/li>\r\n \t<li><strong>Microsoft Azure for Research Grant\u2014<\/strong>Three teams will each win an Azure for Research grant with a maximum value of $20,000 USD. The Azure for Research grant will be awarded to the team lead nominated by the relevant team. Team leads will be solely responsible for allocation of the grant between the relevant team members. The award of a Microsoft Azure for Research grant will be subject to each team member agreeing to comply with such terms and conditions of use or other requirements that Microsoft may impose.<\/li>\r\n<\/ul>\r\n<h3>What other conditions is my team agreeing to by entering?<\/h3>\r\nBy entering the Challenge each team member agrees:\r\n<ul>\r\n \t<li>To abide by these Challenge Rules; and<\/li>\r\n \t<li>To release and hold harmless Microsoft and its respective parents, subsidiaries, affiliates, employees, and agents from any and all liability or any injury, loss, or damage of any kind arising from or in connection with the Challenge, or any prize won; and<\/li>\r\n \t<li>That decisions by Microsoft will be final and binding on all matters related to the Challenge; and<\/li>\r\n \t<li>That, by accepting a prize, Microsoft may use your team name, country of residence, and team photo online and in print, or in any other media, in connection with the Challenge, without payment or compensation to you, except where prohibited by law.<\/li>\r\n<\/ul>\r\n<h3>How will my team's entry be potentially used?<\/h3>\r\nExcept as set out below, we are not claiming any ownership rights to your team\u2019s entry. However, by submitting your entry, each team member: 1. Grants Microsoft an irrevocable, non-exclusive, royalty-free, worldwide right and license to: (i) use, review, assess, test, and otherwise analyze your entry and all its content in connection with the Challenge; and (ii) feature your entry and all content in connection with the marketing, sale, or promotion of the Challenge (including but not limited to internal and external sales meetings, conference presentations, tradeshows, and screen shots of the Challenge entry in press releases) in all media (now known or later developed); and 2. agrees to sign any necessary documentation that may be required for us and our designees to make use of the rights you granted above; and 3. understands and acknowledges that Microsoft may have developed or commissioned materials similar or identical to your team\u2019s submission and you waive any claims you may have resulting from any similarities to your entry; and 4. understands that we cannot control the incoming information you will disclose to our representatives in the course of entering, or what our representatives will remember about your entry. You also understand that we will not restrict work assignments of representatives who have had access to your entry. By entering the Challenge, you agree that use of information in our representatives\u2019 unaided memories in the development or deployment of our products or services does not create liability for us under this agreement or copyright or trade secret law; and 5. understands that you will not receive any compensation or credit for use of your entry, other than what is described in these Challenge Rules.\r\n\r\nIf your team does not want to grant us these rights to your entry, please do not enter the Challenge.\r\n<h3>What laws govern the way the Challenge is administered?<\/h3>\r\nThis Challenge is governed by the laws of England and Wales, and you consent to the exclusive jurisdiction and venue of the Courts of England and Wales for any disputes arising out of the Challenge.\r\n<h3>What if something unexpected happens and the Challenge can't run as planned?<\/h3>\r\nIf someone cheats, or a virus, bug, bot, catastrophic event, or any other unforeseen or unexpected event that cannot be reasonably anticipated or controlled (also referred to as force majeure), affects the fairness and\/or integrity of the Challenge, we reserve the right to cancel, change, or suspend the Challenge. This right is reserved whether the event is due to human or technical error. If a solution cannot be found to restore the integrity of the Challenge, we reserve the right to select winning teams from among all eligible entries received before we had to cancel, change, or suspend the Challenge.\r\n\r\nIf any team member attempts to, or we have strong reason to believe that a team member has, compromised the integrity or the legitimate operation of the Challenge by cheating, or through any other illegal, unlawful, or unfair activity, we may seek damages from that team member to the fullest extent permitted by law. Further, we may disqualify your team, and ban any team member from participating in any of our future Challenges, so please play fairly.\r\n<h3>Winner\u2019s List and Sponsor<\/h3>\r\nWe will notify winning teams by June 5, 2017. We will also post a leaderboard detailing the top 20 team entries online at <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/collaborative-ai-challenge\/\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/collaborative-ai-challenge\/<\/a>. Please note that we will only post team names and we will not post the names of any individual team members. This list will remain posted for a period of at least 12 calendar months.\r\n\r\nIf your team\u2019s entry is in a public repository we may also post a link to that repository. Please check your GitHub settings to ensure that this will not result in individual team members becoming identifiable, unless this is intended by the individual(s) in question.\r\n\r\nThis promotion is sponsored by Microsoft Research Limited, 21 Station Road, Cambridge, United Kingdom, CB1 2FB.\r\n<h3>Privacy Statement<\/h3>\r\nAt Microsoft, we are committed to protecting your privacy. Microsoft uses the information you provide to notify prize winners, and to send you information about other Microsoft products and services, if requested by you. Microsoft will not share the information you provide with third parties without your permission except where necessary to complete the services or transactions you have requested, or as required by law. Microsoft is committed to protecting the security of your personal information. We use a variety of security technologies and procedures to help protect your personal information from unauthorized access, use, or disclosure. Your personal information is never shared outside the company without your permission, except under conditions explained above.\r\n\r\nIf you believe that Microsoft has not adhered to this statement, please notify us by sending an email to <a href=\"mailto:MalmoAdm@microsoft.com\">MalmoAdm@microsoft.com<\/a> or postal mail to Malmo Collaborative AI Challenge, Microsoft Research Limited, 21 Station Road, Cambridge CB1 2FB, United Kingdom, and we will use commercially reasonable efforts to remedy the situation."},{"id":2,"name":"FAQs","content":"[accordion]\r\n\r\n[panel header=\"How do I register?\"]\r\n\r\nPlease complete the <a href=\"https:\/\/www.surveygizmo.com\/s3\/3299773\/The-Collaborative-AI-Challenge\" target=\"_blank\" rel=\"noopener noreferrer\">registration form<\/a>.\u00a0Before submitting your registration, you will need to set up a repository on GitHub because you will have to provide a valid link during the registration process.\r\n\r\nMake sure that your team\u2019s registration form is complete before submitting. Once submitted to Microsoft via your registration form, any changes to your GitHub repository and registration details will be accepted at the sole discretion of Microsoft.\u00a0[\/panel]\r\n\r\n[panel header=\"How should I submit my entry to the Challenge?\"] Your Challenge submission\u00a0will\u00a0be\u00a0the version of the code on your GitHub repository branch master at the time of the entry submission deadline. Your submission needs to contain code in working order and be accompanied by\u00a0a one-page description of your approach and a link to a one-to-three-minute video that shows off your agent. [\/panel]\r\n\r\n[panel header=\"Do I have to use the example code?\"] The example code is provided as an optional starting point, and you do not need to use it in your submission. However, note that the Challenge task definition cannot be changed.\u00a0[\/panel]\r\n\r\n[panel header=\"What platforms\/languages can I use?\"]Malmo clients can be run on Windows,\u00a0Linux, and Mac. We also provide ready-to-build\u00a0Docker images that can be run on any platform supported by docker.io. The Challenge has been developed around Python\u2014both 2.7 and &gt;= 3.4 are compatible.\u00a0\u00a0[\/panel]\r\n\r\n[panel header=\"Can I publish results of my experiments with the Malmo Collaborative AI Challenge?\"] Yes, we encourage academic publications relating to the Malmo Collaborative AI Challenge. If you do decide to publish results, please cite the Malmo Platform\u00a0as:\r\n\r\nJohnson M., Hofmann K., Hutton T., Bignell D. (2016)\u00a0<a href=\"http:\/\/www.ijcai.org\/Proceedings\/16\/Papers\/643.pdf\" target=\"_blank\" rel=\"noopener noreferrer\"><em>The Malmo Platform for Artificial Intelligence Experimentation<\/em><\/a>.\u00a0<a href=\"http:\/\/www.ijcai.org\/Proceedings\/2016\" target=\"_blank\" rel=\"noopener noreferrer\">Proc. 25th International Joint Conference on Artificial Intelligence<\/a>, Ed. Kambhampati S., p. 4246. AAAI Press, Palo Alto, California USA.\r\n\r\n[\/panel]\r\n\r\n[panel header=\"What can I win?\"]Microsoft is offering the following prizes: (1) three winning teams will be awarded placements at its AI Summer School at Microsoft Research Cambridge, UK, and (2) three winning teams will be awarded Microsoft Azure for Research grants with a maximum value of $20,000 USD. Please\u00a0read the\u00a0Challenge Rules\u00a0on this page for further details.\u00a0[\/panel]\r\n\r\n[panel header=\"Where can I get help?\"]You can direct administrative questions to <a href=\"mailto:MalmoAdm@microsoft.com\">MalmoAdm@microsoft.com<\/a>. For technical questions, we encourage you to use the <a href=\"https:\/\/gitter.im\/Microsoft\/malmo\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Malmo forum<\/a>. We endeavor to respond within two business days. [\/panel]\r\n\r\n[panel header=\"What is Microsoft Azure? \"]\r\n\r\n<a href=\"https:\/\/azure.microsoft.com\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Azure<\/a> is the Microsoft cloud computing service. Azure provides a wide range of services and supports a wide variety of popular platforms, tools and programming languages. It\u00a0is ideal for deep learning using GPUs and for running\u00a0machine learning models.\u00a0As part of the Malmo Collaborative AI Challenge we provide example code for running experiments using <a href=\"https:\/\/www.docker.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">Docker<\/a>\u00a0on Azure.\r\n\r\n[\/panel]\r\n\r\n[panel header=\"What is Microsoft Azure for Research?\"]\r\n\r\nThe <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/microsoft-azure-for-research\/\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Azure for Research program<\/a> awards cloud computing time, training, and resources for the purpose of conducting cloud-based research. Qualified applicants must be affiliated with a university or nonprofit research organization.\r\n\r\n[\/panel]\r\n\r\n[panel header=\"How do I get a free Microsoft Azure\u00a0Pass? \"]\r\n\r\nDuring registration, you\u2019ll be asked \u201cDo you want to use a FREE Microsoft Azure\u00a0Pass?\u201d If you choose \u201cYes,\u201d we will contact you within\u00a0two business days\u00a0to set this up. Note that these\u00a0passes are available only to the first 150 entries under the precondition that your team\u2019s registration form is complete and the terms and conditions stated in the Challenge Rules apply.\r\n\r\n[\/panel]\r\n\r\n[panel header=\"Which countries are in the EEA?\"]\r\n\r\nThe EEA (European Economic Area) includes EU countries and also Iceland, Liechtenstein, and Norway. The EU countries are: Austria, Belgium, Bulgaria, Croatia, Republic of Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, and the UK.\r\n\r\n[\/panel]\r\n\r\n[panel header=\"How can I sign up for the prizes?\"]\r\n\r\nDuring registration, you will be asked whether you wish to apply to win the respective prize. Please answer accordingly. Note that the AI Summer School prize is restricted to participants from EEA countries plus Switzerland and the Azure for Research Grant prize is restricted to participants who are affiliated with a university or nonprofit research organization. Please check the Challenge Rules tab on this page.\r\n\r\n[\/panel]\r\n\r\n[panel header=\"How will my submission be evaluated?\"]\r\n\r\nAt the close of the Entry Period, the judges will select winning teams from eligible entries based upon the following criteria:\r\n<ol>\r\n \t<li>Innovativeness\/originality of the solution; and<\/li>\r\n \t<li>Overall performance on the Challenge tasks (i.e. game score); and<\/li>\r\n \t<li>Quality of code developed; and<\/li>\r\n \t<li>Public voting on GitHub (i.e.\u00a0GitHub \u201cstars\u201d).<\/li>\r\n<\/ol>\r\nThe judges will give equal weighting to each of the above criteria. The judges will be employees of Microsoft Corporation or one of\u00a0its affiliated companies. For further details please check the Challenge Rules.\r\n\r\n[\/panel]\r\n\r\n[\/accordion]"},{"id":3,"name":"Challenge Team","content":"<h3>Meet the team behind the Malmo Collaborative AI Challenge<\/h3>\r\n<strong>Lead<\/strong>\r\n\r\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/kahofman\/\" target=\"_blank\" rel=\"noopener noreferrer\">Katja Hofmann<\/a>, Researcher, Microsoft Research Cambridge\r\n\r\n<strong>Development and design<\/strong>\r\n\r\nDavid Bignell, Engineer, Microsoft Research Cambridge\r\nGame development\r\n\r\nMorgan Funtowicz, Research Intern, Microsoft Research Cambridge\r\nGame development and technical support\r\n\r\nMichael Golembewski, Postdoctoral Researcher, Microsoft Research Cambridge\r\nScientific advisor\r\n\r\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/nkushman\/\" target=\"_blank\" rel=\"noopener noreferrer\">Nate Kushman<\/a>, Researcher, Microsoft Research Cambridge\r\nScientific advisor\r\n\r\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/cecilym\/\" target=\"_blank\" rel=\"noopener noreferrer\">Cecily Morrison<\/a>, Researcher, Microsoft Research Cambridge\r\nScientific advisor\r\n\r\n<strong>Program management<\/strong>\r\n\r\nNoburo Kuno, Senior Research Program Manager, Microsoft Research Redmond\r\n\r\n<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/scarlets\/\" target=\"_blank\" rel=\"noopener noreferrer\">Scarlet Schwiderski-Grosche<\/a>, Senior Research Program Manager, Microsoft Research Cambridge\r\n\r\n<strong>Support<\/strong>\r\n\r\nNeeltje Berger, Graphic Designer\r\nWebsite design and support\r\n\r\nSue Flanders, Program Coordinator, Microsoft Research Cambridge\r\nAdministrative support"},{"id":4,"name":"Leaderboard","content":"<table style=\"border-spacing: inherit;border-collapse: collapse;width: 100%;padding: 6px;text-align: center;border-bottom: 1px solid #000000\">\r\n<tbody>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border-bottom: 1px solid #000000\"><strong>Id<\/strong><\/td>\r\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>Team<\/strong><\/td>\r\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>Date<\/strong><\/td>\r\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>100k Mean<\/strong><\/td>\r\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>100k Var<\/strong><\/td>\r\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>100k Count<\/strong><\/td>\r\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>500k Mean<\/strong><\/td>\r\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>500k Var<\/strong><\/td>\r\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>500k Count<\/strong><\/td>\r\n<td style=\"padding: 8px;border-bottom: 1px solid #000000\"><strong>Experiment Name<\/strong><\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">18<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">The Danish Puppeteers<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/21\/2017 21:40<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2.18922663<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">70.03464<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">724<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2.43484855<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">73.86394<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">660<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">Guided Danish Puppet vs PigChase<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">26<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">HogRider<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 13:25<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1.74024224<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">59.3497543<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">743<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2.19602275<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">68.80533<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">704<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">HogRider<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">15<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">ParSys<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/19\/2017 23:22<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.75202155<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">58.50724<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">742<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2.11304355<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">65.8278046<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">690<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">E_AStar vs AStar (Final)<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">25<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">HogRider<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 13:01<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1.80218279<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">59.8067055<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">733<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2.03385043<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">65.08489<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">709<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">HogRiderA<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">33<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">HogRider<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 16:31<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2.41074252<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">71.5722046<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">633<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.89413452<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">61.5710526<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">699<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">HogRiderD<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">35<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">Bacon Gulch<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 21:14<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1.51408446<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">47.795578<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">568<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1.68065691<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">51.0969238<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">548<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">UCT_budget_1000_exploration_15.00<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">7<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">HogRider<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/18\/2017 5:55<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.373262<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">53.1045265<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">935<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.66896546<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">59.3731766<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">870<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My Exp 1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">14<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">ParSys<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/19\/2017 22:45<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1.4073199<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">51.9131927<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">847<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1.48886144<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">53.33651<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">808<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">E_AStar vs AStar<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">27<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">Bacon Gulch<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 13:35<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.49820149<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">46.9766159<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">556<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.35951138<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">43.8428268<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">573<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">UCT_budget_1000_exploration_40.00<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">39<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">Village People<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/23\/2017 13:34<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1.61760461<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">54.04858<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">693<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1.31812418<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">48.9089355<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">789<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">My Exp 1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">AASMA<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/2\/2017 13:08<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.917197466<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">38.05047<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">157<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.27745664<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">50.61666<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">173<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My Exp 1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">12<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">AASMA<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/19\/2017 7:38<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1.44220567<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">54.84475<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">943<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1.24795914<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">50.9089241<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">980<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">AASMA vs Astar<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">9<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">ParSys<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/18\/2017 15:09<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.08771932<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">47.42444<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1083<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1.19844353<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">49.4080925<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1028<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">Enhanced AStar Exp 2<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">8<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">ParSys<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/18\/2017 11:29<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">0.8790614<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">43.6099243<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1108<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1.137931<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">49.051857<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1044<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">Enhanced AStar Exp 1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">29<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">bacon-reloaded<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 14:15<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.851714551<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">3.481255<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2158<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.504816949<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">18.8357182<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">519<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My experiment 2<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">13<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">AASMA<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/19\/2017 8:06<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">0.5913793<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">36.46406<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1160<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">0.498736322<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">34.5852966<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1187<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">AASMA vs Default<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">21<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">bacon-reloaded<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 9:38<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.46981132<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">19.1773911<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">530<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.48<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">19.1562672<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">525<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My experiment 1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">34<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">bacon-reloaded<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 18:06<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">0.123076923<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">11.3489542<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">585<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">0.4163701<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">18.9120445<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">562<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">final<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">30<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">bacon-reloaded<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 15:41<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.02097902<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">8.57998<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">572<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.167293236<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">11.0453215<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">532<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My experiment 3<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">17<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">Pathfinder<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/20\/2017 18:51<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">0.134094149<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">15.4114056<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">701<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">0.159057438<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">15.2648335<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">679<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">Lapisjunkie<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">11<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">AutoMagico<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/18\/2017 19:58<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.151986182<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">12.3637743<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">579<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">0.090056285<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">8.100708<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">533<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">FirstExperiment2<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">19<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">Pathfinder<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 0:16<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.07680835<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">20.4437656<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1341<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">0.04491726<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">22.6559811<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1269<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">Final<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">24<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">HelloJason<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 11:07<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.374222726<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">15.3557177<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1769<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.159561515<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">20.3837967<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1642<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">HiDDeN Vs PigChaseChallenger 2<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">3<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">RoyalPuzzle<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/16\/2017 13:35<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.0854902<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">19.246809<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1275<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.213001385<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">16.5507584<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1446<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">qlearning100000Exp<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">16<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">RoyalPuzzle<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/20\/2017 14:26<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.5792812<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">9.593609<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1892<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.5305024<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">9.740696<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1672<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">q-learning<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">10<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">AutoMagico<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/18\/2017 18:52<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.66284287<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">7.78457928<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2005<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.7344951<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5.776765<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1951<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">FirstExperiment<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">CollaMind<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/17\/2017 21:50<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.7892399<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">4.68756437<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2026<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.777398944<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5.04397058<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2053<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My experiment 2<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">36<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">CollaMind<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 22:37<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.8674641<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2.66520929<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2090<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.7974867<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">4.530762<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2069<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">avg_failed!<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">6<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">CollaMind<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/17\/2017 22:17<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.8081485<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">4.131321<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1939<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.803180933<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">4.35291243<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2012<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">My experiment 3<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">4<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">CollaMind<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/17\/2017 21:21<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.7367647<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5.407178<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1360<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.81155616<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">3.65260458<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">1523<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">My experiment 1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">1<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">MSRC-Admin<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">4\/11\/2017 17:11<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.778490365<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">4.962774<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2027<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.8477952<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">3.23951745<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2109<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">Random vs Random<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">38<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">CollaMind<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 23:20<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.8102941<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">4.25665855<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2040<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.854942858<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2.751934<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2013<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">avg-greedy_failed!<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000;background-color: #dddddd\">37<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">CollaMind<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">5\/22\/2017 22:55<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.8169014<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">3.942677<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2059<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">-0.8649688<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2.66365027<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">2081<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000;background-color: #dddddd\">greedy_failed!<\/td>\r\n<\/tr>\r\n<tr>\r\n<td style=\"width: 5%;padding: 6px;border: 1px solid #000000\">20<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">HelloJason<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">5\/22\/2017 0:16<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.816409767<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">4.61498<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2206<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">-0.89<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2.77181315<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">2300<\/td>\r\n<td style=\"padding: 6px;border: 1px solid #000000\">HiDDeN Vs PigChaseChallenger<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>"}],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program\/346139"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-academic-program"}],"version-history":[{"count":5,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program\/346139\/revisions"}],"predecessor-version":[{"id":827260,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program\/346139\/revisions\/827260"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/346142"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=346139"}],"wp:term":[{"taxonomy":"msr-opportunity-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-opportunity-type?post=346139"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=346139"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=346139"},{"taxonomy":"msr-program-audience","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-program-audience?post=346139"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=346139"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}