{"id":665574,"date":"2020-06-11T13:50:41","date_gmt":"2020-06-11T20:50:41","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-academic-program&p=665574"},"modified":"2023-10-04T13:32:55","modified_gmt":"2023-10-04T20:32:55","slug":"diagnostic-questions","status":"publish","type":"msr-academic-program","link":"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/diagnostic-questions\/","title":{"rendered":"Diagnostic Questions: Predicting Student Responses and Measuring Question Quality"},"content":{"rendered":"\n\n

<\/p>\n\n\n\n\n\n\n

Important Dates:<\/strong>
\nJuly 15, 2020<\/span>: Tasks released
\nOctober 23, 2020<\/span>: Final submission deadline for all tasks
\nNovember 15, 2020<\/span>: Final competition results announced<\/p>\n

Contact:<\/strong> edu_competition@outlook.com<\/a><\/p>\n

Digital technologies are becoming increasingly prevalent in education, enabling personalized, high quality education resources to be accessible by students across the world. Importantly, among these resources are diagnostic questions: the answers that the students give to these questions reveal key information about the specific nature of misconceptions that the students may hold.<\/p>\n

Analyzing the massive quantities of data stemming from students\u2019 interactions with these diagnostic questions can help us more accurately understand the students\u2019 learning status and thus allow us to automate learning curriculum recommendations. In this competition, participants will focus on the students\u2019 answer records to these multiple-choice diagnostic questions, with the aim of 1) accurately predicting which answers the students provide; 2) accurately predict which questions have high quality; and 3) determine a personalized sequence of questions for each student that best predicts the student\u2019s answers. These tasks closely mimic the goals of a real-world educational platform and are highly representative of the educational challenges faced today. We provide data from the last school year (2018-2019) of students\u2019 answers to mathematics questions from Eedi, a leading educational platform which millions of students interact with daily around the globe. Successful competition entrants have the potential to make a lasting, real-world impact on the quality of personalized education for millions of students across the world.<\/p>\n

Calls<\/h2>\n

The competition is now open on CodaLab<\/a>!<\/p>\n

\n\t
\n\t\tGo to competition\t<\/a><\/p><\/div>\n\n\n\n\n\n

Simon Woodhead, Eedi
\nCraig Barton, Eedi
\nJos\u00e9 Miguel Hern\u00e1ndez-Lobato, University of Cambridge
\nRichard Turner, University of Cambridge
\nJack Wang, Rice University
\nRichard G. Baraniuk, Rice University
\n
Angus Lamb<\/a>, Microsoft Research
\nEvgeny Saveliev, Microsoft Research
\n
Pashmina Cameron<\/a>, Microsoft Research
\n
Yordan Zaykov<\/a>, Microsoft Research
\n
Simon Peyton-Jones<\/a>, Microsoft Research
\n
Cheng Zhang<\/a>, Microsoft Research<\/p>\n\n\n\n\n\n

Competition Prizes<\/h2>\n

Microsoft and Eedi will provide more than $5,000 cash prize in total for the competition. There will be $1,000 prizes awarded to the winning team for each task. In addition, a $1,000 prize for the overall winner across all tasks will be awarded, as determined by the team’s average rank across each competition task (smallest average rank wins). If a team hasn’t submitted a working solution to a particular task, their rank for that task will be considered to be equal to the number of entrants across all tasks in total.<\/p>\n

In the event of a tie, this prize will be split evenly between the tied teams.<\/p>\n

Restriction of eligibility for the prize may apply. More information to come.<\/p>\n

Azure Cloud Computating Credits<\/h2>\n

Microsoft made available 50 grants of $250 Azure cloud computing credits to students participating in the contest. Students are not required to use Azure to compete. Please fill in the application form here to apply. The credits will be allocated to the first 50 valid applications.<\/p>\n\n\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"footnotes":""},"msr-opportunity-type":[187426],"msr-region":[256048],"msr-locale":[268875],"msr-program-audience":[243724],"msr-impact-theme":[],"class_list":["post-665574","msr-academic-program","type-msr-academic-program","status-publish","hentry","msr-opportunity-type-challenges","msr-region-global","msr-locale-en_us","msr-program-audience-students"],"msr_description":"","msr_social_media":[],"related-researchers":[],"tab-content":[{"id":0,"name":"Overview","content":"Digital technologies are becoming increasingly prevalent in education, enabling personalized, high quality education resources to be accessible by students across the world. Importantly, among these resources are diagnostic questions: the answers that the students give to these questions reveal key information about the specific nature of misconceptions that the students may hold.\r\n\r\nAnalyzing the massive quantities of data stemming from students\u2019 interactions with these diagnostic questions can help us more accurately understand the students\u2019 learning status and thus allow us to automate learning curriculum recommendations. In this competition, participants will focus on the students\u2019 answer records to these multiple-choice diagnostic questions, with the aim of 1) accurately predicting which answers the students provide; 2) accurately predict which questions have high quality; and 3) determine a personalized sequence of questions for each student that best predicts the student\u2019s answers. These tasks closely mimic the goals of a real-world educational platform and are highly representative of the educational challenges faced today. We provide data from the last school year (2018-2019) of students\u2019 answers to mathematics questions from Eedi, a leading educational platform which millions of students interact with daily around the globe. Successful competition entrants have the potential to make a lasting, real-world impact on the quality of personalized education for millions of students across the world.\r\n

Calls<\/h2>\r\nThe competition is now open on CodaLab<\/a>!\r\n
[msr-button text=\"Go to competition\" url=\"https:\/\/competitions.codalab.org\/competitions\/25449\" new-window=\"true\" ]<\/div>"},{"id":1,"name":"Organizers","content":"Simon Woodhead, Eedi\r\nCraig Barton, Eedi\r\nJos\u00e9 Miguel Hern\u00e1ndez-Lobato, University of Cambridge\r\nRichard Turner, University of Cambridge\r\nJack Wang, Rice University\r\nRichard G. Baraniuk, Rice University\r\nAngus Lamb<\/a>, Microsoft Research\r\nEvgeny Saveliev, Microsoft Research\r\nPashmina Cameron<\/a>, Microsoft Research\r\nYordan Zaykov<\/a>, Microsoft Research\r\nSimon Peyton-Jones<\/a>, Microsoft Research\r\nCheng Zhang<\/a>, Microsoft Research"},{"id":2,"name":"Prizes and support","content":"

Competition Prizes<\/h2>\r\nMicrosoft and Eedi will provide more than $5,000 cash prize in total for the competition. There will be $1,000 prizes awarded to the winning team for each task. In addition, a $1,000 prize for the overall winner across all tasks will be awarded, as determined by the team's average rank across each competition task (smallest average rank wins). If a team hasn't submitted a working solution to a particular task, their rank for that task will be considered to be equal to the number of entrants across all tasks in total.\r\n\r\nIn the event of a tie, this prize will be split evenly between the tied teams.\r\n\r\nRestriction of eligibility for the prize may apply. More information to come.\r\n

Azure Cloud Computating Credits<\/h2>\r\nMicrosoft made available 50 grants of $250 Azure cloud computing credits to students participating in the contest. Students are not required to use Azure to compete. Please fill in the application form here to apply. The credits will be allocated to the first 50 valid applications."}],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program\/665574"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-academic-program"}],"version-history":[{"count":7,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program\/665574\/revisions"}],"predecessor-version":[{"id":972903,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program\/665574\/revisions\/972903"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=665574"}],"wp:term":[{"taxonomy":"msr-opportunity-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-opportunity-type?post=665574"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=665574"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=665574"},{"taxonomy":"msr-program-audience","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-program-audience?post=665574"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=665574"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}