The INTERSPEECH 2022 (opens in new tab)<\/span><\/a> Audio Deep Packet Loss Concealment Challenge is intended to stimulate research in the area of\u202fAudio Packet Loss Concealment\u202f(PLC).<\/p>\n\n\n\n The training and validation dataset has now been released: microsoft\/PLC-Challenge (opens in new tab)<\/span><\/a> \u2013 additional info can be found in the draft challenge paper (opens in new tab)<\/span><\/a><\/strong><\/p>\n\n\n\n PLC is an important part of audio telecommunications technology and codec development, and methods for performing PLC using machine learning approaches are now becoming viable for practical use.\u202fPacket loss, either by missing packets or high packet jitter, is one of the top reasons for speech quality degradation in Voice over IP calls.<\/p>\n\n\n\n While there have been some groups publishing in this area,\u202fa lack of common datasets and evaluation procedures complicates the comparison of\u202fproposed methods\u202fand the establishment of clear baselines. With this challenge, we propose to address this situation: We will open source a dataset based on real-world (as opposed to the\u202fcommon\u202fsynthetic) packet loss traces and bring the community together to, for the first time,\u202fcompare approaches in this field on a unified test set.<\/p>\n\n\n\n As the gold standard for audio quality evaluation is\u202fhuman\u202fevaluator\u202fratings,\u202fwe\u202fwill\u202fevaluate submissions using a crowd-source ITU-T\u202fP.808\u202fCCR\u202fapproach. The\u202ftop three\u202fapproaches\u202fwhich achieve the\u202fhighest\u202faverage Mean Opinion Score\u202fon the blind set\u202fwill be declared the winners\u202fof the\u202fINTERSPEECH 2022 Audio Deep Packet Loss Concealment Challenge.\u202fAs an additional metric, to ensure that approaches are not degrading intelligibility, we will use the\u202fspeech recognition rate, calculated\u202fusing the Microsoft Cognitive Services Speech Recognition Service.<\/p>\n\n\n\n To help participants during the challenge, we will provide\u202fparticipants with access to our prototype \u201cPLC-MOS\u201d neural network model that provides estimates of human ratings of audio files with healed packet losses.<\/p>\n\n\n\n To register for the challenge,\u202fplease register on the Challenge CMT (opens in new tab)<\/span><\/a> site where they can then submit the enhanced clips. To get access to the PLC-MOS service, please fill out the registration form (opens in new tab)<\/span><\/a>. All communication will be done via CMT for the challenge, including challenge updates and results.<\/p>\n\n\n\n Please use the Microsoft Conference Management Toolkit (opens in new tab)<\/span><\/a> for submitting the results. After logging in, complete the following steps to submit the results:<\/p>\n\n\n\n Submission deadline<\/b>:<\/strong> March 8, 2022, 11:59 PM (anywhere on earth)<\/p>\n\n\n\n Contact us: <\/strong>For questions, please contact plc_challenge@microsoft.com<\/a><\/p>\n\n\n\n\n\n These Official Rules (\u201cRules\u201d) govern the operation of the Microsoft M365 Core INTERSPEECH 2022 PLC (see overview) Event Contest (\u201cContest\u201d). Microsoft Corporation, One Microsoft Way, Redmond, WA, 98052, USA, is the Contest sponsor (\u201cSponsor\u201d).<\/p>\n\n\n\n In these Rules, \u201cMicrosoft\u201d, \u201cwe\u201d, \u201cour\u201d, and \u201cus\u201d, refer to Sponsor and \u201cyou\u201d and \u201cyourself\u201d refers to a Contest participant, or the parent\/legal guardian of any Contest entrant who has not reached the age of majority to contractually obligate themselves in their legal place of residence. \u201cEvent\u201d refers to the INTERSPEECH 2022 PLC (see overview) event held in Incheon, Korea (the \u201cEvent\u201d). By entering you (your parent\/legal guardian if you are not the age of majority in your legal place of residence) agree to be bound by these Rules.<\/p>\n\n\n\n The Contest will operate from January 19, 2021 to March 8, 2022 (\u201cEntry Period\u201d). The Entry Period is divided into several periods as described in section How to Enter.<\/p>\n\n\n\n Open to any registered Event attendee 18 years of age or older. If you are 18 years of age or older but have not reached the age of majority in your legal place of residence, then you must have consent of a parent\/legal guardian. Employees and directors of Microsoft Corporation and its subsidiaries, affiliates, advertising agencies, and Contest Parties are not eligible, nor are persons involved in the execution or administration of this promotion, or the family members of each above (parents, children, siblings, spouse\/domestic partners, or individuals residing in the same household). Void in Cuba, Iran, North Korea, Sudan, Syria, Region of Crimea, and where prohibited. For business\/tradeshow events: If you are attending the Event in your capacity as an employee, it is your sole responsibility to comply with your employer\u2019s gift policies. Microsoft will not be party to any disputes or actions related to this matter.<\/p>\n\n\n\n PLEASE NOTE: If you are a public sector employee (government and education), all prize awards will be awarded directly to your public sector organization and subject to receipt of a gift letter signed by your agency\/institution\u2019s ethics officer, attorney, or designated executive\/officer responsible for your organization\u2019s gifts\/ethics policy. Microsoft seeks to ensure that by offering items of value at no charge in promotional settings it does not create any violation of the letter or spirit of the entrant\u2019s applicable gifts and ethics rules.<\/p>\n\n\n\n The Contest Objective is to promote collaborative research in real-time single-channel Speech Enhancement aimed to maximize the subjective (perceptual) quality of the enhanced speech. Prizes will be awarded based on the speech quality of PLC models using the online subjective evaluation framework ITU-T P.808. Only models described in accepted INTERSPEECH 2022 papers will be eligible for prizes. See (yet to upload the paper) for additional Contest details. You may participate as an individual or a team. If forming a team, you must designate a \u201cTeam Captain\u201d who will submit all entry materials on behalf of the team and act as the recipient of any prizes that the team may win. Once you register as part of a Team, you cannot change Teams or alter your current team (either by adding or removing members) after the submission of your Entry. Limit one Entry per person and per team. You may not compete on multiple teams and you may not enter individually and on a team. We are not responsible for Entries that we do not receive for any reason, or for Entries that we receive but are not decipherable or not functional for any reason. Each Team is solely responsible for its own cooperation and teamwork. In no event will Microsoft officiate in any dispute regarding the conduct or cooperation of any Team or its members. The Contest will operate as follows: Registration \/ Development Period: January 19 2022\u2013 March 8, 2022. To register, please send an email to plc_challenge@microsoft.com<\/a> stating that you are interested to participate in the challenge. Please include the following details in your email:<\/p>\n\n\n\n Then i. develop a speech enhancement model that best meets the Contest Objective as described more fully below and ii. submit a paper to INTERSPEECH 2022 which reports the computational complexity of the model in terms of the number of parameters and the time it takes to infer a frame on a particular CPU (preferably Intel Core i5 quad core machine clocked at 2.4 GHz). To develop your model, use any publicly available dataset for training data, including the Contest datasets provided for training and developing models. You may augment your datasets with the Contest dataset. You can augment your data in any way that improves the performance of your model.<\/p>\n\n\n\n The final evaluation will be conducted on a blind test set that is similar to the open sourced test set. On March 1, 2022, the blind test dataset will be made available. You will have until 23:59 AoE on March 8 to test your model against this dataset and create a set of enhanced clips to submit for judging (your \u201cEntry\u201d).<\/p>\n\n\n\n The rules of the challenge are as follows:<\/p>\n\n\n\n INTERSPEECH 2022 Paper Submission and Judging Period: Until 11:59 PM anywhere-on-earth March 21, 2022 Your Entry must be described in a paper accepted by INTERSPEECH 2022. To submit a paper, visit INTERSPEECH 2022 (opens in new tab)<\/span><\/a> .<\/p>\n\n\n\n The entry limit is one per person during the Entry Period. Any attempt by any you to obtain more than the stated number of entries by using multiple\/different accounts, identities, registrations, logins, or any other methods will void your entries and you may be disqualified. Use of any automated system to participate is prohibited. We are not responsible for excess, lost, late, or incomplete entries. If disputed, entries will be deemed submitted by the \u201cauthorized account holder\u201d of the email address, social media account, or other method used to enter. The \u201cauthorized account holder\u201d is the natural person assigned to an email address by an internet or online service provider, or other organization responsible for assigning email addresses.<\/p>\n\n\n\n To be eligible, an entry must meet the following content\/technical requirements:<\/p>\n\n\n\n We are not claiming ownership rights to your Submission. However, by submitting an entry, you grant us an irrevocable, royalty-free, worldwide right and license to use, review, assess, test and otherwise analyze your entry and all its content in connection with this Contest and use your entry in any media whatsoever now known or later invented for any non-commercial or commercial purpose, including, but not limited to, the marketing, sale or promotion of Microsoft products or services, without further permission from you. You will not receive any compensation or credit for use of your entry, other than what is described in these Official Rules. By entering you acknowledge that the we may have developed or commissioned materials similar or identical to your entry and you waive any claims resulting from any similarities to your entry. Further you understand that we will not restrict work assignments of representatives who have had access to your entry and you agree that use of information in our representatives\u2019 unaided memories in the development or deployment of our products or services does not create liability for us under this agreement or copyright or trade secret law. Your entry may be posted on a public website. We are not responsible for any unauthorized use of your entry by visitors to this website. We are not obligated to use your entry for any purpose, even if it has been selected as a winning entry.<\/p>\n\n\n\n Pending confirmation of eligibility, potential prize winners will be selected by Microsoft or their Agent or a qualified judging panel from among all eligible entries received based on the following judging criteria:<\/p>\n\n\n\n Winners will be selected and notified within 7 days following the event. In the event of a tie between any eligible entries, an additional judge will break the tie based on the judging criteria described above. The decisions of the judges are final and binding. If public vote determines winners, it is prohibited for any person to obtain votes by any fraudulent or inappropriate means, including offering prizes or other inducements in exchange for votes, automated programs or fraudulent ID\u2019s. Microsoft will void any questionable votes. Winners will be notified via the contact information provided during entry.<\/p>\n\n\n\n The odds of winning are based on the number and quality of eligible entries received.<\/p>\n\n\n\n To the extent allowed by law, by entering you agree to release and hold harmless Microsoft and its respective parents, partners, subsidiaries, affiliates, employees, and agents from any and all liability or any injury, loss, or damage of any kind arising in connection with this Contest or any prize won. All local laws apply. The decisions of Microsoft are final and binding. We reserve the right to cancel, change, or suspend this Contest for any reason, including cheating, technology failure, catastrophe, war, or any other unforeseen or unexpected event that affects the integrity of this Contest, whether human or mechanical. If the integrity of the Contest cannot be restored, we may select winners from among all eligible entries received before we had to cancel, change or suspend the Contest. If you attempt or we have strong reason to believe that you have compromised the integrity or the legitimate operation of this Contest by cheating, hacking, creating a bot or other automated program, or by committing fraud in any way, we may seek damages from you to the full extent of the law and you may be banned from participation in future Microsoft promotions.<\/p>\n\n\n\n This Contest will be governed by the laws of the State of Washington, and you consent to the exclusive jurisdiction and venue of the courts of the State of Washington for any disputes arising out of this Contest.<\/p>\n\n\n\n Send an email to plc_challenge@microsoft.com<\/a> with the subject line \u201cINTERSPEECH 2022 PLC winners\u201d to receive a list of winners.<\/p>\n\n\n\n At Microsoft, we are committed to protecting your privacy. Microsoft uses the information you provide on this form to notify you of important information about our products, upgrades and enhancements, and to send you information about other Microsoft products and services. Microsoft will not share the information you provide with third parties without your permission except where necessary to complete the services or transactions you have requested, or as required by law. Microsoft is committed to protecting the security of your personal information. We use a variety of security technologies and procedures to help protect your personal information from unauthorized access, use, or disclosure. Your personal information is never shared outside the company without your permission, except under conditions explained above.<\/p>\n\n\n\n If you believe that Microsoft has not adhered to this statement, please contact Microsoft by sending an email to privrc@microsoft.com<\/a> or postal mail to Microsoft Privacy Response Center, Microsoft Corporation, One Microsoft Way, Redmond, WA 98052<\/p>\n\n\n\n\n\n All results obtained on challenge blind set (microsoft\/PLC-Challenge (opens in new tab)<\/span><\/a>), higher is better for all metrics.<\/p>\n\n\n\nRegistration procedure<\/h3>\n\n\n\n
Submission instructions<\/h3>\n\n\n\n
\n
Official rules<\/h2>\n\n\n\n
Sponsor<\/h3>\n\n\n\n
Definitions<\/h3>\n\n\n\n
Entry period<\/h3>\n\n\n\n
Eligibility<\/h3>\n\n\n\n
How to enter<\/h3>\n\n\n\n
\n
\n
Eligible entry<\/h3>\n\n\n\n
\n
Use of entries<\/h3>\n\n\n\n
Winner selection and notification<\/h3>\n\n\n\n
\n
Odds<\/h3>\n\n\n\n
General conditions and release of liability<\/h3>\n\n\n\n
Governing law<\/h3>\n\n\n\n
Winners list<\/h3>\n\n\n\n
Privacy<\/h3>\n\n\n\n
Program timeline<\/h2>\n\n\n\n
\n
Organizers<\/h2>\n\n\n\n
\n
Related links<\/h2>\n\n\n\n
\n
Other challenges<\/h3>\n\n\n\n
\n
Eligible models<\/h3>\n\n\n\n
![\"Pairwise](\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2022\/07\/image.png\")
<\/figure>\n\n\n\n