\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n

Project LITMUS<\/h1>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n

LITMUS: L<\/strong>inguistically I<\/strong>nspired T<\/strong>raining and testing of MU<\/strong>ltilingual S<\/strong>ystems<\/h2>\n\n\n\n

Transformer-based Language Models have revolutionized the field of NLP and have shown great improvements in various benchmarks and are being used to power various NLP applications today. Multilingual versions of these models can also potentially serve many low-resource languages for which labeled data is not available by making use of the zer0-shot paradigm. However, there remain challenges associated with deploying such models, including the question of evaluating the models across a wide variety of languages which may not be present in standard evaluation benchmarks.<\/p>\n\n\n\n