GeNeVA – Datasets<\/strong><\/h3>\nFor re-creating the CoDraw and i-CLEVR datasets used for the GeNeVA task, you will have to download the data files and then run the dataset generation code as shown in the following links:<\/p>\n
\n\t\n\t\tDownload the GeNeVA Data Files\t<\/a>\n\n\t \n\t\n\t\tGeNeVA Datasets - Generation Code\t<\/a>\n\n\t<\/p>\n
\nGeNeVA – Pre-trained Models<\/strong><\/h3>\nThe pre-trained models for the object detector and localizer model that we used for evaluating the metrics can be downloaded from the following links:<\/p>\n
\n\t\n\t\tCoDraw Object Detector and Localizer\t<\/a>\n\n\t \n\t\n\t\ti-CLEVR Object Detector and Localizer\t<\/a>\n\n\t<\/p>\n
\nGeNeVA – Training and Evaluation Code<\/strong><\/h3>\nCode to train and evaluate the GeNeVA-GAN model for the GeNeVA task can be obtained from the following link:<\/p>\n\n\t\n\t\tGeNeVA - Training and Evaluation Code\t<\/a>\n\n\t\n
\nReference<\/strong><\/h3>\nIf you use the GeNeVA task, code, or datasets as part of any published research, please cite the following paper:<\/p>\n
Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, and Graham W. Taylor.\u00a0“Tell, Draw, and Repeat: Generating and modifying images based on continual linguistic instruction”.\u00a0Proceedings of the IEEE International Conference on Computer Vision (ICCV)<\/em>. 2019.<\/p>\n@InProceedings{El-Nouby_2019_ICCV,\r\n author = {El{-}Nouby, Alaaeldin and\r\n Sharma, Shikhar and\r\n Schulz, Hannes and\r\n Hjelm, Devon and\r\n El Asri, Layla and\r\n Ebrahimi Kahou, Samira and\r\n Bengio, Yoshua and\r\n Taylor, Graham W.},\r\n title = {Tell, Draw, and Repeat: Generating and modifying images based on continual linguistic instruction},\r\n booktitle = {The IEEE International Conference on Computer Vision (ICCV)},\r\n month = {Oct},\r\n year = {2019}\r\n}<\/code><\/pre>\n
\n","protected":false},"excerpt":{"rendered":"The Generative Neural Visual Artist (GeNeVA) task The GeNeVA task involves a Teller giving a sequence of linguistic instructions to a Drawer for the ultimate goal of image generation. The Teller is able to gauge progress through visual feedback of the generated image. This is a challenging task because the Drawer needs to learn how […]<\/p>\n","protected":false},"featured_media":587743,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556,13562,13554],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-585388","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-computer-vision","msr-research-area-human-computer-interaction","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[585919,556554],"related-downloads":[586126,610173],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Shikhar Sharma","user_id":36557,"people_section":"Section name 1","alias":"shsh"},{"type":"user_nicename","display_name":"Hannes Schulz","user_id":37188,"people_section":"Section name 1","alias":"haschulz"},{"type":"guest","display_name":"Alaaeldin El-Nouby","user_id":585409,"people_section":"Section name 1","alias":""},{"type":"guest","display_name":"Layla El Asri","user_id":604137,"people_section":"Section name 1","alias":""},{"type":"guest","display_name":"Samira Ebrahimi Kahou","user_id":585412,"people_section":"Section name 1","alias":""},{"type":"guest","display_name":"Yoshua Bengio","user_id":585415,"people_section":"Section name 1","alias":""},{"type":"guest","display_name":"Graham Taylor","user_id":585418,"people_section":"Section name 1","alias":""}],"msr_research_lab":[437514],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/585388"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":60,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/585388\/revisions"}],"predecessor-version":[{"id":610155,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/585388\/revisions\/610155"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/587743"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=585388"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=585388"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=585388"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=585388"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=585388"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"The](\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/05\/GeNeVA-task.png\")
<\/p>\n![\"Example](\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/05\/GeNeVA-codraw-i-clevr-examples.png\")
<\/p>\n