{"id":6690,"date":"2019-02-04T14:30:22","date_gmt":"2019-02-04T22:30:22","guid":{"rendered":"http:\/\/www.microsoft.com\/garage-en-us\/?p=6690"},"modified":"2019-06-14T15:32:42","modified_gmt":"2019-06-14T22:32:42","slug":"garage-externs-from-mit-partner-with-the-met","status":"publish","type":"post","link":"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/","title":{"rendered":"Garage Externs from MIT collaborate with The Met to spark global connections to art using AI"},"content":{"rendered":"

To help celebrate the second anniversary of The Metropolitan Museum of Art\u2019s Open Access Program<\/a>, The Met teamed up with Microsoft engineers and MIT students and faculty to imagine new ways in which their encyclopedic collection could be explored by global audiences.<\/p>\n

\"The<\/p>\n

Chris Hoder speaking at December 2018 hackathon with The Met, MIT, and Microsoft<\/h5>\n

The collaboration started with a 2-day hackathon in December 2018 at The Garage in Microsoft\u2019s New England Research and Development (NERD) center. Microsoft researchers and creative technologists along with students and faculty from MIT\u2019s Open Learning and Knowledge Futures Group worked alongside a group of curatorial and digital department participants from The Met. At the hackathon, The Met provided a pre-release of their \u201csubject keywords\u201d dataset. The new dataset contains keywords about depicted subject matter and provides a new pathway into the museum\u2019s collection.<\/p>\n

Collaborators from MIT included Matthew Ritchie, the Dasha Zhukova Distinguished Visiting Artist at the MIT Center for Art, Science & Technology and computational neuroscientist Sarah Schwettmann from the MIT Department of Brain and Cognitive Sciences and the Knowledge Futures Group. Participants leveraged Microsoft\u2019s AI technologies and built custom models with Azure Machine Learning to parse, explore, and create prototype experiences<\/a>. At the heart of these multifaceted experiments is something Ritchie, a contemporary artist, explained so simply: \u201cMachine learning makes it possible to begin visualizing the diversity and complexity of artistic creation.\u201d<\/p>\n

On February 4th<\/sup> at a private event hosted at The Met, teams revealed five concepts from the hackathon brought to life as prototypes that connect and inspire a global audience using art and AI.<\/p>\n

\"Gen<\/p>\n

Gen Studio website experience<\/h5>\n

One experience showcased is Gen Studio<\/strong><\/a>, a project based on sophisticated generative adversarial networks (GANs) which allow users to explore, search, and even be immersed within the latent space between art pieces.<\/p>\n

Generist Maps, <\/em><\/strong>a component of the Gen Studio project, enables users to visually and creatively navigate the shared features and dimensions underlying 5,000+ years of human creation represented in The Met\u2019s collection.<\/p>\n

\u201cIt\u2019s an interactive map-like model showing how each piece of art relates \u2013 in both linear and unexpected ways \u2013 based on corresponding datasets and attributes like country, material, and keywords.\u201d Mark Hamilton, software engineer at NERD for cognitive services and co-manager of the project brought his deep learning research and applied AI background to the collaboration. In exploring the connections amongst different art pieces, the spaces between is where users can discover dreamlike images created by the AI. \u201cEach space corresponds to a full painting the network dreams up so you can take two paintings and discover what\u2019s between the space of those paintings. It\u2019s the researcher\u2019s job to figure out what\u2019s going on in the network\u2019s brain \u2013 and now you the user can explore the network as an artist in this map-concept.\u201d The project enlists the help of multiple Azure tools including Azure Kubernetes Services<\/a>, Azure Cognitive Services<\/a>, and Azure App Services<\/a>.<\/p>\n

Hamilton, alongside Microsoft colleague and program manager, Chris Hoder, mentored five MIT students who built a working prototype during their MIT externship with The Garage at NERD for the entire month of January.<\/p>\n

\u201cIt\u2019s been fun to work with everyone to get everything up and running, we\u2019ve moved very quickly to take ideas and implement them in hours instead of weeks.\u201d Hoder has been involved with The Garage at NERD since its\u00a0 opening last year and managing this collaborative project since the December hackathon event. \u201cThe prototype we built is such an intriguing and interesting experience that I\u2019ve found myself getting lost in and playing in it for hours.\u201d<\/p>\n

\"Screenshot<\/p>\n

Generist Maps website experience<\/h5>\n

Generative Explorations<\/em><\/strong>, the second component of the project, is a searchable web experience that uses Azure Search<\/a> with MML Spark<\/a> to make it easy to find specific art pieces. \u201cWe take all of The Met\u2019s data and add searchable fields so you can query based on properties like tags and medium.\u201d Alonso Salas Infante, sophomore at MIT interested in cyber security, was on point for the search experience. \u201cIn some cultures, the artist of the art piece doesn\u2019t matter, so, many pieces did not have authors. There are also differing labels. We had to find a balance between how much information we should make available to the user and what we shouldn\u2019t for the best experience.\u201d<\/p>\n

For some of The Garage externs, working with machine learning was a new experience. Elaine Zhang, junior at MIT, explained how the externship was her crash-course on neural networks and deep learning algorithms. \u201cGetting thrown headfirst into ML has been challenging but so rewarding. We didn\u2019t know what project we\u2019d be working on prior to accepting the externship, so this was a very cool project I did not expect.\u201d Zhang focused her efforts on the GAN, inputting data into the machine learning model to fine-tune the results.<\/p>\n

\"Photo<\/p>\n

MIT externs at The Garage. Left to right, top to bottom: Chris Templeman, Maria Guirguis, Mark Hamilton, Chris Hoder, Linda Thackeray, Alonso Salas Infante, Gillian Belton, Darius Bopp, Diana Nguyen, Elaine Zhang<\/h5>\n

Studying computer science at MIT and interested in game design and product development, Darius Bopp was responsible for much of the front-end including building the website infrastructure. \u201cI took a class on web development last semester so I\u2019m pretty new to it. That\u2019s where Chris [Hoder] helped me a lot, and the community here has been really supportive. Learning the project workflow from Microsoft\u2019s point of view was great and this is the first project I\u2019ve worked on where the stakeholder wasn\u2019t in the same room as me. We had a lot of autonomy in our day-to-day work.\u201d<\/p>\n

Gillian Belton, senior at MIT, drove the visual map-like exploration piece of the app. \u201cThe biggest reward for me was dealing with all the things on the back-end, setting up remote computers, using Azure. There\u2019s been three or four different frameworks I\u2019ve never seen before. Now I\u2019m able to go in and feel confident working with all these things. It made me realize I could pick up almost anything and do it.\u201d<\/p>\n

Diana Nguyen, a junior at MIT, previously interned with The Garage and worked on an exploratory HoloLens concept that was more under wraps. \u201cI\u2019m really happy to see something I worked on getting into the hands of potential customers and being shown at such a public venue. Seeing how these technologies can be applied here with art, has made me realize machine learning is something I would be interested to work on more.\u201d Nguyen\u2019s focus was integrating the backend ML with the website and deploying models on Azure, ensuring the site could call these models to create more images.<\/p>\n

Though currently still in the prototyping phase, the larger goal is to eventually release Generist Maps and Generative Explorations publicly and open-source much of the nuts and bolts of the project so developers can use the APIs in their own apps.<\/p>\n

Though Microsoft Garage has internship opportunities in many worldwide locations, the New England location sits in a unique area with an incredibly vibrant STEM ecosystem and student population. So much so, that more organizations from all over are reaching out to partner on hacking opportunities with not only Microsoft engineers, but students who bring fresh perspectives to tough problems. The MIT externship program is a lot like The Garage internship, students can explore the industry they are interested in working in, but a key difference is how long externships last \u2013 approximately 4 weeks rather than an entire semester. \u201cThough Microsoft has been participating in externships for a while, this is only the second year that we have brought externs into The Garage.\u201d Maria Guirguis, Garage Software Developer, engineer, and the industry sponsor of the January MIT externs, provided guidance and helped the students settle into their new digs at NERD.<\/p>\n

\"Collage<\/p>\n

Collage of paintings generated by the network<\/h5>\n

\u201cDefinitely one of the most fun experiences in my time at Microsoft.\u201d Mark Hamilton shares. \u201cI think The Garage really understands the importance of trying something, going out on a limb, it\u2019s been a great space to work in. And you know software development doesn\u2019t have to be a monolithic thing. All you really need is a few passionate people and interesting content to work with.\u201d Hamilton grew up in New York and visited The Met on numerous occasions. \u201cIt was amazing to be able to see behind the scenes. The people we worked with at The Met were very open and excited about this opportunity. And the externs never cease to amaze me with how fast they can pick things up and hit the ground running.\u201d<\/p>\n

Having all the right tools helps, as Chris Hoder explains. \u201cThis collaboration shows what you can do today with Azure and AI without needing a depth of data science and expertise. Azure and our AI tools can make it easier to apply this kind of technology to any project.\u201d<\/p>\n

Linda Thackeray, Director of The Garage, is excited to cultivate more partnerships both within and outside of Microsoft. \u201cHaving Mark and Chris embedded with the extern team and working so closely \u2013 they\u2019re literally right down the hall \u2013 has been fantastic. It was meant to be. And we\u2019re excited to see what comes next.\u201d<\/p>\n

Learn more about The Met, MIT and Microsoft hackathon and other projects<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

To help celebrate the second anniversary of The Metropolitan Museum of Art\u2019s Open Access Program, The Met teamed up with Microsoft engineers and MIT students and faculty to imagine new ways in which their encyclopedic collection could be explored by global audiences. Chris Hoder speaking at December 2018 hackathon with The Met, MIT, and Microsoft The collaboration started with a….<\/span><\/p>\n

CONTINUE READING \"Garage Externs from MIT collaborate with The Met to spark global connections to art using AI\"<\/span><\/a><\/p>","protected":false},"author":14,"featured_media":6701,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[6],"tags":[11,42,41,27,15,40],"class_list":["post-6690","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-hackathons","tag-ai","tag-cambridge","tag-garage-internship","tag-hackathon","tag-machine-learning","tag-nerd"],"acf":[],"yoast_head":"Garage Externs from MIT collaborate with The Met to spark global connections to art using AI | Microsoft Garage<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Garage Externs from MIT collaborate with The Met to spark global connections to art using AI | Microsoft Garage\" \/>\n<meta property=\"og:description\" content=\"To help celebrate the second anniversary of The Metropolitan Museum of Art\u2019s Open Access Program, The Met teamed up with Microsoft engineers and MIT students and faculty to imagine new ways in which their encyclopedic collection could be explored by global audiences. Chris Hoder speaking at December 2018 hackathon with The Met, MIT, and Microsoft The collaboration started with a....\" \/>\n<meta property=\"og:url\" content=\"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft Garage\" \/>\n<meta property=\"article:published_time\" content=\"2019-02-04T22:30:22+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-06-14T22:32:42+00:00\" \/>\n<meta property=\"og:image\" content=\"http://approjects.co.za/?big=en-us/garage\/wp-content\/uploads\/2019\/02\/MetMITExterns_group_279x157.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"279\" \/>\n\t<meta property=\"og:image:height\" content=\"157\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Meixia Huang\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@MSFTGarage\" \/>\n<meta name=\"twitter:site\" content=\"@MSFTGarage\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Meixia Huang\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/\",\"url\":\"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/\",\"name\":\"Garage Externs from MIT collaborate with The Met to spark global connections to art using AI | Microsoft Garage\",\"isPartOf\":{\"@id\":\"http://approjects.co.za/?big=en-us/garage\/#website\"},\"primaryImageOfPage\":{\"@id\":\"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/#primaryimage\"},\"image\":{\"@id\":\"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/#primaryimage\"},\"thumbnailUrl\":\"\/wp-content\/uploads\/2019\/02\/MetMITExterns_group_279x157.jpg\",\"datePublished\":\"2019-02-04T22:30:22+00:00\",\"dateModified\":\"2019-06-14T22:32:42+00:00\",\"author\":{\"@id\":\"http://approjects.co.za/?big=en-us/garage\/#\/schema\/person\/744bc20c9b6f354da52285115d0c58c1\"},\"breadcrumb\":{\"@id\":\"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/#primaryimage\",\"url\":\"\/wp-content\/uploads\/2019\/02\/MetMITExterns_group_279x157.jpg\",\"contentUrl\":\"\/wp-content\/uploads\/2019\/02\/MetMITExterns_group_279x157.jpg\",\"width\":279,\"height\":157},{\"@type\":\"BreadcrumbList\",\"@id\":\"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"http://approjects.co.za/?big=en-us/garage\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Garage Externs from MIT collaborate with The Met to spark global connections to art using AI\"}]},{\"@type\":\"WebSite\",\"@id\":\"http://approjects.co.za/?big=en-us/garage\/#website\",\"url\":\"http://approjects.co.za/?big=en-us/garage\/\",\"name\":\"Microsoft Garage\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"http://approjects.co.za/?big=en-us/garage\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"http://approjects.co.za/?big=en-us/garage\/#\/schema\/person\/744bc20c9b6f354da52285115d0c58c1\",\"name\":\"Meixia Huang\",\"url\":\"http://approjects.co.za/?big=en-us/garage\/blog\/author\/meixia\/\"}]}<\/script>","yoast_head_json":{"title":"Garage Externs from MIT collaborate with The Met to spark global connections to art using AI | Microsoft Garage","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/","og_locale":"en_US","og_type":"article","og_title":"Garage Externs from MIT collaborate with The Met to spark global connections to art using AI | Microsoft Garage","og_description":"To help celebrate the second anniversary of The Metropolitan Museum of Art\u2019s Open Access Program, The Met teamed up with Microsoft engineers and MIT students and faculty to imagine new ways in which their encyclopedic collection could be explored by global audiences. Chris Hoder speaking at December 2018 hackathon with The Met, MIT, and Microsoft The collaboration started with a....","og_url":"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/","og_site_name":"Microsoft Garage","article_published_time":"2019-02-04T22:30:22+00:00","article_modified_time":"2019-06-14T22:32:42+00:00","og_image":[{"width":279,"height":157,"url":"http://approjects.co.za/?big=en-us/garage\/wp-content\/uploads\/2019\/02\/MetMITExterns_group_279x157.jpg","type":"image\/jpeg"}],"author":"Meixia Huang","twitter_card":"summary_large_image","twitter_creator":"@MSFTGarage","twitter_site":"@MSFTGarage","twitter_misc":{"Written by":"Meixia Huang","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/","url":"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/","name":"Garage Externs from MIT collaborate with The Met to spark global connections to art using AI | Microsoft Garage","isPartOf":{"@id":"http://approjects.co.za/?big=en-us/garage\/#website"},"primaryImageOfPage":{"@id":"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/#primaryimage"},"image":{"@id":"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/#primaryimage"},"thumbnailUrl":"\/wp-content\/uploads\/2019\/02\/MetMITExterns_group_279x157.jpg","datePublished":"2019-02-04T22:30:22+00:00","dateModified":"2019-06-14T22:32:42+00:00","author":{"@id":"http://approjects.co.za/?big=en-us/garage\/#\/schema\/person\/744bc20c9b6f354da52285115d0c58c1"},"breadcrumb":{"@id":"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/#primaryimage","url":"\/wp-content\/uploads\/2019\/02\/MetMITExterns_group_279x157.jpg","contentUrl":"\/wp-content\/uploads\/2019\/02\/MetMITExterns_group_279x157.jpg","width":279,"height":157},{"@type":"BreadcrumbList","@id":"http://approjects.co.za/?big=en-us/garage\/blog\/2019\/02\/garage-externs-from-mit-partner-with-the-met\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"http://approjects.co.za/?big=en-us/garage\/"},{"@type":"ListItem","position":2,"name":"Garage Externs from MIT collaborate with The Met to spark global connections to art using AI"}]},{"@type":"WebSite","@id":"http://approjects.co.za/?big=en-us/garage\/#website","url":"http://approjects.co.za/?big=en-us/garage\/","name":"Microsoft Garage","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"http://approjects.co.za/?big=en-us/garage\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"http://approjects.co.za/?big=en-us/garage\/#\/schema\/person\/744bc20c9b6f354da52285115d0c58c1","name":"Meixia Huang","url":"http://approjects.co.za/?big=en-us/garage\/blog\/author\/meixia\/"}]}},"_links":{"self":[{"href":"http://approjects.co.za/?big=en-us/garage\/wp-json\/wp\/v2\/posts\/6690"}],"collection":[{"href":"http://approjects.co.za/?big=en-us/garage\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http://approjects.co.za/?big=en-us/garage\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http://approjects.co.za/?big=en-us/garage\/wp-json\/wp\/v2\/users\/14"}],"replies":[{"embeddable":true,"href":"http://approjects.co.za/?big=en-us/garage\/wp-json\/wp\/v2\/comments?post=6690"}],"version-history":[{"count":0,"href":"http://approjects.co.za/?big=en-us/garage\/wp-json\/wp\/v2\/posts\/6690\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http://approjects.co.za/?big=en-us/garage\/wp-json\/wp\/v2\/media\/6701"}],"wp:attachment":[{"href":"http://approjects.co.za/?big=en-us/garage\/wp-json\/wp\/v2\/media?parent=6690"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http://approjects.co.za/?big=en-us/garage\/wp-json\/wp\/v2\/categories?post=6690"},{"taxonomy":"post_tag","embeddable":true,"href":"http://approjects.co.za/?big=en-us/garage\/wp-json\/wp\/v2\/tags?post=6690"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}