{"id":596833,"date":"2019-07-12T08:58:37","date_gmt":"2019-07-12T15:58:37","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=596833"},"modified":"2019-07-19T07:10:24","modified_gmt":"2019-07-19T14:10:24","slug":"leveraging-blockchain-to-make-machine-learning-models-more-accessible","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/leveraging-blockchain-to-make-machine-learning-models-more-accessible\/","title":{"rendered":"Leveraging blockchain to make machine learning models more accessible"},"content":{"rendered":"

\"\"<\/a>Significant advances are being made in artificial intelligence, but accessing and taking advantage of the machine learning systems making these developments possible can be challenging, especially for those with limited resources. These systems tend to be highly centralized, their predictions are often sold on a per-query basis, and the datasets required to train them are generally proprietary and expensive to create on their own. Additionally, published models run the risk of becoming outdated if new data isn\u2019t regularly provided to retrain them.<\/p>\n

We envision a slightly different paradigm, one in which people will be able to easily and cost-effectively run machine learning models with technology they already have, such as browsers and apps on their phones and other devices. In the spirit of democratizing AI, we\u2019re introducing Decentralized & Collaborative AI on Blockchain (opens in new tab)<\/span><\/a>.<\/p>\n

Through this new framework, participants can collaboratively and continually train and maintain models, as well as build datasets, on public blockchains, where models are generally free to use for evaluating predictions. The framework is ideal for AI-assisted scenarios people encounter daily, such as interacting with personal assistants, playing games, or using recommender systems. An open-source implementation for the Ethereum blockchain (opens in new tab)<\/span><\/a> is available on GitHub (opens in new tab)<\/span><\/a>, and our paper “Decentralized & Collaborative AI on Blockchain<\/a>“\u2014co-authored by myself and Bo Waggoner (opens in new tab)<\/span><\/a>, a postdoc researcher with Microsoft at the time of the work\u2014will be presented at the second IEEE International Conference on Blockchain (opens in new tab)<\/span><\/a> July 14\u201317.<\/p>\n

Why blockchain?<\/h3>\n

Leveraging blockchain technology allows us to do two things that are integral to the success of the framework: offer participants a level of trust and security and reliably execute an incentive-based system to encourage participants to contribute data that will help improve a model\u2019s performance.<\/p>\n

With current web services, even if code is open source, people can\u2019t be 100 percent sure of what they\u2019re interacting with, and running the models generally requires specialized cloud services. In our solution, we put these public models into smart contracts (opens in new tab)<\/span><\/a>, code on a blockchain that helps ensure the specifications of agreed upon terms are upheld. In our framework, models can be updated on-chain<\/em>, meaning within the blockchain environment, for a small transaction fee or used for inference off-chain<\/em>, locally on the individual\u2019s device, with no transaction costs.<\/p>\n

Smart contracts are unmodifiable and evaluated by many machines, helping to ensure the model does what it specifies it will do. The immutable nature and permanent record of smart contracts also allows us to reliably compute and deliver rewards for good data contributions. Trust is important when processing payments, especially in a system like ours that seeks to encourage positive participation via incentives (more to come on that later). Additionally, blockchains such as Ethereum have thousands of decentralized machines all over the world (opens in new tab)<\/span><\/a>, making it less likely a smart contract will become completely unavailable or taken offline.<\/p>\n

\"Ethereum<\/a>

Ethereum nodes are located around the world. Locations are as of July 4, 2019. Source: https:\/\/www.ethernodes.org (opens in new tab)<\/span><\/a><\/p><\/div>\n

Deploying and updating models<\/h3>\n

Hosting a model on a public blockchain requires an initial one-time fee for deployment, usually a few dollars, based on the computational cost to the blockchain network. From that point, anyone contributing data to train the model, whether that be the individual who deployed it or another participant, will have to pay a small fee, usually a few cents, again proportional to the amount of computation being done.<\/p>\n

Using our framework, we set up a Perceptron (opens in new tab)<\/span><\/a> model capable of classifying the sentiment, positive or negative, of a movie review. As of July 2019, it costs about USD0.25 to update the model on Ethereum. We have plans to extend our framework so most data contributors won\u2019t have to pay this fee. For example, contributors could get reimbursed during a reward stage or a third party could submit the data and pay the fee on their behalf when the data comes from usage of the third party\u2019s technology, such as a game.<\/p>\n

To reduce computational costs, we use models that are very efficient to train with such as a Perceptron or a Nearest Centroid Classifier (opens in new tab)<\/span><\/a>. We can also use these models along with high-dimensional representations computed off-chain. More complicated models could be integrated using API calls from the smart contract to machine learning services, but ideally, models would be kept completely public in a smart contract.<\/p>\n

\"Adding<\/a>

Adding data to a model in the Decentralized & Collaborative AI on Blockchain framework consists of three steps: (1) The incentive mechanism, designed to encourage the contribution of \u201cgood\u201d data, validates the transaction, for instance, requiring a \u201cstake\u201d or monetary deposit. (2) The data handler stores data and metadata onto the blockchain. (3) The machine learning model is updated.<\/p><\/div>\n

Incentive mechanisms<\/h3>\n

Blockchains easily let us share evolving model parameters. Newly created information such as new words, new movie titles, and new pictures can be used to update existing models hosted regardless of a specific person or organization\u2019s ability to update and host the model themselves. To encourage people to contribute new data that will help maintain the model\u2019s performance, we propose several incentive mechanisms: gamified, prediction market\u2013based, and ongoing self-assessment.<\/p>\n

Gamified<\/strong>: Like on Stack Exchange (opens in new tab)<\/span><\/a> sites, data contributors can earn points and badges when other contributors validate their contributions. This proposal relies solely on the willingness of contributors to collaborate for a common good\u2014the betterment of the model.<\/p>\n

Prediction market\u2013based<\/strong>: Contributors get rewarded if their contribution improves the performance of the model when evaluated using a specific test set. This proposal builds on existing work using prediction market (opens in new tab)<\/span><\/a> frameworks to collaboratively train and evaluate models, including \u201cA Collaborative Mechanism for Crowdsourcing Prediction Problems (opens in new tab)<\/span><\/a>\u201d and \u201cA Market Framework for Eliciting Private Data. (opens in new tab)<\/span><\/a>\u201d<\/p>\n

The prediction market\u2013based incentive in our framework has three phases:<\/p>\n

    \n
  1. A commitment phase<\/strong> in which a provider stakes a bounty to be awarded to contributors and shares enough of the test set to prove the test set is valid<\/li>\n
  2. A participation phase<\/strong> in which participants submit training data samples with a small deposit of funds to cover the possibility their data is incorrect<\/li>\n
  3. A reward phase<\/strong> in which the provider reveals the rest of the test set and a smart contract validates it matches the proof provided in the commitment phase<\/li>\n<\/ol>\n

    Participants are rewarded based on how much their contribution helped the model improve. If the model did worse on the test set, then participants who contributed “bad” data lose their deposit.<\/p>\n

    Here is how the process looks when running in a simulation:<\/p>\n

    \"For<\/a>

    For this simulation, a Perceptron was trained on the IMDB reviews dataset for sentiment classification (opens in new tab)<\/span><\/a>. The participants contributing \u201cgood\u201d data profit, the participants contributing \u201cbad\u201d data lose their funds, and the model\u2019s accuracy improves. This simulation represents the addition of about 8,000 training samples.<\/p><\/div>\n

    Ongoing self-assessment<\/strong>: Participants effectively validate and pay each other for good data contributions. In such scenarios, an existing model already trained with some data is deployed. A contributor wishing to update the model submits data with features \\(x\\), label \\(y\\), and a deposit. After some predetermined time has passed, if the current model still agrees with the classification, then the person gets their deposit back. We now assume the data has been validated as \u201cgood,\u201d and that contributor earns a point. If a contributor adds \u201cbad\u201d data\u2014that is, data that cannot be validated as \u201cgood\u201d\u2014then the contributor\u2019s deposit is forfeited and split among contributors who\u2019ve earned points for \u201cgood\u201d contributions. Such a reward system would help deter the malicious contribution of \u201cbad\u201d data.<\/p>\n

    \"For<\/a>

    For this simulation, a Perceptron was again trained on the IMDB reviews dataset for sentiment classification (opens in new tab)<\/span><\/a>. This figure demonstrates balance percentages and model accuracy in a simulation where an adversarial \u201cbad contributor\u201d is willing to spend more than an honest \u201cgood contributor.\u201d Despite the malicious efforts, the accuracy can still be maintained, and the honest contributor profits. This simulates the addition of about 25,000 training samples.<\/p><\/div>\n

    From the small and efficient to the complex<\/h3>\n

    The Decentralized & Collaborative AI on Blockchain framework is about sharing models, making valuable resources more accessible to all, and\u2014just as importantly\u2014creating large public datasets that can be used to train models inside and outside the blockchain environment.<\/p>\n

    Currently, this framework is mainly designed for small models that can be efficiently updated. As blockchain technology advances, we anticipate that more applications for collaboration between people and machine learning models will become available, and we hope to see future research in scaling to more complex models along with new incentive mechanisms.<\/p>\n","protected":false},"excerpt":{"rendered":"

    Significant advances are being made in artificial intelligence, but accessing and taking advantage of the machine learning systems making these developments possible can be challenging, especially for those with limited resources. These systems tend to be highly centralized, their predictions are often sold on a per-query basis, and the datasets required to train them are […]<\/p>\n","protected":false},"author":38022,"featured_media":596839,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[{"type":"user_nicename","value":"Justin D. Harris","user_id":"37062"}],"msr_hide_image_in_river":0,"footnotes":""},"categories":[194467],"tags":[],"research-area":[13556],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-596833","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artifical-intelligence","msr-research-area-artificial-intelligence","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[],"related-projects":[591091],"related-events":[],"related-researchers":[],"msr_type":"Post","featured_image_thumbnail":"\"\"","byline":"Justin D. Harris","formattedDate":"July 12, 2019","formattedExcerpt":"Significant advances are being made in artificial intelligence, but accessing and taking advantage of the machine learning systems making these developments possible can be challenging, especially for those with limited resources. These systems tend to be highly centralized, their predictions are often sold on a…","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/596833","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/38022"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=596833"}],"version-history":[{"count":15,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/596833\/revisions"}],"predecessor-version":[{"id":598438,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/596833\/revisions\/598438"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/596839"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=596833"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=596833"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=596833"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=596833"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=596833"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=596833"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=596833"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=596833"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=596833"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=596833"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=596833"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}