{"id":180756,"date":"2017-01-12T20:44:00","date_gmt":"2017-01-13T01:44:00","guid":{"rendered":"https:\/\/www.panix.com\/~msaroff\/40years\/2017\/01\/12\/this-is-fing-inspired\/"},"modified":"2017-01-12T20:44:00","modified_gmt":"2017-01-13T01:44:00","slug":"this-is-fing-inspired","status":"publish","type":"post","link":"https:\/\/www.panix.com\/~msaroff\/40years\/2017\/01\/12\/this-is-fing-inspired\/","title":{"rendered":"This is F%$#ing Inspired"},"content":{"rendered":"<p>Self-driving cars are all the rage right now, though I really don&#8217;t see the tech taking off for a very long time.<\/p>\n<p>The problem is how to make an AI play nice with people on the road, who are inattentive, stupid, violent, vindictive, and frequently malicious.<\/p>\n<p>And once you do, how do you test it?<\/p>\n<p>Rolling it out on the road, with an operator in the drivers seat, is expensive.<\/p>\n<p>Just the liability insurance would be insane.<\/p>\n<p>Obviously, one solution, for the software at least, is to test it in a virtual environment, but this raises an important question:  Where can one find a virtual reality that even comes close to mimicking the insanity that is humans driving cars?<\/p>\n<p>Three Words: <i><a href=\"http:\/\/www.theregister.co.uk\/2017\/01\/12\/gta_v_open_ai_universe\/\"><b><span style=\"font-size: 150%; font-variant: small-caps;\">Grand Theft Auto<\/span><\/b><\/a><\/i>:<\/p>\n<blockquote><p><span style=\"color: blue;\">Developers building self-driving cars can now take their AI agents for a spin in the simulated open world of <i>Grand Theft Auto V<\/i> \u2013 via OpenAI\u2019s machine-learning playground, Universe. <\/p>\n<p>The <a href=\"https:\/\/openai.com\/blog\/GTA-V-plus-Universe\/\">open-source MIT-licensed code<\/a> <a href=\"http:\/\/deepdrive.io\/\">gluing GTA V to Universe<\/a> is maintained by Craig Quiter, who works for Otto \u2013 the Uber-owned startup that delivered 51,744 cans of Budweiser over 193km (120 miles) using a self-driving truck. <\/p>\n<p>The software comes with a trained driving agent; all developers need is a copy of the game to get cracking. After that, programmers can swap out the demo AI model with their own agents to test their code and neural networks. Universe and Quiter&#8217;s integration code takes care of the fiddly interfacing with the game. <\/p>\n<p>Video games new and old provide great training grounds for developing reinforcement learning agents, which learn through trial and error \u2013 or rather, trial and reward when things go right. OpenAI&#8217;s <a href=\"http:\/\/www.theregister.co.uk\/2016\/12\/05\/openai_universe_reinforcement_learning\/\">Universe<\/a> was released in December, and is a wedge of open-source middleware that connects game controls and video displays to machine-learning agents so they can be trained in the virtual arenas.<\/span><\/p><\/blockquote>\n<p>Admittedly, <i>GTA<\/i>, with its hot rods, weapons, and rampant crime is only a pale shadow of commuting in Boston,<sup>*<\/sup> but putting self driving automobile software through its paces in the fictional burg of San Andreas, is a truly inspired reuse of code.<\/p>\n<p><sup>*<\/sup><span style=\"font-size: xx-small;\">No joke:  I knew that it was time for me to leave New England when I screamed at someone for <b>NOT<\/b> cutting me off in a parking lot.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Self-driving cars are all the rage right now, though I really don&#8217;t see the tech taking off for a very long time. The problem is how to make an AI play nice with people on the road, who are inattentive, stupid, violent, vindictive, and frequently malicious. And once you do, how do you test it? &hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[786,787,548,533,471,584],"class_list":["post-180756","post","type-post","status-publish","format-standard","hentry","tag-automobile","tag-gaming","tag-safety","tag-software","tag-transportation","tag-win"],"_links":{"self":[{"href":"https:\/\/www.panix.com\/~msaroff\/40years\/wp-json\/wp\/v2\/posts\/180756"}],"collection":[{"href":"https:\/\/www.panix.com\/~msaroff\/40years\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.panix.com\/~msaroff\/40years\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.panix.com\/~msaroff\/40years\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.panix.com\/~msaroff\/40years\/wp-json\/wp\/v2\/comments?post=180756"}],"version-history":[{"count":0,"href":"https:\/\/www.panix.com\/~msaroff\/40years\/wp-json\/wp\/v2\/posts\/180756\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.panix.com\/~msaroff\/40years\/wp-json\/wp\/v2\/media?parent=180756"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.panix.com\/~msaroff\/40years\/wp-json\/wp\/v2\/categories?post=180756"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.panix.com\/~msaroff\/40years\/wp-json\/wp\/v2\/tags?post=180756"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}