{"id":1878,"date":"2017-01-23T17:30:11","date_gmt":"2017-01-23T15:30:11","guid":{"rendered":"http:\/\/variances.eu\/?p=1878"},"modified":"2017-01-23T17:31:33","modified_gmt":"2017-01-23T15:31:33","slug":"poker-is-the-latest-game-to-fold-against-artificial-intelligence","status":"publish","type":"post","link":"https:\/\/variances.eu\/?p=1878","title":{"rendered":"Poker is the latest game to fold against artificial intelligence"},"content":{"rendered":"
\n
\n
\n
Apres la d\u00e9faite de professionnels du jeu de Go en 2016 face a DeepMind de Google, voici un recent article du MIT Technology review sur de nouvelles avanc\u00e9es de l\u2019intelligence artificielle et la d\u00e9faite de professionnels de Poker face a un nouveau programme DeepStack.<\/em><\/div>\n
<\/div>\n<\/div>\n
Un article s\u00e9lectionn\u00e9 par Fr\u00e9d\u00e9ric Smadja <\/strong>(2000), le correspondant de Variances.eu aux Etats-Unis : l’article, r\u00e9dig\u00e9 par Will Knight<\/strong><\/a><\/span>, \u00a0a \u00e9t\u00e9 pr\u00e9c\u00e9demment publi\u00e9 dans le \u00ab\u00a0MIT Technology review<\/strong><\/a><\/span>\u00ab\u00a0<\/div>\n
<\/div>\n
<\/div>\n
\n
\n
\n<\/div>\n
<\/div>\n
Two research groups have developed poker-playing AI programs that show how computers can out-hustle the best humans.<\/em><\/div>\n
<\/div>\n<\/div>\n<\/div>\n<\/div>\n

In a landmark achievement for artificial intelligence, a poker bot developed by researchers in Canada and the Czech Republic has defeated several professional players in one-on-one games of no-limit Texas hold\u2019em poker.<\/p>\n

Perhaps most interestingly, the academics behind the work say their program overcame its human opponents by using an approximation approach that they compare to \u201cgut feeling.\u201d<\/p>\n

\u201cIf correct, this is indeed a significant advance in game-playing AI,\u201d says\u00a0Michael Wellman<\/a><\/span>, a professor at the University of Michigan who specializes in game theory and AI. \u201cFirst, it achieves a major milestone (beating poker professionals) in a game of prominent interest. Second, it brings together several novel ideas, which together support an exciting approach for imperfect-information games.\u201d<\/p>\n

Later this week, a tournament at a Pittsburgh casino will see several world-class poker players play the same version of poker against a program developed at CMU. Tuomas Sandholm<\/a><\/span>, a professor of computer science at CMU who is leading the effort, says the human players involved are considerably stronger than those tested by the Alberta researchers, and 120,000 hands will be played over 20 days, providing greater statistical significance to the results. The tournament could confirm that AI has indeed mastered a game that has long seemed far too complex and subtle for computers.<\/p>\n

DeepStack, the poker-playing software that has already bested some professional players, was developed by a team led by Michael Bowling<\/a><\/span>, a professor of computer science at the University of Alberta, which included researchers from Charles University and Czech Technical University in the Czech Republic. In a research paper posted online<\/a><\/span> but not yet peer reviewed, the researchers say that DeepStack played almost 45,000 hands of poker against several players, beating them handily.<\/p>\n

Poker is more complex than many other games that have pitted humans against AI. And tellingly, it contains levels of uncertainty, such as when an opponent may be bluffing, that are found in many real-world situations that AI has not yet mastered. Poker players cannot see their opponents\u2019 hands, meaning that, in contrast to checkers, chess, or Go, not all of the information contained within the game is available to them. Researchers from DeepMind, a U.K.-based subsidiary of Alphabet, made headlines last year after creating a program capable of beating one of the world\u2019s best Go players (see \u201cGoogle\u2019s AI Masters the Game of Go a Decade Earlier Than Expected<\/a><\/span>\u201d).<\/p>\n

Heads-up no-limit Texas hold\u2019em is a version of the game played between two people who can bet as many of the chips as they possess. This variant for a long time proved too difficult for machines to play expertly. There are 10160<\/sup> (10 followed by 160 zeros) possible paths of play for each hand in heads-up no-limit Texas hold\u2019em.<\/p>\n

DeepStack learned to play poker by playing hands against itself. After each game, it revisits and refines its strategy, resulting in a more optimized approach. Due to the complexity of no-limit poker, this approach normally involves practicing with a more limited version of the game. The DeepStack team coped with this complexity by applying a fast approximation technique that they refined by feeding previous poker situations into a deep-learning algorithm.<\/p>\n

\u201cWhat’s really new for such a complex game is being able to effectively compute the action to take in each situation as it is encountered, rather than having to work through a simplified form of the entire tree of game possibilities offline,\u201d says Wellman of the University of Michigan.<\/p>\n

The researchers compare DeepStack\u2019s approximation technique to a human player\u2019s instinct for when an opponent is bluffing or holding a winning hand, although the machine has to base its assessment on the opponent’s betting patterns rather than his or her body language. \u201cThis estimate can be thought of as DeepStack\u2019s intuition,\u201d they write. \u201cA gut feeling of the value of holding any possible private cards in any possible poker situation.\u201d<\/p>\n

It\u2019s possible to measure the performance of a poker player by looking at the amount won, relative to the amount bet at his or her table, over many games. DeepStack had a win rate roughly nine times better than what would be considered good for a professional player.<\/p>\n

In 2015, Bowling and colleagues at the University of Alberta \u201csolved\u201d the more limited version of heats up hold\u2019em by developing a poker bot<\/a>\u00a0<\/span>capable of playing the game perfectly.<\/p>\n

The poker bot involved in the Pittsburgh tournament, called Libratus, was developed by Sandholm and one of his graduate students, Noam Brown<\/a><\/span>. The pair has not yet disclosed details of how their program approaches the game, but Brown says it essentially tries to \u00ab\u00a0solve\u00a0\u00bb the game\u2014or figure out every possible scenario\u2014earlier during the game than was previously possible. Libratus runs on extremely powerful hardware at the Pittsburgh Supercomputing Center<\/a><\/span>, a facility run jointly by CMU and the University of Pittsburgh.<\/p>\n","protected":false},"excerpt":{"rendered":"

Apres la d\u00e9faite de professionnels du jeu de Go en 2016 face a DeepMind de Google, voici un recent article du MIT Technology review sur de nouvelles avanc\u00e9es de l\u2019intelligence artificielle et la d\u00e9faite de professionnels de Poker face a un nouveau programme DeepStack. Un article s\u00e9lectionn\u00e9 par Fr\u00e9d\u00e9ric Smadja (2000), le correspondant de Variances.eu […]<\/p>\n","protected":false},"author":42,"featured_media":1881,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[21],"tags":[],"class_list":["post-1878","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-machine-learning","et-has-post-format-content","et_post_format-et-post-format-standard"],"_links":{"self":[{"href":"https:\/\/variances.eu\/index.php?rest_route=\/wp\/v2\/posts\/1878","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/variances.eu\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/variances.eu\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/variances.eu\/index.php?rest_route=\/wp\/v2\/users\/42"}],"replies":[{"embeddable":true,"href":"https:\/\/variances.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1878"}],"version-history":[{"count":0,"href":"https:\/\/variances.eu\/index.php?rest_route=\/wp\/v2\/posts\/1878\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/variances.eu\/index.php?rest_route=\/wp\/v2\/media\/1881"}],"wp:attachment":[{"href":"https:\/\/variances.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1878"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/variances.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1878"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/variances.eu\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1878"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}