欢迎来到天天文库
浏览记录
ID:33943670
大小:1.59 MB
页数:10页
时间:2019-03-02
《Better Computer Go Player with Neural Network and Long-term Prediction.pdf》由会员上传分享,免费在线阅读,更多相关内容在学术论文-天天文库。
1、UnderreviewasaconferencepaperatICLR2016BETTERCOMPUTERGOPLAYERWITHNEURALNET-WORKANDLONG-TERMPREDICTIONYuandongTianYanZhuFacebookAIResearchRutgersUniversityMenloPark,CA94025FacebookAIResearchyuandong@fb.comyz328@cs.rutgers.eduABSTRACTCompetingwithtophumanplayersintheancientgameofGohasbeenalong-termg
2、oalofartificialintelligence.Go’shighbranchingfactormakestraditionalsearchtechniquesineffective,evenonleading-edgehardware,andGo’sevaluationfunctioncouldchangedrasticallywithonestonechange.Recentworks[Maddi-sonetal.(2015);Clark&Storkey(2015)]showthatsearchisnotstrictlynec-essaryformachineGoplayers.A
3、purepattern-matchingapproach,basedonaDeepConvolutionalNeuralNetwork(DCNN)thatpredictsthenextmove,canperformaswellasMonteCarloTreeSearch(MCTS)-basedopensourceGoen-ginessuchasPachi[Baudis&Gailly(2012)]ifitssearchbudgetislimited.Weextendthisideainourbotnameddarkforest,whichreliesonaDCNNdesignedforlon
4、g-termpredictions.Darkforestsubstantiallyimprovesthewinrateforpattern-matchingapproachesagainstMCTS-basedapproaches,evenwithloosersearchbudgets.Againsthumanplayers,darkforestachievesastable1d-2dlevelonKGSGoServer,estimatedfromfreegamesagainsthumanplayers.Thissubstan-tiallyimprovestheestimatedranki
5、ngsreportedinClark&Storkey(2015),whereDCNN-basedbotsareestimatedat4k-5klevelbasedonperformanceagainstothermachineplayers.AddingMCTStodarkforestcreatesamuchstrongerplayer:withonly1000rollouts,darkforest+MCTSbeatspuredarkforest90%ofthetime;with5000rollouts,ourbestmodelplusMCTSbeatsPachiwith10,000rol
6、louts95:5%ofthetime.1INTRODUCTIONForalongtime,computerGoisconsideredtobeagrandchallengeinartificialintelligence.Fig.1showsasimpleillustrationofthegameofGo.Twoplayers,blackandwhite,placestonesatinter-sectionsinturnona19x19board(Fig.1(a)).Blackplaysfirstonanemptyboard.A4-connectedarXiv:1511.06410v1[cs
7、.LG]19Nov2015componentofthesamecoloriscalledagroup.Thelibertiesofagroupisthenumberofitsneigh-boringemptyintersections(Fig.1(b)).Agroupiscapturedifitslibertiesarezero.Thegoalofthegameistocontrolmoreterritorythanth
此文档下载收益归作者所有