返回
A Practical Guide to Training RBM.pdf

A Practical Guide to Training RBM.pdf

ID：34211655

大小：186.85 KB

页数：21页

时间：2019-03-04

A Practical Guide to Training RBM.pdf_第1页
A Practical Guide to Training RBM.pdf_第2页
A Practical Guide to Training RBM.pdf_第3页
A Practical Guide to Training RBM.pdf_第4页
A Practical Guide to Training RBM.pdf_第5页
资源描述：

《A Practical Guide to Training RBM.pdf》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、DepartmentofComputerScience6King'sCollegeRd,TorontoUniversityofTorontoM5S3G4,Canadahttp://learning.cs.toronto.edufax:+14169781455CopyrightcGeo reyHinton2010.August2,2010UTMLTR2010{003APracticalGuidetoTrainingRestrictedBoltzmannMachinesVersion1Geo reyHintonDepartmentofComputerScience,U

2、niversityofTorontoAPracticalGuidetoTrainingRestrictedBoltzmannMachinesVersion1Geo reyHintonDepartmentofComputerScience,UniversityofTorontoContents1Introduction32AnoverviewofRestrictedBoltzmannMachinesandContrastiveDivergence33HowtocollectstatisticswhenusingContrastiveDivergence53.1Upd

3、atingthehiddenstates.................................53.2Updatingthevisiblestates.................................63.3Collectingthestatisticsneededforlearning........................63.4ArecipeforgettingthelearningsignalforCD1......................64Thesizeofamini-batch64.1Arecipeford

4、ividingthetrainingsetintomini-batches..................75Monitoringtheprogressoflearning75.1Arecipeforusingthereconstructionerror.........................76Monitoringtheover tting86.1Arecipeformonitoringtheover tting...........................87Thelearningrate87.1Arecipeforsettingthel

5、earningratesforweightsandbiases...............88Theinitialvaluesoftheweightsandbiases98.1Arecipeforsettingtheinitialvaluesoftheweightsandbiases.............99Momentum919.1Arecipeforusingmomentum................................1010Weight-decay1010.1Arecipeforusingweight-decay..........

6、.....................1111Encouragingsparsehiddenactivities1111.1Arecipeforsparsity.....................................1212Thenumberofhiddenunits1212.1Arecipeforchoosingthenumberofhiddenunits.....................1213Di erenttypesofunit1313.1Softmaxandmultinomialunits..................

7、.............1313.2Gaussianvisibleunits....................................1313.3Gaussianvisibleandhiddenunits..............................1413.4Binomialunits........................................1413.5Recti edlinearunits.....................................1414Varietiesofcontrasti

8、vediv

当前文档最多预览五页，下载文档查看全文

此文档下载收益归作者所有

当前文档最多预览五页，下载文档查看全文
温馨提示：
1. 部分包含数学公式或PPT动画的文件，查看预览时可能会显示错乱或异常，文件下载后无此问题，请放心下载。
2. 本文档由用户上传，版权归属用户，天天文库负责整理代发布。如果您对本文档版权有争议请及时联系客服。
3. 下载前请仔细阅读文档内容，确认文档内容符合您的需求后进行下载，若出现内容与标题不符可向本站投诉处理。
4. 下载文档时可能由于网络波动等原因无法下载或下载错误，付费完成后未能成功下载的用户请联系客服处理。