BOOK - 2012 - Tom White - Hadoop The Definitive Guide 3rd Edition.pdf

《BOOK - 2012 - Tom White - Hadoop The Definitive Guide 3rd Edition.pdf》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、THIRDEDITIONHadoop:TheDefinitiveGuidewnloadfromWow!eBookoDTomWhiteBeijing•Cambridge•Farnham•Köln•Sebastopol•TokyoHadoop:TheDefinitiveGuide,ThirdEditionbyTomWhiteRevisionHistoryforthe:2012-01-27Earlyreleaserevision1Seehttp://oreilly.

2、com/catalog/errata.csp?isbn=9781449311520forreleasedetails.ISBN:978-1-449-31152-01327616795ForEliane,Emilia,andLottieTableofContentsForeword..................................................................xiiiPreface.................................

3、....................................xv1.MeetHadoop...........................................................1Data!1DataStorageandAnalysis3ComparisonwithOtherSystems4RDBMS4GridComputing6VolunteerComputing8ABriefHistoryofHadoop9ApacheHadoopandtheHadoo

4、pEcosystem12HadoopReleases13What’sCoveredinthisBook14Compatibility152.MapReduce...........................................................17AWeatherDataset17DataFormat17AnalyzingtheDatawithUnixTools19AnalyzingtheDatawithHadoop20MapandReduce20JavaMapR

5、educe22ScalingOut30DataFlow31CombinerFunctions34RunningaDistributedMapReduceJob37HadoopStreaming37Ruby37Python40iiiHadoopPipes41CompilingandRunning423.TheHadoopDistributedFilesystem.......................................45TheDesignofHDFS45HDFSConcept

6、s47Blocks47NamenodesandDatanodes48HDFSFederation49HDFSHigh-Availability50TheCommand-LineInterface51BasicFilesystemOperations52HadoopFilesystems54Interfaces55TheJavaInterface57ReadingDatafromaHadoopURL57ReadingDataUsingtheFileSystemAPI59WritingData62D

7、irectories64QueryingtheFilesystem64DeletingData69DataFlow69AnatomyofaFileRead69AnatomyofaFileWrite72CoherencyModel75ParallelCopyingwithdistcp76KeepinganHDFSClusterBalanced78HadoopArchives78UsingHadoopArchives79Limitations804.HadoopI/O................

8、...........................................83DataIntegrity83DataIntegrityinHDFS83LocalFileSystem84ChecksumFileSystem85Compression85Codecs87CompressionandInputSplits91UsingCompressioninMapReduce92Serialization94TheWritableInterface95WritableClasses98i