hadoop.the.definitive.guide.3rd.edition

《hadoop.the.definitive.guide.3rd.edition》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、THIRDEDITIONHadoop:TheDefinitiveGuideTomWhiteBeijing•Cambridge•Farnham•Köln•Sebastopol•TokyoHadoop:TheDefinitiveGuide,ThirdEditionbyTomWhiteRevisionHistoryforthe:2012-01-27Earlyreleaserevision1Seehttp://oreilly.com/catalog/errata.csp?isbn=9781449311520forreleasedet

2、ails.ISBN:978-1-449-31152-01327616795ForEliane,Emilia,andLottieTableofContentsForeword..................................................................xiiiPreface.....................................................................xv1.MeetHadoop...................

3、........................................1Data!1DataStorageandAnalysis3ComparisonwithOtherSystems4RDBMS4GridComputing6VolunteerComputing8ABriefHistoryofHadoop9ApacheHadoopandtheHadoopEcosystem12HadoopReleases13What’sCoveredinthisBook14Compatibility152.MapReduce.....

4、......................................................17AWeatherDataset17DataFormat17AnalyzingtheDatawithUnixTools19AnalyzingtheDatawithHadoop20MapandReduce20JavaMapReduce22ScalingOut30DataFlow31CombinerFunctions34RunningaDistributedMapReduceJob37HadoopStreaming37R

5、uby37Python40iiiHadoopPipes41CompilingandRunning423.TheHadoopDistributedFilesystem.......................................45TheDesignofHDFS45HDFSConcepts47Blocks47NamenodesandDatanodes48HDFSFederation49HDFSHigh-Availability50TheCommand-LineInterface51BasicFilesystem

6、Operations52HadoopFilesystems54Interfaces55TheJavaInterface57ReadingDatafromaHadoopURL57ReadingDataUsingtheFileSystemAPI59WritingData62Directories64QueryingtheFilesystem64DeletingData69DataFlow69AnatomyofaFileRead69AnatomyofaFileWrite72CoherencyModel75ParallelCopyi

7、ngwithdistcp76KeepinganHDFSClusterBalanced78HadoopArchives78UsingHadoopArchives79Limitations804.HadoopI/O...........................................................83DataIntegrity83DataIntegrityinHDFS83LocalFileSystem84ChecksumFileSystem85Compression85Codecs87Compr

8、essionandInputSplits91UsingCompressioninMapReduce92Serialization94TheWritableInterface95WritableClasses98iv

9、TableofContentsImplementingaCustomWri