欢迎来到天天文库
浏览记录
ID:37537565
大小:112.01 KB
页数:14页
时间:2019-05-24
《apache官方文档---hadoopstreaming》由会员上传分享,免费在线阅读,更多相关内容在行业资料-天天文库。
1、HadoopStreamingContent-Typetext/html;utf-8Tableofcontents1HadoopStreaming..............................................................................................................32HowDoesStreamingWork.......................................................................
2、.......................33PackageFilesWithJobSubmissions.................................................................................44StreamingOptionsandUsage...........................................................................................44.1Mapper-OnlyJobs....
3、....................................................................................................44.2SpecifyingOtherPluginsforJobs................................................................................44.3LargefilesandarchivesinHadoopStreaming.....................
4、........................................54.4SpecifyingAdditionalConfigurationVariablesforJobs.............................................64.5OtherSupportedOptions..............................................................................................75Moreusageexamples
5、........................................................................................................85.1CustomizingtheWaytoSplitLinesintoKey/ValuePairs..........................................85.2AUsefulPartitionerClass(secondarysort,the-partitionerorg.apache.hadoop.mapr
6、ed.lib.KeyFieldBasedPartitioneroption)........................................95.3WorkingwiththeHadoopAggregatePackage(the-reduceaggregateoption).........105.4FieldSelection(similartounix'cut'command)........................................................116FrequentlyAskedQu
7、estions...........................................................................................116.1HowdoIuseHadoopStreamingtorunanarbitrarysetof(semi-)independenttasks?........................................................................................................
8、......................................126.2HowdoIprocessfiles,oneper
此文档下载收益归作者所有