linux下的hadoop--分布式模式的部署

《linux下的hadoop--分布式模式的部署》由会员上传分享，免费在线阅读，更多相关内容在工程资料-天天文库。

1、2009年10月30日星期五12:49Linux下的Hadoop--分布式模式的部署　　选用软件版本：1.jdk1.6.0.102.hadoop-0.19.11.准备Host环境和配置ssh主节点IP是192.168.1.247，子节点1是192.168.1.36，修改两个节点的/etc/hosts文件：#/etc/hosts(formasterANDslave)192.168.1.247master192.168.1.36slave分别在两台机器上添加用户hadoop　　①在master上：groupadd-g2000hadoopuseradd-u2000-ghadoophadoopsu-h

2、adoopssh-keygen-tdsa-P''-f~/.ssh/identityGeneratingpublic/privatedsakeypair.Createddirectory'/home/hadoop/.ssh'.Youridentificationhasbeensavedin/home/hadoop/.ssh/identity.Yourpublickeyhasbeensavedin/home/hadoop/.ssh/identity.pub.Thekeyfingerprintis:44:e5:05:16:a2:33:95:23:3e:54:f8:c7:f1:e5:bc:24hado

3、op@localhost.localdomainmv.ssh/identity.pub.ssh/authorized_keyssshmaster输入yes接受自己的公钥，看能否自动登录，然后sshslave输入yes接受36的公钥。Theauthenticityofhost'slave(192.168.1.36)'can'tbeestablished.RSAkeyfingerprintis40:39:05:3d:3e:6c:9d:1f:8c:d1:40:68:67:65:86:41.Areyousureyouwanttocontinueconnecting(yes/no)?yesWarning

4、:Permanentlyadded'slave,192.168.1.36'(RSA)tothelistofknownhosts.hadoop@slave'spassword:cat.ssh/authorized_keysssh-dssAAAAB3NzaC1kc3MAAACBAM4FxFo0oXwj04yyOYQsFe4IeNU/ClXOVxXtTQyQlZHse/Cl9tzKzzrDxfKkM8K/wjRH3o2gppk2L2VO7SAd8ZYarCKQzCQjQzMa7UcsjQBth9bzde/rafDO2izHyN5dM9oHMD3p4H9f672pPO0n8oYShrA48ndBn0N

5、8TucrT0t9AAAAFQCy+pU9QOOD4lvp/qipQbJI2JX7kQAAAIB4lwMLhjcJmtTiQqxUruTm4WgdOhlVz9HJPqv1FipZEhAVIk5xG9X93wUee3zVN+6v2mOuJlXAiOAbFeY5ba7EgSaL8RAAhUhzFiTNar6jtZJgy36TzOoECL99leX+F9EpYnCyN7zMHjuOE5nFPV6NgsDJDjt2EPEdoEvyeMz3iAAAAIEAsoGk1TxRN12zq5HjFsPUiwVCKKoi4NKlwCHzUGNwE875je1ZHOm32SNUzpfwKGT8PR+d530aVzU

6、GTmT7On5mUlD5ZIHPgjn9zXPFZ/ZMV9XAoxhHBNbkCrQlwLgEE7C3nK3xlEGLymdLxGRZpiCctdlromNqNhr33mzJnWWnVPI=hadoop@localhost.localdomain复制备用　　②在slave上：groupadd-g2000hadoopuseradd-u2000-ghadoophadoopsu-hadoopmkdir.sshchmod700.sshvi.ssh/authorized_keys把从master机器上拷贝的authorized_keys文件内容粘贴上。chmod644.ssh/authorized_

7、keys　　③在master上：sshslave看是否能自动登录　　这样host和ssh环境就配好了。　　有人会觉得slave上的操作很麻烦，这是因为这里只添加了用户，而没有给用户密码，这样导致hadoop用户只能用证书登陆，不能用密码方式登录，会更安全。2.配置hadoop和jdk1.6这里下载的jdk是jdk-6u10-rc-bin-b28-linux-i586-21_jul_2008.bin