77范文网 - 专业文章范例文档资料分享平台

hadoop单机部署、集群部署及win7本地Eclipse远程配置管理(8)

来源:网络收集 时间:2019-06-05 下载这篇文档 手机版
说明:文章内容仅供预览,部分内容可能不全,需要完整文档或者需要复制内容,请下载word后使用。下载word有问题请添加微信号:或QQ: 处理(尽可能给您提供完整文档),感谢您的支持与谅解。点击这里给我发消息

if (NativeIO.isAvailable()) {

NativeIO.chmod(f.getCanonicalPath(), permission.toShort()); } else {

execCommand(f, Shell.SET_PERMISSION_COMMAND, String.format(\ } }

static String execCommand(File f, String... cmd) throws IOException { String[] args = new String[cmd.length + 1]; System.arraycopy(cmd, 0, args, 0, cmd.length); args[cmd.length] = f.getCanonicalPath(); String output = Shell.execCommand(args); return output; } /**

* Create a tmp file for a base file.

* @param basefile the base file of the tmp * @param prefix file name prefix of tmp

* @param isDeleteOnExit if true, the tmp will be deleted when the VM exits * @return a newly created tmp file

* @exception IOException If a tmp file cannot created * @see java.io.File#createTempFile(String, String, File) * @see java.io.File#deleteOnExit() */

public static final File createLocalTempFile(final File basefile, final String prefix,

final boolean isDeleteOnExit) throws IOException {

File tmp = File.createTempFile(prefix + basefile.getName(), \ if (isDeleteOnExit) { tmp.deleteOnExit(); }

return tmp; } /**

* Move the src file to the name specified by target. * @param src the source file * @param target the target file

* @exception IOException If this operation fails */

public static void replaceFile(File src, File target) throws IOException { /* renameTo() has two limitations on Windows platform. * src.renameTo(target) fails if * 1) If target already exists OR

* 2) If target is already open for reading/writing. */

if (!src.renameTo(target)) { int retries = 5;

while (target.exists() && !target.delete() && retries-- >= 0) { try {

Thread.sleep(1000);

} catch (InterruptedException e) {

throw new IOException(\ } }

if (!src.renameTo(target)) {

throw new IOException(\ \ } } } /**

* A wrapper for {@link File#listFiles()}. This java.io API returns null * when a dir is not a directory or for any I/O error. Instead of having * null check everywhere File#listFiles() is used, we will add utility API

* to get around this problem. For the majority of cases where we prefer * an IOException to be thrown.

* @param dir directory for which listing should be performed * @return list of files or empty list

* @exception IOException for invalid directory or for a bad disk. */

public static File[] listFiles(File dir) throws IOException { File[] files = dir.listFiles(); if(files == null) {

throw new IOException(\ + dir.toString()); }

return files; } /**

* A wrapper for {@link File#list()}. This java.io API returns null * when a dir is not a directory or for any I/O error. Instead of having * null check everywhere File#list() is used, we will add utility API * to get around this problem. For the majority of cases where we prefer * an IOException to be thrown.

* @param dir directory for which listing should be performed * @return list of file names or empty string list

* @exception IOException for invalid directory or for a bad disk. */

public static String[] list(File dir) throws IOException { String[] fileNames = dir.list(); if(fileNames == null) {

throw new IOException(\ + dir.toString()); }

return fileNames; } }

重新编译打包hadoop-core-1.0.2.jar,替换掉hadoop-1.0.2根目录下的hadoop-core-1.0.2.jar即可。

替换之后,刷新项目,设置好正确的jar包依赖,现在再运行WordCountTest,即可。 成功之后,在Eclipse下刷新HDFS目录,可以看到生成了ouput2目录:

点击“ part-r-00000”文件,可以看到排序结果:

Bye 1 Goodbye 1 Hadoop 2 Hello 2 World 2

嗯,一样可以正常Debug调试该程序,设置断点(右键 –> Debug As – > Java Application),即可(每次运行之前,都需要收到删除输出目录)。

另外,该插件会在eclipse对应的workspace\\.metadata\\.plugins\\org.apache.hadoop.eclipse下,自动生成jar文件,以及其他文件,包括Haoop的一些具体配置等。 嗯,更多细节,慢慢体验吧。

百度搜索“77cn”或“免费范文网”即可找到本站免费阅读全部范文。收藏本站方便下次阅读,免费范文网,提供经典小说综合文库hadoop单机部署、集群部署及win7本地Eclipse远程配置管理(8)在线全文阅读。

hadoop单机部署、集群部署及win7本地Eclipse远程配置管理(8).doc 将本文的Word文档下载到电脑,方便复制、编辑、收藏和打印 下载失败或者文档不完整,请联系客服人员解决!
本文链接:https://www.77cn.com.cn/wenku/zonghe/650579.html(转载请注明文章来源)
Copyright © 2008-2022 免费范文网 版权所有
声明 :本网站尊重并保护知识产权,根据《信息网络传播权保护条例》,如果我们转载的作品侵犯了您的权利,请在一个月内通知我们,我们会及时删除。
客服QQ: 邮箱:tiandhx2@hotmail.com
苏ICP备16052595号-18
× 注册会员免费下载(下载后可以自由复制和排版)
注册会员下载
全站内容免费自由复制
注册会员下载
全站内容免费自由复制
注:下载文档有可能“只有目录或者内容不全”等情况,请下载之前注意辨别,如果您已付费且无法下载或内容有问题,请联系我们协助你处理。
微信: QQ: