目的:
学会HDFS CLI 常用操作
环境:
Hadoop 2.6.4 伪分布式版
环境搭建参考本博客前篇文章:
帮助:
hadoop@ssmaster:~$ hadoop fsUsage: hadoop fs [generic options] [-appendToFile... ] [-cat [-ignoreCrc] ...] [-checksum ...] [-chgrp [-R] GROUP PATH...] [-chmod [-R] PATH...] [-chown [-R] [OWNER][:[GROUP]] PATH...] [-copyFromLocal [-f] [-p] [-l] ... ] [-copyToLocal [-p] [-ignoreCrc] [-crc] ... ] [-count [-q] [-h] ...] [-cp [-f] [-p | -p[topax]] ... ] [-createSnapshot [ ]] [-deleteSnapshot ] [-df [-h] [ ...]] ......... .........
任务:
1 创建目录
hadoop@ssmaster:~$ hadoop fs -mkdir datahadoop@ssmaster:~$ hadoop fs -ls /Found 1 itemsdrwxr-xr-x - hadoop supergroup 0 2016-10-22 22:33 /data
2 Linux 本地准备文件,内容任意英文
hadoop@ssmaster:~$ vi paper.txthadoop@ssmaster:~$ lsDesktop Documents Downloads examples.desktop hadoop-2.6.4.tar.gz Music paper.txt Pictures Public Templates Videoshadoop@ssmaster:~$ more paper.txt
There are moments in life when you miss someone so much that you just want to pick them from your dreams and hug them for real! Dream
what you want to dream;go where you want to go;be what you want to be,because you have only one life and one chance to do all the things you want to do.....
3 上传文件 Linux 本地到 HDFS
hadoop@ssmaster:~$ hadoop fs -put paper.txt /dataDEPRECATED: Use of this script to execute hdfs command is deprecated.Instead use the hdfs command for it.hadoop@ssmaster:~$ hadoop fs -ls /dataFound 1 items-rw-r--r-- 1 hadoop supergroup 1762 2016-10-22 22:44 /data/paper.txt
4 查看HDFS 文件内容
hadoop@ssmaster:~$ hadoop fs -cat /data/paper.txtThere are moments in life when you miss someone so much that you just want to pick them from your dreams and hug them for real! Dream what you want to dream;go where you want to go;be what you want to be,because you have only one life and one chance to do all the things you want to do.
5 下载到linux本地
hadoop@ssmaster:~$ rm paper.txt hadoop@ssmaster:~$ lsDesktop Documents Downloads examples.desktop hadoop-2.6.4.tar.gz Music Pictures Public Templates Videoshadoop@ssmaster:~$ hadoop fs -get /data/paper.txthadoop@ssmaster:~$ lsDesktop Documents Downloads examples.desktop hadoop-2.6.4.tar.gz Music paper.txt Pictures Public Templates Videos
6 删除HDFS 文件
hadoop@ssmaster:~$ hadoop fs -rm /data/paper.txt16/10/22 22:47:28 INFO fs.TrashPolicyDefault: Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.Deleted /data/paper.tx
7 删除目录
hadoop@ssmaster:~$ hadoop fs -ls /Found 4 itemsdrwxr-xr-x - hadoop supergroup 0 2016-10-22 22:48 /datadrwxr-xr-x - hadoop supergroup 0 2016-10-23 00:01 /inputdrwxr-xr-x - hadoop supergroup 0 2016-10-23 00:08 /outputdrwx------ - hadoop supergroup 0 2016-10-23 00:05 /tmphadoop@ssmaster:~$ hadoop fs -rm -r /input16/10/23 00:37:03 INFO fs.TrashPolicyDefault: Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.Deleted /inputhadoop@ssmaster:~$ hadoop fs -ls /Found 3 itemsdrwxr-xr-x - hadoop supergroup 0 2016-10-22 22:48 /datadrwxr-xr-x - hadoop supergroup 0 2016-10-23 00:08 /outputdrwx------ - hadoop supergroup 0 2016-10-23 00:05 /tmp