CBD praktikum 1
Setup
-
Docker, hadoop etc., there are ready docker-compose files etc.,
docker-compose up -detc. -
interface: http://localhost:9870/
17:08:41 ~/Uni/cbd/pr/data/ 0
> sudo docker cp praktikum namenode:/
17:09:01 ~/Uni/cbd/pr/data/ 0
> sudo docker exec -it namenode bash
root@252b2231892b:/#
DFS
Steps
hdfs dfs runs a command on the system
root@252b2231892b:/# hdfs dfs -mkdir -p /user/root/input
root@252b2231892b:/# hdfs dfs -ls /
Found 1 items
drwxr-xr-x - root supergroup 0 2023-04-24 15:11 /user
root@252b2231892b:/# hdfs dfs -put /praktikum/* input
2023-04-24 15:12:06,177 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2023-04-24 15:12:06,455 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2023-04-24 15:12:06,489 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2023-04-24 15:12:06,633 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2023-04-24 15:12:06,748 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2023-04-24 15:12:06,999 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2023-04-24 15:12:07,123 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
root@252b2231892b:/# hdfs dfs -ls input
Found 7 items
-rw-r--r-- 2 root supergroup 6 2023-04-24 15:12 input/delete_me.txt
-rw-r--r-- 2 root supergroup 522197 2023-04-24 15:12 input/movies.dat
-rw-r--r-- 2 root supergroup 51765440 2023-04-24 15:12 input/r1.test
-rw-r--r-- 2 root supergroup 53393607 2023-04-24 15:12 input/r2.test
-rw-r--r-- 2 root supergroup 53338914 2023-04-24 15:12 input/r3.test
-rw-r--r-- 2 root supergroup 53287278 2023-04-24 15:12 input/r4.test
-rw-r--r-- 2 root supergroup 53320396 2023-04-24 15:12 input/r5.test
Interface
Utilities -> browse file system
http://localhost:9870/explorer.html#/user/root/input
Aufgaben
1. Lassen Sie sich die Dateien und Ordner, die im Wurzelverzeichnis liegen, ausgeben.
root@252b2231892b:/# hdfs dfs -ls /
Found 1 items
drwxr-xr-x - root supergroup 0 2023-04-24 15:11 /user
root@252b2231892b:/# hdfs dfs -ls -R /
drwxr-xr-x - root supergroup 0 2023-04-24 15:11 /user
drwxr-xr-x - root supergroup 0 2023-04-24 15:11 /user/root
drwxr-xr-x - root supergroup 0 2023-04-24 15:12 /user/root/input
-rw-r--r-- 2 root supergroup 6 2023-04-24 15:12 /user/root/input/delete_me.txt
-rw-r--r-- 2 root supergroup 522197 2023-04-24 15:12 /user/root/input/movies.dat
-rw-r--r-- 2 root supergroup 51765440 2023-04-24 15:12 /user/root/input/r1.test
-rw-r--r-- 2 root supergroup 53393607 2023-04-24 15:12 /user/root/input/r2.test
-rw-r--r-- 2 root supergroup 53338914 2023-04-24 15:12 /user/root/input/r3.test
-rw-r--r-- 2 root supergroup 53287278 2023-04-24 15:12 /user/root/input/r4.test
-rw-r--r-- 2 root supergroup 53320396 2023-04-24 15:12 /user/root/input/r5.test
2-4
Erstellen Sie ein neues Verzeichnis /user/root/output
Benennen Sie die Datei delete_me.txt um in delete_me_now.txt
Löschen Sie die Datei delete_me_now.txt aus dem Ordner input.
root@252b2231892b:/# hdfs dfs -mkdir /user/root/output
root@252b2231892b:/# hdfs dfs -mv /user/root/input/delete_me.txt /user/root/input/delete_me_now.txt
root@252b2231892b:/# hdfs dfs -rm /user/root/input/delete_me_now.txt
Deleted /user/root/input/delete_me_now.txt
5. Lassen Sie sich die obersten Zeilen der Datei movies.dat ausgeben.
root@252b2231892b:/# hdfs dfs -head /user/root/input/movies.dat
2023-04-24 15:19:51,284 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
1::Toy Story (1995)::Adventure|Animation|Children|Comedy|Fantasy
2::Jumanji (1995)::Adventure|Children|Fantasy
3::Grumpier Old Men (1995)::Comedy|Romance
4::Waiting to Exhale (1995)::Comedy|Drama|Romance
5::Father of the Bride Part II (1995)::Comedy
6::Heat (1995)::Action|Crime|Thriller
7::Sabrina (1995)::Comedy|Romance
8::Tom and Huck (1995)::Adventure|Children
9::Sudden Death (1995)::Action
10::GoldenEye (1995)::Action|Adventure|Thriller
11::American President, The (1995)::Comedy|Drama|Romance
12::Dracula: Dead and Loving It (1995)::Comedy|Horror
13::Balto (1995)::Animation|Children
14::Nixon (1995)::Drama
15::Cutthroat Island (1995)::Action|Adventure|Romance
16::Casino (1995)::Crime|Drama
17::Sense and Sensibility (1995)::Comedy|Drama|Romance
18::Four Rooms (1995)::Comedy|Drama|Thriller
19::Ace Ventura: When Nature Calls (1995)::Comedy
20::Money Train (1995)::Action|Comedy|Crime|Drama|Thriller
21::Get Shorty (1995)::Action|Comedy|Drama
22::Copycat (1995)::Crime|Drama|Horror|Mystery|Thriller
23::Assassins (root@252b2231892b:/#
Nel mezzo del deserto posso dire tutto quello che voglio.
comments powered by Disqus