= Linux Hands - On = Through this hands-on you will install Ubuntu Server on a vm and you will make additional two clones of the installed ubuntu server for your lab sessions in next two days. == Setting up virtualbox == === Installation of virtualbox and Downloading Ubuntu iso image === - Download and install virtualbox 5.0.x - Download Ubuntu image from the LEARN mirror - Note down the location of downloaded iso file === Creating the VM === - Start virtualbox and Click on New button (at top-right) to create new virtual machine - Enter name of the VM as: '''linux.'your domain'.ws.learn.ac.lk'''. You can get your domain from [wiki:ipallocation here] eg: linux.user1.ws.learn.ac.lk - Select OS Type: '''Linux''' - Select Version: '''Ubuntu (64-bit)''' - Then click on '''Continue''' button - Set VM's memory size to '''1024MB''' and click on Continue button - Set VM's hard disk option to '''Create a virtual hard disk now''' and then click on '''Continue''' - Select disk type to '''VDI''' - Select storage type to '''Fixed size''' and '''Continue''' - Make sure virtual hard disk file name in following format '''linux.'your domain'.ws.learn.ac.lk''' - adjust the disk size to '''10.0GB''' and click on '''Create''' to create the VM This might take couple of minutes (Note down the location of vdi image file when virtualbox flashes it on the screen) === Setting up Network Interface === - Select the VM from left panel on Virtual box, right click and open '''Settings''' - Click on the '''Network''' title - On '''Adapter 1''' While ''Enable'' Network Adapter selected choose Attached to be '''Bride Adapter'''. This virtual interface will work as the WAN port of the firewall (Can be connect from out side). === Setting up boot device and Booting=== - Click on '''Storage''' title and select '''CD ROM icon''' under the '''Controller:IDE''' Click on CD ROM icon under the '''Attribute''' on the left side to select - Choose '''Virtual Optical Disk File''' - Locate the '''Ubuntu CD Image''' file you downloaded from the LEARN ftp - Right click on VM to make a '''Normal Start''' VM. You should now see a separate window with Installation screen == Installation == === Initial Installation options === - Select '''English''' as language for the installation wizard - Select '''Ubuntu Server''' - Select '''English''' for VM's OS language - Select location by '''Others->Asia->Sri Lanka''' - Keep locales as default '''United States''' - Press '''No''' for configure Keyboard - Select '''English (US)''' for country of origin for the keyboard Now it might take sometime to detect the hardware and load the necessary Linux modules Note that it configure network with DCHP - Type host name as: '''linux.'your domain'.ws.learn.ac.lk''' - When it asked, add a User by entering Your '''Name, your username, password''' - You may select '''No''' for not to encrypt home directory - Select '''Yes''' confirm the time-zone === Disk Configuration === Your have 10GB hard drive previously configured for your VM - Select '''Manual''' - Select the Disk '''SCSI3(0,0,0) (sda) - 10.0 GB ATA VBOX HARDDISK''' and Select '''Yes''' to create new partition table - Select Free Space to create following partitions and mount them as follows. Use EXT4 for all partitions except for SWAP partition * a primary partition for /boot 512MB - turn on Bootable flag * a primary partition for Linux SWAP (two times the RAM) SWAP 2GB * a primary partition for Linux Logical Volume for remaining disk space. - Then use Logical Volume Manager to create a Volume Group named as "linux" and logical volumes for followings * a logical volume root for / 2GB * a logical volume usr for /usr 3GB * a logical volume var for /var rest of the free space - Get above partitions mounted as /, /usr and /var with the file system EXT4 selected. - Then finish the partitioning and confirm it to write to the disk Now it might take sometime to install the OS base. === Final Configuration === - At the package manager, click '''Continue''' not to use any proxy settings Again it might take times to install rest of the packages. - Select '''No''' automatic updates - Select only a. standard system utilities b. OpenSSH server Wait until it finished the installation of software - Finally install/setup the GRUB boot loader by selecting '''Yes''' - Finish the installation of Ubuntu by selecting '''Continue''' VM now should restart with the newly installed OS. You may now login using your credentials === Create the Additional VMs === You will now easily create the second VM using VM cloning. This VM is for your Web Server which will be used for hands-on tomorrow. - First Power off/shutdown your VM - Right click on the VM to select Clone option - Assign new name as web."your domain".ws.ac.lk - Check "Reinitialize the MAC address for all network cards - And then click on Continue - Select Full clone This might take sometime to create the new virtual disk image (vdi) file. Note that your new VM is same as your previous one. You have to change host name, ip addresses, etc accordingly. - When the cloning finished, start you new VM and do following to change the host name - edit /etc/hostname file and change host name to web. You may use vi or nano editor. - also edit /etc/hosts file to change 127.0.0.1 pc."your domain".ws.ac.lk pc to 127.0.0.1 web."your domain".ws.ac.lk You can follow the same steps and create the third VM to use as the ldap Server. Note the following changes. - Assign new name as ldap."your domain".ws.ac.lk - edit /etc/hostname file and change host name to web. You may use vi or nano editor. - also edit /etc/hosts file to change 127.0.0.1 pc."your domain".ws.ac.lk pc to 127.0.0.1 ldap."your domain".ws.ac.lk '''Note''': For this Hands-on you only need your pc(pc."your domain.ws.ac.lk") VM. Please shut down the additional VM's == Playing with Linux == === Working with directories === A brief overview of the most common commands to work with directories: '''pwd''', '''cd''', '''ls''', '''mkdir''' and '''rmdir'''. These commands are available on any Linux (or Unix) system. - '''pwd''' : Print Working Directory (Will tell you the location you are currently working) - '''cd''' : You can change your current directory with the cd command * '''cd''' : shortcut to get back into your home directory. Just typing cd without a target directory, will put you in your home directory * '''cd ..''' : To go to the parent directory (the one just above your current directory in the directory tree) * '''cd -''' : To go to the previous directory - '''ls''' : You can list the contents of a directory with ls * '''ls -a''' : To show all files. Showing all files means including the hidden files. When a file name on a Linux file system starts with a dot, it is considered a hidden file and it doesn't show up in regular file listings. * '''ls -l''' : to display the contents of the directory in different formats or to display different parts of the directory. * '''ls -lh''' : shows the numbers (file sizes) in a more human readable format. - '''mkdir''' : Create new directories - '''mkdir -p''': To create parent directories as needed - '''rmdir''': To remove the directory. (Directory has to be empty) '''Some exercise''' 1. Login to your VM. and Display your current directory 2. Change to /etc directory and display current directory 3. Go to root directory and list the contents 4. List a long listing of the root directory 5. Go to your home directory 6. Make directory named 'test' 7. make a directory inside test directory named 'one' and make a hidden directory inside 'one' directory named '.hidden'. Make a directory inside test directory named 'one' and make a hidden directory inside 'one' directory named 'unhidden'. 8. Go to 'one' directory and list the content. 9. Then list all contents 10. Remove directory 'unhidden' 11. Go to your home and try to remove directory 'test' {{{ dilum@DilumL:~$ pwd /home/dilum dilum@DilumL:~$ cd /etc dilum@DilumL:/etc$ pwd /etc dilum@DilumL:/etc$ cd .. dilum@DilumL:/$ ls bin etc lib lost+found opt run var boot home lib32 media proc sbin tmp mnt dev lib64 root sys usr dilum@DilumL:/$ ls -l total 88 drwxrwxr-x 2 root root 4096 Mar 4 2016 bin drwxr-xr-x 3 root root 4096 Feb 9 2016 boot drwxr-xr-x 20 root root 3360 Nov 16 08:16 dev drwxr-xr-x 155 root root 12288 Aug 29 09:30 etc drwxr-xr-x 4 root root 4096 Aug 16 08:54 home drwxr-xr-x 19 root root 4096 Mar 4 2016 lib drwxr-xr-x 2 root root 4096 Mar 4 2016 lib32 drwxr-xr-x 2 root root 4096 Mar 4 2016 lib64 drwx------ 2 root root 16384 Dec 15 2015 lost+found drwxr-xr-x 4 root root 4096 Dec 15 2015 media drwxr-xr-x 2 root root 4096 Dec 15 2015 mnt drwxr-xr-x 3 root root 4096 Jan 26 2016 opt dr-xr-xr-x 189 root root 0 Nov 16 08:16 proc drwx------ 12 root root 4096 Sep 6 16:25 root drwxr-xr-x 26 root root 960 Nov 16 08:41 run drwxr-xr-x 2 root root 4096 Mar 4 2016 sbin dr-xr-xr-x 13 root root 0 Nov 16 08:16 sys drwxrwxrwt 18 root root 4096 Nov 16 12:50 tmp drwxr-xr-x 12 root root 4096 Nov 8 12:39 usr drwxr-xr-x 13 root root 4096 Dec 16 2015 var dilum@DilumL:/$ cd dilum@DilumL:~$ pwd /home/dilum dilum@DilumL:~$ mkdir test/one/.hidden mkdir: cannot create directory ‘test/one/.hidden’: No such file or directory dilum@DilumL:~$ mkdir -p test/one/.hidden dilum@DilumL:~$ mkdir -p test/one/unhidden dilum@DilumL:~$ cd test/one dilum@DilumL:~/test/one$ ls unhidden dilum@DilumL:~/test/one$ ls -a . .. .hidden unhidden dilum@DilumL:~/test/one$ rmdir unhidden/ dilum@DilumL:~/test/one$ ls -a . .. .hidden dilum@DilumL:~$ rmdir test rmdir: failed to remove ‘test’: Directory not empty }}} === File Editing === The vi editor is installed on almost every Unix. Linux will very often install vim (vi improved) which is similar. Every system administrator should know vi(m), because it is an easy tool to solve problems. '''vi Commands and Tips''' {{{ Open: vi filename (fn=filename) vi -r filename Recover a file from a crashed session vi + filename Place the cursor on last line of file. vi +n filename Place the cursor on line "n" of file. vi +/pat filename Place cursor on line with first occurrence of "pat"tern Close: :w Write the file to disk. Don't exit. :w! Write the file to disk even if read/only. :wq Write the file to disk and exit. :wq! Write the file to disk even if read/only and quit. :q Quit the file (only if no changes). :q! Quit the file even if changes. Movement: A Move to end of line, change to insert mode. h Move 1 space backwards (back/left arrow). j Move down 1 line (down arrow). k Move up 1 line (up arrow). l Move 1 space forwards (forward/right arrow) w Move cursor to start of next word. W Same as "w". b Move cursor to start of previous word. B Same as "b". :n Go to line number "n" in the file. Editing: i Enter in to input mode. o Add a line below cursor and enter in to input mode. x Delete character (del key in some cases). D Delete line from right of cursor to end of line. dd Delete entire line. u Undo last edit or restore current line. yy Yank current line. p Put yanked text before the cursor. Searching: /pattern Search for "pattern" in the file going forwards. ?pattern Search for "pattern" in the file going backwards. n Find the next occurrence of pattern found forwards. N Find next occurrence of pattern found backwards. Copy/Cut and Paste yyp Copy n lines to buffer, paste below cursor yyP Copy n lines to buffer, paste above cursor ddp Cut n lines and copy to buffer, paste below cursor ddP Cut n lines and copy to buffer, paste above cursor }}} ==== Practice Using vi ==== '''Remember The vi editor uses "modes"''' The easiest thing to do if you get confused in vi is to press the ESCape key a couple of times and start over with what you were doing. Log in to your VM and... {{{ $ cd $ vi temp.txt }}} vi wil create the file “temp.txt” for you. Press the "i" key to switch to input mode. {{{ Type something like, "VI is great! I think I'll be using vi from now on instead of Word” Press to add lines. Type some more text }}} Save the file that you are in. To do this do: Press the ESCape key for command mode Type “:wq” then hit Enter to save and quit the file (notice the “:” before the “wq”). Copy a large file to your home directory so that you can play around with some more vi commands. We'll copy over your /etc/sysctl.conf file for this exercise. To do this do: {{{ $ cd $ cp /etc/sysctl.conf sysctl.conf.bak }}} Edit the file, but let's start at the bottom of the file: {{{ $ vi + sysctl.conf.bak }}} Go to the first line of the file. Notice the colon (“:”) before the “1”. {{{ :1 }}} Go to line 10, add a new line, and add in some text: {{{ :10 Press the “o” key }}} Add the following text: {{{ ## ## A sample comment ## }}} Delete the three lines you just created: Move to the first line of new text Press the ESCape key Press “dd” to delete a line, repeat until the text is gone Save the file, but don’t exit. {{{ :w press }}} Practice copying and pasting text. Go to line 12, copy 3 lines of text, go to the bottom of the file, place the text there: {{{ ESC (go to command mode) :12 (go to line 12 of the file) 3yy (“yank” 3 lines of text and place in copy buffer) G (go to the end of the file) p (place the contents of the copy buffer here) }}} If want to undo this you would type (in command mode): {{{ u }}} Go to the top of the file, replace all occurrences of “ipv4” with “ipv6”, but prompt for each change: {{{ ESC :1 :%s/ipv4/ipv6/gc }}} Say “yes” or “no” to a few prompts then escape from this mode by pressing ctrl-c and . Go to line 1, search for “kernel”, move to the end of the line, add some text: {{{ ESC :1 /kernel SHIFT-A “text here” ESC }}} Now let’s exit from the file and not save the few changes we’ve made. {{{ :q! }}} === Working with Files === Files on Linux (or any Unix) are case sensitive. This means that FILE1 is different from file1, and /etc/hosts is different from /etc/Hosts (the latter one does not exist on a typical Linux computer). In Linux everything is considered as a file even a directory is a special kind of file. A small overview of some basic and important file handling commands - '''file''': The file utility determines the file type. Linux does not use extensions to determine the file type. The command line does not care whether a file ends in .txt or .pdf. As a system administrator, you should use the file command to determine the file type. - '''cp''': To copy a file, use cp with a source and a target argument. * '''cp -r''': To copy complete directories, use cp -r (the -r option forces recursive copying of all files in all subdirectories). * '''cp -i''': To prevent cp from overwriting existing files, use the -i (for interactive) option. - '''mv''': Use to rename a file or to move the file to another directory. - '''rm''': Use to remove files *'''rm -i''':To prevent yourself from accidentally removing a file. *'''rm -rf''':'''rm -r''' will not remove non-empty directories. However rm accepts several options that will allow you to remove any directory. The rm -rf will erase anything '''Extremely dangerous Command''' {{{ When you are logged on as root, be very careful with rm -rf (the f means force and the r means recursive) since being root implies that permissions don't apply to you. You can literally erase your entire file system by accident. }}} - '''less''':The less command is useful for displaying files that take up more than one screen - '''head/tail''':You can use head to display the first ten lines of a file. and tail to display the last ten lines of a file. you can use both commands with '''-n''' and specify the number of lines - '''cat''':The cat command is one of the most universal tools, yet all it does is copy standard input to standard output. === Exercise === - Create numbers.txt (Containing ten lines of numbers one to ten)file with cat command. {{{ $ cat > numbers.txt }}} Add the lines with enter key at the end. After inserting all the lines press Ctrl + D {{{ one two . . ten }}} - View the file you created using less and cat '''cat''' {{{ $ cat numbers.txt one two three four five six seven eight nine ten }}} '''less''' {{{ $ less numbers.txt }}} Press '''q''' to exit from less - View first four lines and last four lines using head and tail commands {{{ $ head -n 4 numbers.txt one two three four $ tail -n 4 numbers.txt seven eight nine ten }}} - Create another file numbers2.txt(with lines contain eleven to fifteen) {{{ $ cat numbers2.txt eleven twevelve thirteen fourteen fifteen }}} - Combine numbers.txt and numbers2.txt and create numbers3.txt. and view the file. {{{ $ cat numbers.txt numbers2.txt > numbers3.txt $ cat numbers3.txt one two three four five six seven eight nine ten eleven twevelve thirteen fourteen fifteen }}} - Check the file format of the newly created file {{{ $ file numbers3.txt numbers3.txt: ASCII text }}} - Copy all the created files to the test directory. and verify {{{ $ cp numbers.txt numbers2.txt numbers3.txt test/ $ cd test $ ls numbers2.txt numbers3.txt numbers.txt one }}} - Make a copy of test directory as newtest and rename it to numbers {{{ $ cp -r test/ newtest $ mv newtest/ numbers }}} - Delete the test directory {{{ $ rm -rf test }}} === File Permission === - Commands preceded with "$" imply that you should execute the command as a general user - not as root. - Commands preceded with "#" imply that you should be working as root with "sudo" - Commands with more specific command lines (e.g. "RTR-GW>" or "mysql>") imply that you are executing commands on remote equipment, or within another program. '''chmod''': Change file read write permission '''chown''': Change the owner of the file '''chgrp''': Change the group of the file ==== Reference ==== If you look at files in a directory using "ls -al" you will see the permissions for each file and directories. Here is an example: {{{ drwxrwxr-x 3 root root 4096 Feb 25 09:49 directory -rwxr--r-- 12 root root 4096 Feb 16 05:02 file }}} So, the directory has r (read), w (write), x (execute) access for the User and Group. For Other it has r (read) and x (execute) access. The file has read/write/execute access for User and read only access for everyone else (Group and Other). To change permissions you use the '''chmod''' command. chmod uses a base eight (octal) system to configure permissions. Or, you can use an alternate form to specify permissions by column (User/Group/Other) at a time. Permissions have values like this: {{{ Letter Permission Value R read 4 W write 2 X execute 1 - none 0 }}} Thus you can give permissions to a file using the sum of the values for each permission you wish to give for each column. Here is an example: {{{ Letter Permission Value --- none 0 --x execute 1 -w- write only (rarely used) 2 -wx write and execute (rare) 3 r-- read only 4 r-x read and execute 5 rw- read and write 6 rwx read, write, and execute 7 }}} This is just one column. Since we have three areas of permissions (User, Group, Other), it looks like this will all 3 sets: {{{ Permissions Numeric Description equivalent -rw------- 600 User has read & write permission. -rw-r--r-- 644 User has read & write. Group and Other have read permission. -rw-rw-rw- 666 Everyone (User, Group, Other) have read & write permission (dangerous?) -rwx------ 700 User has read, write, & execute permission. -rwxr-xr-x 755 User has read, write, & execute permission. Rest of the world (Other) has read & execute permission (typical for web pages or 644). -rwxrwxrwx 777 Everyone has full access (read, write, execute). -rwx--x--x 711 User has read, write, execute permission. Group and world have execute permission. drwx------ 700 User only has access to this directory. Directories require execute permission to access. drwxr-xr-x 755 User has full access to directory. Everyone else can see the directory. drwx--x--x 711 Everyone can list files in the directory, but Group and Other need to know a filename to do this. }}} ==== Exercise ==== - Go to the numbers directory and get a detailed list {{{ $ cd numbers $ ls -al total 24 drwxr-xr-x 3 dilum dilum 4096 Nov 17 13:53 . drwxrwxrwx 50 dilum dilum 4096 Nov 17 13:10 .. -rw-r--r-- 1 dilum dilum 42 Nov 17 13:08 numbers2.txt -rw-r--r-- 1 dilum dilum 91 Nov 17 13:08 numbers3.txt -rw-r--r-- 1 dilum dilum 49 Nov 17 13:08 numbers.txt drwxr-xr-x 3 dilum dilum 4096 Nov 17 13:08 one }}} - Change file permission as follows {{{ $ chmod 044 numbers.txt }}} Now you have remove read privilege try view the file using cat {{{ $ chmod 444 numbers.txt }}} Now you have set privilege as read only. Open the file via vi editor and try to edit the file - Switch to root user {{{ $ sudo su }}} - Change the ownership and group of the numbers2.txt to root and make it read only for all the other users. - Change the ownership and group of the numbers3.txt to root and remove all the privileges from all the other users. - Switch back to your user and try to view numbers3.txt and try to edit numbers2.txt {{{ # chown root numbers2.txt # chgrp root numbers2.txt # chown root numbers3.txt # chgrp root numbers2.txt # chmod 700 numbers3.txt # chmod 744 numbers2.txt # su 'Your username' $ cat numbers3.txt cat: numbers3.txt: Permission denied $ cat > numbers2.txt bash: numbers2.txt: Permission denied }}} === More Linux Commands === - '''who''': who command will give you information about who is logged on the system. {{{ $ who root pts/0 2014-10-10 23:07 (10.104.33.101) paul pts/1 2014-10-10 23:30 (10.104.33.101) laura pts/2 2014-10-10 23:34 (10.104.33.96) }}} * '''whoami''' command tells you your username {{{ $ whoami paul }}} - '''df -dh''': report file system disk space usage {{{ $ df -h Filesystem Size Used Avail Use% Mounted on /dev/sda1 451G 141G 287G 33% / udev 10M 0 10M 0% /dev tmpfs 774M 19M 755M 3% /run .. .. }}} - '''man''': Will give you man pages (also called manual pages) on your Unix or Linux computer {{{ $man ls $man cp }}} - '''date''': Will give you the date and time of the system {{{ $ date Thu Nov 17 16:01:52 IST 2016 }}} - '''ln''': Use to create links between files. Frequently use with '''-s''' to create symbolic links {{{ $ ln -s file2 symlink_to_file2 }}} - '''ps''': report a snapshot of the current processes. frequently use with -aux. {{{ $ ps -aux USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 0.0 0.0 111476 3400 ? Ss 07:39 0:01 /sbin/init root 2 0.0 0.0 0 0 ? S 07:39 0:00 [kthreadd] root 3 0.3 0.0 0 0 ? S 07:39 1:40 [ksoftirqd/0] }}} == Final Step (Needed for the next Hands-on)== You will use This PC (pc."your domain".ws.ac.lk) in your next pfSense hands-on as a client machine. In the next step we are going to install an GUI for linux PC. It will make things easy for you to carry on your pfSense Hands-on. {{{ sudo apt-get update }}} This command will update your repositories. {{{ sudo apt-get install xubuntu-desktop }}} This will install Xfce Desktop Environment.