- What are directories, if everything on Linux is a file?
- 1 Answer 1
- Understanding Unix/Linux filesystem and files: Everything is an inode
- Directory Tree
- Accessing directories as if they’re file
- Unix / Linux — Directory Management
- Home Directory
- Absolute/Relative Pathnames
- Listing Directories
- Creating Directories
- Creating Parent Directories
- Removing Directories
- Changing Directories
- Renaming Directories
- The directories . (dot) and .. (dot dot)
What are directories, if everything on Linux is a file?
Very often beginners hear a phrase «Everything is a file on Linux/Unix». However, what are the directories then? How are they different from files?
1 Answer 1
Note: originally this was written to support my answer for Why is the current directory in the ls command identified as linked to itself? but I felt that this is a topic that deserves to stand on its own, and hence this Q&A .
Understanding Unix/Linux filesystem and files: Everything is an inode
Essentially, a directory is just a special file, which contains list of entries and their ID.
Before we begin the discussion, it’s important to make a distinction between a few terms and understand what directories and files really represent. You may have heard the expression «Everything is a file» for Unix/Linux. Well, what users often understand as file is this: /etc/passwd — An object with a path and a name. In reality, a name (be it a directory or file, or whatever else) is just a string of text — a property of the actual object. That object is called inode or I-number, and stored on disk in the inode table. Open programs also have inode tables, but that’s not our concern for now.
Unix’s notion of a directory is as Ken Thompson put it in a 1989 interview:
. And then some of those files, were directories which just contained name and I-number.
An interesting observation can be made from Dennis Ritchie’s talk in 1972 that
«. directory is actually no more than a file, but its contents are controlled by the system, and the contents are names of other files. (A directory is sometimes called a catalog in other systems.)»
. but there’s no mention of inodes anywhere in the talk. However, the 1971 manual on format of directories states:
The fact that a file is a directory is indicated by a bit in the flag word of its i—node entry.
Directory entries are 10 bytes long. The first word is the i—node of the file represented by the entry, if non—zero; if zero, the entry is empty.
So it has been there since the beginning.
Directory and inode pairing is also explained in How are directory structures stored in UNIX filesystem?. a directory itself is a data structure, more specifically: a list of objects (files and inode numbers) pointing to lists about those objects (permissions, type, owner, size, etc.). So each directory contains its own inode number, and then filenames and their inode numbers. Most famous is the inode #2 which is / directory. (Note, though that /dev and /run are virtual filesystems, so since they are root folders for their filesystem, they also have inode 2; i.e. an inode is unique on its own fileystem, but with multiple filesystems attached, you have non-unique inodes ). the diagram borrowed from the linked question probably explains it more succinctly:
All that information stored in the inode can be accessed via stat() system calls, as per Linux man 7 inode :
Each file has an inode containing metadata about the file. An application can retrieve this metadata using stat(2) (or related calls), which returns a stat structure, or statx(2), which returns a statx structure.
Is it possible to access a file only knowing its inode number ( ref1 , ref2 )? On some Unix implementations it is possible but it bypasses permission and access checks, so on Linux it’s not implemented, and you have to traverse the filesystem tree (via find -inum 1234 for example) to get a filename and its corresponding inode.
On the source code level, it’s defined in the Linux kernel source and is also adopted by many filesystems that work on Unix/Linux operating systems, including ext3 and ext4 filesystems (Ubuntu default). Interesting thing: with data being just blocks of information, Linux actually has inode_init_always function that can determine if an inode is a pipe ( inode->i_pipe ). Yes, sockets and pipes are technically also files — anonymous files, which may not have a filename on disk. FIFOs and Unix-Domain sockets do have filenames on filesystem.
Data itself may be unique, but inode numbers aren’t unique. If we have a hard link to foo called foobar, that will point to inode 123 as well. This inode itself contains information as to what actual blocks of disk space are occupied by that inode. And that’s technically how you can have . being linked to the directory filename. Well,almost: you can’t create hardlinks to directories on Linux yourself, but filesystems can allow hard links to directories in a very disciplined way, which makes a constraint of having only . and .. as hard links.
Directory Tree
Filesystems implement a directory tree as one of the tree datastructures. In particular,
Key point here is that directories themselves are nodes in a tree, and subdirectories are child nodes, with each child having a link back to the parent node. Thus, for a directory link the inode count is minimum 2 for a bare directory (link to directory name /home/example/ and link to self /home/example/. ), and each additional subdirectory is an extra link/node:
# new directory has link count of 2 $ stat --format=%h . 2 # Adding subdirectories increases link count $ mkdir subdir1 $ stat --format=%h . 3 $ mkdir subdir2 $ stat --format=%h . 4 # Count of links for root $ stat --format=%h / 25 # Count of subdirectories, minus . $ find / -maxdepth 1 -type d | wc -l 24
The diagram found on Ian D. Allen’s course page shows a simplified very clear diagram:
WRONG — names on things RIGHT — names above things ======================= ========================== R O O T —> [etc,bin,home] [passwd] [ls,rm] [abcd0001] | / \ \ | / \ | | ls rm abcd0001 —> | [.bashrc] | | | | passwd .bashrc —>
The only thing in the RIGHT diagram that’s incorrect is that files aren’t technically considered being on the directory tree itself: Adding a file has no effects on the links count:
$ mkdir subdir2 $ stat --format=%h . 4 # Adding files doesn't make difference $ cp /etc/passwd passwd.copy $ stat --format=%h . 4
Accessing directories as if they’re file
The whole point with «everything is a file» is not that you have some random filename (indeed, sockets and pipes show that «file» and «filename» have nothing to do with each other), but the fact that you can use common tools to operate on different things.
Considering that a directory is just a special case of a file, naturally there have to be APIs that allow us to open/read/write/close them in a similar fashion to regular files.
That’s where dirent.h C library comes into place, which defines the dirent structure, which you can find in man 3 readdir:
Thus, in your C code you have to define struct dirent *entry_p , and when we open a directory with opendir() and start reading it with readdir() , we’ll be storing each item into that entry_p structure. Of course, each item will contain the fields defined in the template for dirent shown above.
The practical example of how this works can be found in my answer on How to list files and their inode numbers in the current working directory.
Note that the POSIX manual on fdopen states that «[t]he directory entries for dot and dot-dot are optional» and readdir manual states struct dirent is only required to have d_name and d_ino fields.
Note on «writing» to directories: writing to a directory is modifying its «list» of entries. Hence, creating or removing a file is directly associated with directory write permissions, and adding/removing files is the writing operation on said directory.
Unix / Linux — Directory Management
In this chapter, we will discuss in detail about directory management in Unix.
A directory is a file the solo job of which is to store the file names and the related information. All the files, whether ordinary, special, or directory, are contained in directories.
Unix uses a hierarchical structure for organizing files and directories. This structure is often referred to as a directory tree. The tree has a single root node, the slash character (/), and all other directories are contained below it.
Home Directory
The directory in which you find yourself when you first login is called your home directory.
You will be doing much of your work in your home directory and subdirectories that you’ll be creating to organize your files.
You can go in your home directory anytime using the following command −
Here ~ indicates the home directory. Suppose you have to go in any other user’s home directory, use the following command −
To go in your last directory, you can use the following command −
Absolute/Relative Pathnames
Directories are arranged in a hierarchy with root (/) at the top. The position of any file within the hierarchy is described by its pathname.
Elements of a pathname are separated by a /. A pathname is absolute, if it is described in relation to root, thus absolute pathnames always begin with a /.
Following are some examples of absolute filenames.
/etc/passwd /users/sjones/chem/notes /dev/rdsk/Os3
A pathname can also be relative to your current working directory. Relative pathnames never begin with /. Relative to user amrood’s home directory, some pathnames might look like this −
To determine where you are within the filesystem hierarchy at any time, enter the command pwd to print the current working directory −
Listing Directories
To list the files in a directory, you can use the following syntax −
Following is the example to list all the files contained in /usr/local directory −
$ls /usr/local X11 bin gimp jikes sbin ace doc include lib share atalk etc info man ami
Creating Directories
We will now understand how to create directories. Directories are created by the following command −
Here, directory is the absolute or relative pathname of the directory you want to create. For example, the command −
Creates the directory mydir in the current directory. Here is another example −
This command creates the directory test-dir in the /tmp directory. The mkdir command produces no output if it successfully creates the requested directory.
If you give more than one directory on the command line, mkdir creates each of the directories. For example, −
Creates the directories docs and pub under the current directory.
Creating Parent Directories
We will now understand how to create parent directories. Sometimes when you want to create a directory, its parent directory or directories might not exist. In this case, mkdir issues an error message as follows −
$mkdir /tmp/amrood/test mkdir: Failed to make directory "/tmp/amrood/test"; No such file or directory $
In such cases, you can specify the -p option to the mkdir command. It creates all the necessary directories for you. For example −
The above command creates all the required parent directories.
Removing Directories
Directories can be deleted using the rmdir command as follows −
Note − To remove a directory, make sure it is empty which means there should not be any file or sub-directory inside this directory.
You can remove multiple directories at a time as follows −
$rmdir dirname1 dirname2 dirname3 $
The above command removes the directories dirname1, dirname2, and dirname3, if they are empty. The rmdir command produces no output if it is successful.
Changing Directories
You can use the cd command to do more than just change to a home directory. You can use it to change to any directory by specifying a valid absolute or relative path. The syntax is as given below −
Here, dirname is the name of the directory that you want to change to. For example, the command −
Changes to the directory /usr/local/bin. From this directory, you can cd to the directory /usr/home/amrood using the following relative path −
Renaming Directories
The mv (move) command can also be used to rename a directory. The syntax is as follows −
You can rename a directory mydir to yourdir as follows −
The directories . (dot) and .. (dot dot)
The filename . (dot) represents the current working directory; and the filename .. (dot dot) represents the directory one level above the current working directory, often referred to as the parent directory.
If we enter the command to show a listing of the current working directories/files and use the -a option to list all the files and the -l option to provide the long listing, we will receive the following result.
$ls -la drwxrwxr-x 4 teacher class 2048 Jul 16 17.56 . drwxr-xr-x 60 root 1536 Jul 13 14:18 .. ---------- 1 teacher class 4210 May 1 08:27 .profile -rwxr-xr-x 1 teacher class 1948 May 12 13:42 memo $