llnl / fdtree Goto Github PK

/******************************************************************************\
*                                                                              *
*        Copyright (c) 2004, The Regents of the University of California       *
*      See the file COPYRIGHT for a complete copyright notice and license.     *
*                                                                              *
\******************************************************************************/

             FILE AND DIRECTORY TREE CREATION/REMOVAL TIMING TEST
********************************** WARNING ON ******************************
BE VERY CAREFUL WITH THIS TEST AS IT CAN CREATE A VERY LARGE DIRECTORY TREE
AND A GREAT DEAL OF DATA SIMPLY BY CHOOSING THE WRONG PARAMATERS.  STAY WITH
THE DEFAULTS UNTIL YOU UNDERSTAND THE PARAMATERS...
********************************** WARNING OFF *****************************

This script recursively creates level_depth directories below pathname with 
files_per_dir files in every directory of size size_of_files.  
Every directory except leaf directories then have dirs_per_level 
subdirectories and so on.  Default starting point is "LEVEL0" directory in
the current working directory.
The directories are created first, by recursion and then the files in each
directory are created by writing to them by another recursion.  
Then the files are deleted by another recursion. 
Finally the directories are removed by recursion.  
Times for each operation are reported.

Written by Mark K. Seager ([email protected], 925-423-3141) and
           Bill Loewe ([email protected], 925-422-5587)

********************************************************************************

fdtree.bash [-C] [-D] [-R] [-l level_depth] [-d dirs_per_level]
	    [-f files_per_dir] [-s size_of_files (in file system blocks)]
	    [-o pathname]
	    -C create structure only
	    -D turns on debugging
	    -R remove structure only
	    -l is the number of recursive levels below LEVEL0
	    -d is the number of directories to create per level
	    -f is the number of files to create per directory
	    -o is the starting directory pathname
	    -s is the file size (in blocks, 4096 for Linux, to create)

WARNING: directories and files created increases polynomically with -l.
Be careful, very careful.  Your filesystem may suffer...

EXAMPLE: fdtree.bash -d 1 -l 2 -f 10000 -s 10000
	This example is a file stress test and creates two levels with one
	directory each and 10K files in each directory of size 10K*4K blocks.
	This is 40,960,000B = 40.96 MB of data per file
	or 2*409,600,000,000B = 819.2 GB of data.
	You should NOT attempt this at home...

EXAMPLE: fdtree.bash -d 10000 -l 100
	This is a directory stress test and creates 100 levels with
	10K directories per level.
	This is 10K directories in the first level and
	(10K)*(10K) directories in the second level and
	(10K)*(10K)*(10K) directories in the third level and so on.
	10K**100 = 10**500 directories at the 100th level.
	You should NOT attempt this at home OR work...

********************************************************************************

sample output:
% time fdtree.bash -f 3 -d 5
fdtree: starting at ./LEVEL0
	creating 4 directory levels with 5 directories at each level
	for a total of 781 directories
	with 3 files of size 40 KiB per directory
	for a total of 2343 files and 9372 KiB

Thu Jun 10 11:07:55 2004
DIRECTORY CREATE TIME IN, OUT, TOTAL	= 0, 0, 0
	Directory creates per second	= 1114

Thu Jun 10 11:07:55 2004
FILE CREATE TIME IN, OUT, TOTAL	= 0, 11, 10
	File creates per second		= 72
	KiB per second			= 875

Thu Jun 10 11:08:06 2004
FILE REMOVE TIME IN, OUT, TOTAL	= 11, 14, 3
	File removals per second	= 684

Thu Jun 10 11:08:09 2004
DIRECTORY REMOVE TIME IN, OUT, TOTAL	= 14, 15, 0
	Directory removals per second	= 2790

Thu Jun 10 11:08:10 2004
0.310u 1.020s 0:15.52 8.5%	0+0k 0+0io 400pf+0w