strace Analysis

Requirements

pandas                    2.2.1
matplotlib                3.8.4
numpy                     1.26.4
cacheout                  0.15.0

1. Trace process using strace

You can see more detail about strace in here

strace -a1 -s0 -f -C -tt -v -yy -z -e trace=read,write,pread64,pwrite64,lseek,mmap,munmap,mremap,creat,open,openat,memfd_create,close,stat,fstat,lstat,fork,clone,socket,socketpair,pipe,pipe2,dup,dup2,dup3,fcntl,eventfd,eventfd2 -o input.txt [program]

• read : read bytes for open file
  
• write : write bytes for open file
  
• pread64 : read from a file descriptor at a given offset
  
• pwrite64 : write to a file descriptor at a given offset
  
• lseek : move position of next read or write
  
• mmap : map files or devices into memory
  
• munmap : unmap files or devices into memory
  
• mremap : remap a virtual memory address
  
• creat : creates file and connect to open file (-1 on error)
  
• open : connect to open file (-1 on error)
  
• openat : open a file relative to a directory file descriptor (-1 on error)
  
• memfd_create : create an anonymous file
  
• close : disconnect open file (zero on success, -1 on error)
  
• stat : get file status (zero on success, -1 on error)
  
• fstat : get file status (zero on success, -1 on error)
  
• lstat : get file status(if path is a symbolic link, then the link itself is stat-ed, not the file that it refers to) (zero on success, -1 on error)
  
• fork : create a child process
  
• clone : create a child process
  
• socket : create an endpoint for communication
  
• socketpair : create a pair of connected sockets
  
• pipe/pipe2 : create pipe
  
• dup/dup2/dup3 : duplicate a file descriptor
  
• fcntl : manipulate file descriptor
  
• eventfd/eventfd2 : create a file descriptor for event notification
  

2. stcparse.py : Parse strace log file   

time	pid	op	cpid	fd	offset	flag	length	mem_addr	filename	inode
time	pid	read/write		fd			(return)count		<filename>
time	pid	pread64/pwrite64		fd	offset (pos)		(return)count		<filename>
time	pid	lseek		fd	(return)offset	origin	offset		<filename>
time	pid	mmap		fd	offset		length	(return)addr	<filename>
time	pid	munmap					length	addr
time	pid	mremap					new_len	old_addr || (return)new_addr
time	pid	creat		(return)fd					*pathname=><filename>
time	pid	open		(return)fd		flags			*filename=><filename>
time	pid	openat		(return)fd		flags			*pathname=><filename>
time	pid	memfd_create		(return)fd		flags			*name =><filename>
time	pid	close		fd					<filename>
time	pid	stat					st_size		*path	st_ino
time	pid	fstat		fd			st_size		<filename>	st_ino
time	pid	lstat					st_size		*path	st_ino
time	pid	fork	(return)c_pid
time	pid	clone	(return)c_pid			flags
time	pid	socket		(return)fd					<socket>
time	pid	socketpair		sp[0] || sp[1]					<socket1>||<socket2>
time	pid	pipe/pipe2		pipefd[0] || pipefd[1]					<pipe1>||<pipe2>
time	pid	dup/dup2/dup3		old_fd || (return)fd					<filename1>||<filename2>
time	pid	fcntl		fd || (return)fd		flags			<filename1>||<filename2>
time	pid	eventfd/eventfd2		(return)fd			initval		<filename>

3. Analyze workload characteristics

fileio/ : File I/O analysis

• Extract only the traces related to file I/O
• Analyze file I/O characteristics

💡 Execute

Using main.py

python main.py [-i <input_log_file>] [-o <output_directory>] [-t <figure_title>] [-b <blocksize>]

• #1 must be performed before in order to do the following.

Using run.sh

./run.sh [-i <input_log_file>] [-o <output_directory>] [-s <process>] [-f] [-t <figure_title>] [-b <blocksize>]

• You can use -s to run #1 concurrently.

Usage:  ./run.sh -i <input> [options]
        -i | --input  %  (set input file name)
        -o | --output  %  (set output directory name)
        -s | --strace  %   (process to track with strace)
        -t | --title  %   (title of graphs)
        -f | --file     (whether analyze file IO or not)
        -b | --blocksize  %   (blocksize, default: 4KB)

Example

./run.sh -i firefox-v1.txt -o firefox-v1 -f -s "firefox"
./run.sh -i mnist-v3.txt -o mnist-v3 -f -s "python3 mnist_cnn.py"
./run.sh -i iris-v2.txt -o iris-v2 -f