FALL 2019 CSE221 Project : System Measurement Project

Completed on Mac

------------------------------
Rohit Gupta
Kien Nguyen
Ben Zhou
------------------------------

Table of Contents

• Directory Structure
• Build
• Executing Experiments
• Running All Experiments
• Important Know-how for Mac

Directory Structure

├── Makefile
├── operations
│   ├── 1_cpu_scheduling_and_os_services
│   │   ├── README.md
│   │   ├── context_switch_time
│   │   │   ├── context_switch_kthreads.c
│   │   │   ├── context_switch_processes.c
│   │   │   └── logs/
│   │   ├── measurement_overhead
│   │   │   ├── logs/
│   │   │   ├── loop_overhead.c
│   │   │   └── reading_time_overhead.c
│   │   ├── procedure_call
│   │   │   ├── logs/
│   │   │   └── procedure_call.c
│   │   ├── system_call
│   │   │   ├── logs/
│   │   │   └── system_call.c
│   │   └── task_creation_time
│   │       ├── creation_kthreads.c
│   │       ├── creation_processes.c
│   │       └── logs/
│   ├── 2_memory
│   │   ├── README.md
│   │   ├── cpuid_memory_info
│   │   │   └── cpuid_memory_info.c
│   │   ├── page_fault_time
│   │   │   ├── logs/
│   │   │   └── page_fault_time.c
│   │   ├── ram_access_time
│   │   │   ├── logs/
│   │   │   └── ram_access_time.c
│   │   └── ram_bandwidth
│   │       ├── logs/
│   │       ├── prepare.py
│   │       ├── ram_bandwidth.c
│   │       └── ram_bandwidth.c.template
│   ├── 3_network
│   │   ├── README.md
│   │   ├── connection_overhead
│   │   │   ├── connection_overhead_setup.c
│   │   │   ├── connection_overhead_teardown.c
│   │   │   └── logs/
│   │   ├── peak_bandwidth
│   │   │   ├── logs/
│   │   │   └── peak_bandwidth.c
│   │   └── round_trip_time
│   │       ├── logs/
│   │       └── round_trip_time.c
│   └── 4_file_system
│       ├── README.md
│       ├── contention
│       │   ├── contention.c
│       │   └── file_contention.sh
│       ├── file_cache_size
│       │   ├── file_cache_size.c
|       |   ├── file_cache_size.sh
│       │   └── logs/
│       └── file_read_time
│           ├── file_read_time.c
│           ├── file_read_time_sizes.sh
│           ├── logs/
│           ├── remote_linux_file_create.sh
│           └── remote_log/
└── utils
    ├── repeat_cmd.sh
    └── utils.h

Build

We used Makefile to specify experiment build dependencies and their rules for this project. So, use the following command from the top directory to generate all executables in created build folder.

gcc -v
Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr --with-gxx-include-dir=/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include/c++/4.2.1
Apple LLVM version 10.0.0 (clang-1000.11.45.5)
Target: x86_64-apple-darwin19.0.0
Thread model: posix
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

make

Executing Experiments

1. CPU, Scheduling, and OS Services

   • Measurement overhead

     sudo ./utils/repeat_cmd.sh ./build/loop_overhead 100
     

     sudo ./utils/repeat_cmd.sh ./build/measurement_overhead 100
     

   • Procedure call overhead

     sudo ./build/procedure_call
     

   • System call overhead

     sudo ./utils/repeat_cmd.sh ./build/system_call 100
     

   • Task creation time

     sudo ./utils/repeat_cmd.sh build/creation_processes 20
     

     sudo ./utils/repeat_cmd.sh build/creation_kthreads 20
     

   • Context switch time

     sudo ./utils/repeat_cmd.sh ./build/context_switch_processes 100
     

     sudo ./utils/repeat_cmd.sh ./build/context_switch_kthreads 100
     

2. Memory

   • RAM access time

     sudo ./build/ram_access_time
     

   • RAM bandwidth

     sudo ./build/ram_bandwidth
     

   • Page fault service time

     sudo ./utils/repeat_cmd.sh ./build/page_fault_time 100
     

3. Network

   • Round trip time
     Run following command to create a dummy echo server either locally or remotely on port 2000.

     ncat -l 2000 --keep-open --exec "/bin/cat"
     

     Local

     ./utils/repeat_cmd.sh ./build/round_trip_time 100
     

     Remote
     Manually compile the executable for this case, specifying the remote server IP Address.

     gcc -Werror -O0 -D SERVERADDR=\"x.x.x.x\" -D SERVERPORT=2000 -D DATABYTES=56 -o build/round_trip_time_remote operations/3_network/round_trip_time/round_trip_time.c
     ./utils/repeat_cmd.sh ./build/round_trip_time_remote 100
     

   • Peak bandwidth First run the server with

     ./build/peak_bandwidth -s
     

     Then

     ./utils/repeat_cmd.sh build/peak_bandwidth 100
     

   • Connection overhead
     Run following command to create a dummy server either locally or remotely on port 2000.

     ncat -l 2000 --keep-open
     

     Setup

     sudo ./utils/repeat_cmd.sh ./build/connection_overhead_setup 100
     

     Manually compile the executable for this case, specifying the remote server IP Address.

     gcc -Werror -O0 -D SERVERADDR=\"x.x.x.x\" -D SERVERPORT=2000 -o build/connection_overhead_setup_remote operations/3_network/connection_overhead/connection_overhead_setup.c
     sudo ./utils/repeat_cmd.sh ./build/connection_overhead_setup_remote 100
     

     Teardown

     ./utils/repeat_cmd.sh ./build/connection_overhead_teardown 100
     

     Manually compile the executable for this case, specifying the remote server IP Address.

     gcc -Werror -O0 -D SERVERADDR=\"x.x.x.x\" -D SERVERPORT=2000 -o build/connection_overhead_teardown_remote operations/3_network/connection_overhead/connection_overhead_teardown.c
     ./utils/repeat_cmd.sh ./build/connection_overhead_teardown_remote 100
     

4. File System

   • Size of file cache

     sudo ./build/file_cache_size.sh ./build/file_cache_size
     

   • File read time
     Random Access

     sudo ./build/file_read_time_sizes.sh ./build/file_read_time
     

     Sequential Access

     sudo ./build/file_read_time_sizes.sh ./build/file_read_time_seq
     

   • Remote file read time
     Create fake files on remote disk using following command.

     ./build/remote_linux_file_create.sh
     

     Random Access

     sudo ./build/file_read_time_sizes.sh ./build/file_read_time /locally/mounted/path/containing/temp/files
     

     Sequential Access

     sudo ./build/file_read_time_sizes.sh ./build/file_read_time_seq /locally/mounted/path/containing/temp/files
     

   • Contention

     sudo ./build/file_contention.sh ./build/contention
     

Running All Experiments

make
sudo ./run_all.sh > run_all.log

Please note that it does not run any remote experiments since they require additional setup detailed above.

Important Know-how for Mac

Increase the priority of a process

Use 'nice' shell command or system call in C. Refer for system call in C - http://u.cs.biu.ac.il/~linraz/os/OS5.pdf
For usage of shell command - https://www.techrepublic.com/article/how-to-adjust-cpu-priority-using-apples-terminal/
Remember to run as superuser if doing in a C program!

Use single core and disable hyperthreading

For macOS (Need Xcode and its Developer Tools installed),

1. Open Instruments app (Could search in spotlight)
2. From top left, Instruments -> Preferences -> CPUs

Disable TurboBoost

For macOS, I used this app - https://www.rugarciap.com/turbo-boost-switcher-for-os-x/
Just note that you should move the app to Applications folder and run it from there.

Intel® 64 and IA-32 Architectures Software Developer’s Manual

Useful for finding precisely about instructions and asm code. Refer - https://www.intel.com/content/dam/www/public/us/en/documents/manuals/64-ia-32-architectures-software-developer-instruction-set-reference-manual-325383.pdf

create a dummy echo server using nmap's ncat tool

ncat -l 2000 --keep-open --exec "/bin/cat"

create a dummy server using nmap's ncat tool

ncat -l 2000 --keep-open

create a fake large file in MacOs

mkfile -n 1g temp_1GB_file