Parallel Tar With Validation¶
Compute Resources
Have questions or need help with compute, including activation or issues? Follow this link.
Overview¶
The purpose of this document is to demonstrate steps required to parallel tar using RIS-hosted image gcr.io/ris-registry-shared/parallel-tar. Input variable and process execution validation included.
Interactive Command-Line Session¶
bsub -n 2 -Is -q general-interactive -a 'docker(gcr.io/ris-registry-shared/parallel-tar)' /bin/bash
parallel-tar.py -s path/to/source_dir/ -d path/to/dest_dir/
Non-Interactive Session¶
bsub -n 2 -q general -a 'docker(gcr.io/ris-registry-shared/parallel-tar)' "parallel-tar.py -s path/to/source_dir/ -d path/to/dest_dir/"
Expected Output¶
Running tar with parameters
source directory: path/to/source_dir/
destination directory: path/to/dest_dir/
threads: 4
tar file name: path/to/dest_dir/source_dir.tar.gz
remove source directory: False
Validating tar contents
Parallel-tar completed successfully
Script Variables¶
-s –source-dir source directory to tar and compress
-d –dest-dir destination directory to place tar compressed file
-t –threads number of threads for the compress algorithm, default 4
-n –tar-file-name name of tar file with out the .tar.gz extension
-r –remove-source-dir Remove the source directory when tar process completes, default False
