No edit summary |
No edit summary |
||
(3 intermediate revisions by the same user not shown) | |||
Line 20: | Line 20: | ||
Usage | Usage | ||
./parB <Nr. of workers | ./parB <Nr. of workers> <file> [preferences to master/workers] | ||
Example usage: | Example usage: | ||
Line 58: | Line 58: | ||
= Files = | = Files = | ||
* [ | == parB.sh == | ||
<pre> | |||
#!/bin/bash | |||
PROBCOMMAND=probcli | |||
if [ $# -lt 2 ] | |||
then | |||
echo "Too few parameters ($#) for parB" | |||
echo "Usage ./parB <Nr. of workers> <file> [preferences to master/workers]" | |||
exit -1 | |||
else | |||
PARB=$0 | |||
CORES=$1 | |||
FILE=$2 | |||
shift | |||
shift | |||
echo "Running ProB in Parallel (on .prob files)" | |||
# dirname | |||
if [ -h "$PARB" ] | |||
then | |||
realname=`readlink "$PARB"` | |||
dirname=`dirname "$realname"` | |||
else | |||
dirname=`dirname "$PARB"` | |||
fi | |||
#ulimit -d unlimited | |||
echo "Directory: $dirname" | |||
# dirname | |||
if [ -h "$PARB" ] | |||
then | |||
realname=`readlink "$PARB"` | |||
dirname=`dirname "$realname"` | |||
else | |||
dirname=`dirname "$PARB"` | |||
fi | |||
#ulimit -d unlimited | |||
# setting the library path to find the zmq shared libraries | |||
system=`uname` | |||
if [ $system = "Linux" ]; then | |||
export LD_LIBRARY_PATH="$dirname/lib${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}" | |||
fi | |||
echo "Directory: $dirname" | |||
echo "Starting workers in parallel" | |||
echo "$dirname/$PROBCOMMAND -zmq_worker <worker-id> $*" | |||
for (( i = 0 ; i < $CORES; i++ )) | |||
do | |||
"$dirname/$PROBCOMMAND" -zmq_worker $i $* & | |||
done | |||
##Usage: ./proxy <master IP> <port start> <own IP> <queue threshold> <logfile> [<proxynumber>] | |||
echo "Starting proxy server: $dirname/lib/proxy localhost 5000" | |||
"$dirname/lib/proxy" localhost 5000 localhost 50 loggyMcLogface-proxy & | |||
echo "Starting master: $dirname/$PROBCOMMAND -bf -zmq_master master $FILE $*" | |||
time "$dirname/$PROBCOMMAND" -bf -zmq_master master $FILE $* | |||
fi | |||
</pre> | |||
== parB2.sh == | |||
This file provides a few more options: | |||
<pre> | |||
#!/bin/bash | |||
PROBCOMMAND=probcli | |||
if [ $# -lt 5 ] | |||
then | |||
echo "Usage ./parB2 <Nr. of workers> <minimum que size> <max number of states> <Port (usually 5000)> <logdir> <model>" | |||
exit -1 | |||
else | |||
echo "Running ProB in Parallel (on .prob files)" | |||
# dirname | |||
if [ -h "$0" ] | |||
then | |||
realname=`readlink "$0"` | |||
dirname=`dirname "$realname"` | |||
else | |||
dirname=`dirname "$0"` | |||
fi | |||
ulimit -d unlimited | |||
echo "Directory: $dirname" | |||
mkdir -p $5 | |||
# dirname | |||
if [ -h "$0" ] | |||
then | |||
realname=`readlink "$0"` | |||
dirname=`dirname "$realname"` | |||
else | |||
dirname=`dirname "$0"` | |||
fi | |||
ulimit -d unlimited | |||
# setting the library path to find the zmq shared libraries | |||
system=`uname` | |||
if [ $system = "Linux" ]; then | |||
export LD_LIBRARY_PATH="$dirname/lib${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}" | |||
fi | |||
echo "Directory: $dirname" | |||
#cd $dirname | |||
#ls | |||
echo "Starting workers in parallel" | |||
for (( i = 0 ; i < $1; i++ )) | |||
do | |||
"$dirname/$PROBCOMMAND" -bf -zmq_worker $i -p logdir $5 & | |||
done | |||
echo "Starting proxy server: $dirname/lib/proxy localhost $4 localhost $2 $5/log-proxy " | |||
"$dirname/lib/proxy" localhost $4 localhost $2 $5/log-proxy & | |||
echo "Starting master: $dirname/$PROBCOMMAND -bf -zmq_master master -p queue_threshold $2 -p max_states $3 -p port $4 -p logdir $5" | |||
time "$dirname/$PROBCOMMAND" -bf -zmq_master master $6 -p queue_threshold $2 -p max_states $3 -p port $4 -p logdir $5 | |||
fi | |||
</pre> |
This page explains how to run the distributed model checking prototype.
Note that the implementation does not work with Windows, only Linux andMac OS are supported.
It is required to set the limits for shared memory on some systems, this can be done using sysctl. Here is a little script that sets the limits. It takes the size of shared memory as parameter (usually the size of your memory in GB). You need to run the script with root rights.
#!/bin/bash if [ $# -gt 0 ]; then echo "Setting SHM sizes:" sysctl -w kern.sysv.shmmax=`perl -e "print 1073741824*$1"` sysctl -w kern.sysv.shmseg=4096 sysctl -w kern.sysv.shmall=`perl -e "print 262144*$1"` echo "Here are the current values:" sysctl -a | grep shm else echo "You need to provide the size of shared memort (in full GB)" fi
After setting up shared memory, you can use the parB.sh script that comes with the ProB distribution (see Download).
Usage
./parB <Nr. of workers> <file> [preferences to master/workers]
Example usage:
$ ./parB.sh 2 ~/parB.log scheduler.mch
The script can only be used for computation on a single physical computer. If you want to use multiple computers, the setup is a bit more complex:
lib/hasher <MASTER_IP> <MASTER_PORT> 1
probcli -zmq_worker2 <MASTER_IP> <MASTER_PORT> 0
probcli -zmq_master2 <MIN QUEUE SIZE> <MAX NR OF STATES> <MASTER_PORT> 0 <LOGFILE> <MODEL_FILE>
The minimal queue length is used to determine if a worker is allowed to share its queue. The experiments have shown, that a number between 10 and 100 is fine. parB will stop after (at least) the maximal number of states have been explored, a value of -1 will explore all states (beware of this, if the state space is infinite!).
As a rule of thumb use one real core for each of the processes. On hyperthreads the model checking still becomes faster, but the speedup is only 1/4 for each additional hyperthread.
We plan to develop a control interface that allows configuring the logical network in a more convenient way and running the model checker from within ProB.
You can use preferences in parB.sh (and the master) :
./parB <Nr. of workers> <logfile> <file> <additional probcli options> ./probcli <additional probcli options> -zmq_master2 <MIN QUEUE SIZE> <MAX NR OF STATES> <MASTER_PORT> 0 <LOGFILE> <MODEL_FILE> <additional probcli options>
If you use -strict, parB will stop as soon as a violation is found, otherwise parB will explore the full state space (up to the maximal number of states)
If something goes wrong it may be necessary to clean up your shared memory. You can find out if there are still memory blocks occupied using ipcs. Removal can be done using:
ipcrm -M `ipcs | grep <YOUR USERNAME> | grep -o "0x[^ ]*" | sed ':a;N;$!ba;s/\n/ -M /g'`
#!/bin/bash PROBCOMMAND=probcli if [ $# -lt 2 ] then echo "Too few parameters ($#) for parB" echo "Usage ./parB <Nr. of workers> <file> [preferences to master/workers]" exit -1 else PARB=$0 CORES=$1 FILE=$2 shift shift echo "Running ProB in Parallel (on .prob files)" # dirname if [ -h "$PARB" ] then realname=`readlink "$PARB"` dirname=`dirname "$realname"` else dirname=`dirname "$PARB"` fi #ulimit -d unlimited echo "Directory: $dirname" # dirname if [ -h "$PARB" ] then realname=`readlink "$PARB"` dirname=`dirname "$realname"` else dirname=`dirname "$PARB"` fi #ulimit -d unlimited # setting the library path to find the zmq shared libraries system=`uname` if [ $system = "Linux" ]; then export LD_LIBRARY_PATH="$dirname/lib${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}" fi echo "Directory: $dirname" echo "Starting workers in parallel" echo "$dirname/$PROBCOMMAND -zmq_worker <worker-id> $*" for (( i = 0 ; i < $CORES; i++ )) do "$dirname/$PROBCOMMAND" -zmq_worker $i $* & done ##Usage: ./proxy <master IP> <port start> <own IP> <queue threshold> <logfile> [<proxynumber>] echo "Starting proxy server: $dirname/lib/proxy localhost 5000" "$dirname/lib/proxy" localhost 5000 localhost 50 loggyMcLogface-proxy & echo "Starting master: $dirname/$PROBCOMMAND -bf -zmq_master master $FILE $*" time "$dirname/$PROBCOMMAND" -bf -zmq_master master $FILE $* fi
This file provides a few more options:
#!/bin/bash PROBCOMMAND=probcli if [ $# -lt 5 ] then echo "Usage ./parB2 <Nr. of workers> <minimum que size> <max number of states> <Port (usually 5000)> <logdir> <model>" exit -1 else echo "Running ProB in Parallel (on .prob files)" # dirname if [ -h "$0" ] then realname=`readlink "$0"` dirname=`dirname "$realname"` else dirname=`dirname "$0"` fi ulimit -d unlimited echo "Directory: $dirname" mkdir -p $5 # dirname if [ -h "$0" ] then realname=`readlink "$0"` dirname=`dirname "$realname"` else dirname=`dirname "$0"` fi ulimit -d unlimited # setting the library path to find the zmq shared libraries system=`uname` if [ $system = "Linux" ]; then export LD_LIBRARY_PATH="$dirname/lib${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}" fi echo "Directory: $dirname" #cd $dirname #ls echo "Starting workers in parallel" for (( i = 0 ; i < $1; i++ )) do "$dirname/$PROBCOMMAND" -bf -zmq_worker $i -p logdir $5 & done echo "Starting proxy server: $dirname/lib/proxy localhost $4 localhost $2 $5/log-proxy " "$dirname/lib/proxy" localhost $4 localhost $2 $5/log-proxy & echo "Starting master: $dirname/$PROBCOMMAND -bf -zmq_master master -p queue_threshold $2 -p max_states $3 -p port $4 -p logdir $5" time "$dirname/$PROBCOMMAND" -bf -zmq_master master $6 -p queue_threshold $2 -p max_states $3 -p port $4 -p logdir $5 fi