-
Notifications
You must be signed in to change notification settings - Fork 25
SimEx on maxwell
SimEx for python3.4 is installed under /data/netapp/s2e/simex. Every maxwell user should be able to
>>> from SimEx import *
Download the simex modulefile e.g. to your $HOME directory and load the module.
$> cd
$> wget https://gist.github.com/CFGrote/1d4b0acbc8ff7d0e545266f6f3838ec0/raw/2257886a80af812d4fba5c35d32abc2e6ce2537f/simex.modulefile
$> module load $HOME/simex.modulefile
Besides setting the paths to the simex installation, a couple of other modules are loaded. In particular the module python3/3.4. Henceforth, the command python
will be linked to python3.4
, so beware ...
Then check your active SimEx environment with
$> python
>>> from SimEx import *
If this returns without error (warnings ok), you're all set.
In order to run SimEx simulations in a jupyter-notebook on your desktop pc or laptop but have the kernel run on a maxwell compute node, we recommend the following setup:
Login to maxwell and allocate the compute resource (One node on partition exfel for 1 day, adjust according to your needs)
$> screen -R -D
$> salloc -N1 -pexfel -t1-0
$> ssh max-exfl080
$> module load $HOME/simex.modulefile
$> jupyter-notebook-3.4 --no-browser --port=12345
Note down the returned notebook URL. You can now return to the login node. Since you logged into the compute node in a screen session, you can simply press and hold ctrl, press and release a, press and release d. To resume the screen session and go back to the compute node,
$> screen -r
On your desktop or laptop: Setup a ssh tunnel (works from within DESY network, otherwise go through bastion).
$> ssh -f -N -L12345:localhost:12345 max-exfl080 (adjust port number and compute node hostname)
Then launch your favourite web browser and navigate to the notebook URL which you noted down in the previous step.
- connect to max-display via ssh using an X-session
- setup ssh tunnel to the compute node from the max-display server
$> ssh -f -N -L12345:localhost:12345 max-exfl080 (adjust port number and compute node hostname)
- start firefox on max-display and browse to
localhost:12345
Detector simulations with XCSITPhotonDetector depend on
- py_detector_interface which depends on
- xcsit
- CImg.h
- geant4
- xerces-c
Getting all dependencies right can be cumbersome. This works on maxwell:
- Download from https://www.apache.org/dist/xerces/c/3/sources/xerces-c-3.2.1.tar.bz2
- Extract
- cd into extracted dir.
Then
$> mkdir build
$> cd build
$> cmake -DCMAKE_INSTALL_PREFIX=/data/netapp/s2e/simex -DCMAKE_BUILD_TYPE=Release
$> make -j64
$> make install
- Download from http://cern.ch/geant4/support/source/geant4.10.04.p01.tar.gz
- Extract
- cd into extracted dir.
Then
$> mkdir build
$> cd build
$> cmake -DCMAKE_INSTALL_PREFIX=/data/netapp/s2e/simex -DGEANT4_INSTALL_DATA=ON -DGEANT4_USE_GDML=ON -DXERCESC_ROOT_DIR=/data/netapp/s2e/simex ..
$> make -j64
$> make install
- Clone repo: ssh://git@git.xfel.eu:10022/grotec/xcsit.git
Then
$> cd xcsit
$> git checkout jan-philipp
-
Adjust the Geant4_DIR variable in line 21 to match the geant4 version installed in the previous step.
$> source xcsit_install.sh