Job Submission and File Systems
Current working directory
- the directory from where the qsub command was called. STDOUT and STDERR of a job go into files that are created in $HOME. Because of quota limits and archiving policies that is not recommended.
- With the -cwd option to qsub the files get created in the current working directory. For performance reasons that should be on a local file system
- If cwd is in NFS space, the batch system must not use the real mount point but be translated according to /usr/SGE/default/common/sge_aliases. As every job stores the full info from sge_aliases, we want to get rid of that file and discourage the use of NFS as current working directory
- If required, create your own $HOME/.sge_aliases file
Local file space
- /usr1/tmp is guaranteed to exist on all linux nodes and has typically > 10GB
- /data exists on some linux nodes and has typically > 15GB capacity. A job can request the existence of /data by -l datadir
- $TMP[DIR] is a unique directory below /usr1/tmp, that gets erased at the end of the job. Normal jobs should make use of that mechanism if possible