sherpaTarCreator.batchJobBase.batchJobBase Class Reference

Inheritance diagram for sherpaTarCreator.batchJobBase.batchJobBase:

Collaboration diagram for sherpaTarCreator.batchJobBase.batchJobBase:

Public Member Functions
	__init__ (self, name, hours=0, nCores=1, account=None, queue=None, memMB=0, mounts=[], basedir="")
	write (self, useSingularity=True, useApptainer=False, extraDirs=[])

Public Attributes
	name = name
list	cmds = []
	hours = hours
	nCores = nCores
	account = account
	queue = queue
int	memMB = memMB
	mounts = mounts
dict	env = {}
	basedir = basedir
	id = None
list	dependsOnOk = []
list	dependsOnAny = []

Detailed Description

A class containing all information necessary to run given bash commands in an arbitrary batch system.

Definition at line 5 of file batchJobBase.py.

Constructor & Destructor Documentation

__init__()

sherpaTarCreator.batchJobBase.batchJobBase.__init__	(		self,
			name,
			hours = 0,
			nCores = 1,
			account = None,
			queue = None,
			memMB = 0,
			mounts = [],
			basedir = "" )

Definition at line 8 of file batchJobBase.py.

  def __init__(self, name, hours=0, nCores=1, account=None, queue=None, memMB=0, mounts=[], basedir=""):
    self.name = name
    self.cmds = []
    self.hours = hours
    self.nCores = nCores
    self.account = account
    self.queue = queue
    self.memMB = memMB
    self.mounts = mounts
    if self.memMB == 1:
      self.memMB = 1499
    if self.memMB == 2:
      self.memMB = 2499
    self.env = {}
    self.basedir = basedir
    self.id = None
    self.dependsOnOk = []
    self.dependsOnAny = []
 

Member Function Documentation

write()

sherpaTarCreator.batchJobBase.batchJobBase.write	(		self,
			useSingularity = True,
			useApptainer = False,
			extraDirs = [] )

Definition at line 27 of file batchJobBase.py.

  def write(self, useSingularity=True, useApptainer=False, extraDirs=[]):
    executable =  "#!/bin/sh -\n"
 
    # COMPILER_PATH
    if useSingularity:
      platform = str(os.environ['COMPILER_PATH']).split('/')[-1].replace('el9', 'almalinux9')
      executable += 'if [ "$1" != "--really" ]; then \n'
      executable += '  exec singularity exec -e --no-home'
      for dir in ["/cvmfs", "/var", self.basedir, "$(pwd | cut -d '/' -f 1-2)"] + extraDirs:
        executable += ' -B '+dir
      executable += ' /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/'
      executable += platform + ' /bin/bash -- "$0" --really "$@";\n'
      executable += 'fi\n'
      executable += "shift;\n\n"
      executable += "export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase\n"
      executable += "source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh\n"
 
    if useApptainer:
      wrapper = ''
      wrapperfilename = self.basedir+"/"+self.name+"_wrapper.sh"
      platform = str(os.environ['COMPILER_PATH']).split('/')[-1].replace('el9', 'almalinux9')
      executable += 'export ALRB_CONT_SWTYPE="apptainer"\n'
      executable += 'export ALRB_CONT_PRESETUP="hostname -f; date; id -a"\n'
      executable += 'export ALRB_testPath=",,,,,,,,,,,,,,,,,,,,,,,,"\n'
      executable += 'export ALRB_CONT_RUNPAYLOAD="'+wrapperfilename+'"\n'
      wrapper += "ulimit -f 1000000;\n"
      wrapper += "cd "+self.basedir+";\n\n"
      wrapper += "echo 'ncores="+str(self.nCores)+" nhours="+str(self.hours)+" "+self.basedir+"/"+self.name+".sh';\n"
      for cmd in self.cmds:
        wrapper += cmd+'\n'
      with open(wrapperfilename, 'w') as f:
        f.write(wrapper)
      st = os.stat(wrapperfilename)
      os.chmod(wrapperfilename, st.st_mode | stat.S_IEXEC)
      executable += "export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase\n"
      executable += "source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh -c "+platform+" -b -q"
      if self.mounts != []:
        executable += "-m"+" ".join(self.mounts)
      else:
        executable += "\n"
      executable += "exit $?\n"
      
    else:
      executable += "ulimit -f 1000000;\n"
      executable += "cd "+self.basedir+"\n\n"
      executable += "echo 'ncores="+str(self.nCores)+" nhours="+str(self.hours)+" "+self.basedir+"/"+self.name+".sh';\n"
      for cmd in self.cmds:
        executable += cmd+"\n"
      executable += "exit 0\n"
 
    filename = self.basedir+"/"+self.name+".sh"
    with open(filename, 'w') as f:
        f.write(executable)
 
    #make shell-files executable
    st = os.stat(filename)
    os.chmod(filename, st.st_mode | stat.S_IEXEC)
 
 

Member Data Documentation

account

sherpaTarCreator.batchJobBase.batchJobBase.account = account

Definition at line 13 of file batchJobBase.py.

basedir

sherpaTarCreator.batchJobBase.batchJobBase.basedir = basedir

Definition at line 22 of file batchJobBase.py.

cmds

list sherpaTarCreator.batchJobBase.batchJobBase.cmds = []

Definition at line 10 of file batchJobBase.py.

dependsOnAny

list sherpaTarCreator.batchJobBase.batchJobBase.dependsOnAny = []

Definition at line 25 of file batchJobBase.py.

dependsOnOk

list sherpaTarCreator.batchJobBase.batchJobBase.dependsOnOk = []

Definition at line 24 of file batchJobBase.py.

env

dict sherpaTarCreator.batchJobBase.batchJobBase.env = {}

Definition at line 21 of file batchJobBase.py.

hours

sherpaTarCreator.batchJobBase.batchJobBase.hours = hours

Definition at line 11 of file batchJobBase.py.

id

sherpaTarCreator.batchJobBase.batchJobBase.id = None

Definition at line 23 of file batchJobBase.py.

memMB

int sherpaTarCreator.batchJobBase.batchJobBase.memMB = memMB

Definition at line 15 of file batchJobBase.py.

mounts

sherpaTarCreator.batchJobBase.batchJobBase.mounts = mounts

Definition at line 16 of file batchJobBase.py.

name

sherpaTarCreator.batchJobBase.batchJobBase.name = name

Definition at line 9 of file batchJobBase.py.

nCores

sherpaTarCreator.batchJobBase.batchJobBase.nCores = nCores

Definition at line 12 of file batchJobBase.py.

queue

sherpaTarCreator.batchJobBase.batchJobBase.queue = queue

Definition at line 14 of file batchJobBase.py.

---

The documentation for this class was generated from the following file:

• batchJobBase.py