python.TaskManager.TaskAnalyzer Class Reference

Collaboration diagram for python.TaskManager.TaskAnalyzer:

Public Member Functions
	__init__ (self, jobDir, dsName, taskName)
	isOnDisk (self)
	analyzeFiles (self)
	updateStatus (self, taskman)

Public Attributes
	jobDir = jobDir
	dsName = dsName
	taskName = taskName
str	path = jobDir+'/'+dsName+'/'+taskName
	status = TaskManager.StatusCodes['UNKNOWN']
	onDisk = TaskManager.OnDiskCodes['UNKNOWN']
int	nResultFiles = 0
int	nJobs = 0
int	nJobsSubmitted = 0
int	nJobsRunning = 0
int	nJobsPostProc = 0
int	nJobsFailed = 0
int	nJobsCompleted = 0

Detailed Description

TaskAnalyzer is a class for analyzing the files of a given task.

Definition at line 605 of file TaskManager.py.

Constructor & Destructor Documentation

__init__()

python.TaskManager.TaskAnalyzer.__init__	(		self,
			jobDir,
			dsName,
			taskName )

Definition at line 608 of file TaskManager.py.

    def __init__(self,jobDir,dsName,taskName):
        self.jobDir = jobDir
        self.dsName = dsName
        self.taskName = taskName
        self.path = jobDir+'/'+dsName+'/'+taskName
 
        self.status = TaskManager.StatusCodes['UNKNOWN']
        self.onDisk = TaskManager.OnDiskCodes['UNKNOWN']
        self.nResultFiles = 0
        self.nJobs = 0
        self.nJobsSubmitted = 0
        self.nJobsRunning = 0
        self.nJobsPostProc = 0
        self.nJobsFailed = 0
        self.nJobsCompleted = 0
 
 

Member Function Documentation

analyzeFiles()

python.TaskManager.TaskAnalyzer.analyzeFiles

(

self

)

Definition at line 633 of file TaskManager.py.

    def analyzeFiles(self):
        onDisk = self.isOnDisk()
        if onDisk:
            self.nJobs = len(glob.glob(self.path+'/*/*.config.py'))
            self.nResultFiles = len(glob.glob(self.path+'/*')) - self.nJobs
            self.nJobsSubmitted = len(glob.glob(self.path+'/*/*.SUBMITTED'))
            self.nJobsRunning = len(glob.glob(self.path+'/*/*.RUNNING'))
            self.nJobsPostProc = len(glob.glob(self.path+'/*/*.POSTPROCESSING'))
            self.nJobsCompleted = len(glob.glob(self.path+'/*/*.COMPLETED'))
            self.nJobsFailed = self.nJobsCompleted - len(glob.glob(self.path+'/*/*.exit.0'))
 
            self.status = TaskManager.StatusCodes['UNKNOWN']
            if self.nJobs>0:
                self.status = TaskManager.StatusCodes['CONFIGURED']
            if self.nJobs==self.nJobsCompleted:
                self.status = TaskManager.StatusCodes['COMPLETED']
 
            if self.nJobsSubmitted>0:
                self.status = TaskManager.StatusCodes['SUBMITTED']
            if self.nJobsRunning>0:
                self.status = TaskManager.StatusCodes['RUNNING']
            if self.nJobsPostProc>0:
                self.status = TaskManager.StatusCodes['POSTPROCESSING']
            if self.nJobsFailed>0:
                if self.nJobsSubmitted>0 or self.nJobsRunning>0 or self.nJobsPostProc>0:
                    self.status = TaskManager.StatusCodes['PARTIALFAILED']
                else:
                    self.status = TaskManager.StatusCodes['FAILED']
 
        return onDisk
 
 

isOnDisk()

python.TaskManager.TaskAnalyzer.isOnDisk

(

self

)

Check if task directories are still on disk.

Definition at line 625 of file TaskManager.py.

    def isOnDisk(self):
        """Check if task directories are still on disk."""
        onDisk = os.path.exists(self.path)
        if not onDisk:
            self.onDisk = TaskManager.OnDiskCodes['DELETED']
        return onDisk
 
 

updateStatus()

python.TaskManager.TaskAnalyzer.updateStatus	(		self,
			taskman )

Definition at line 665 of file TaskManager.py.

    def updateStatus(self,taskman):
        taskman.updateStatus(self.dsName,self.taskName,
                             self.status,self.nResultFiles,
                             self.nJobs,self.nJobsSubmitted,self.nJobsRunning,self.nJobsPostProc,self.nJobsFailed,self.nJobsCompleted)
 
 
 

Member Data Documentation

dsName

python.TaskManager.TaskAnalyzer.dsName = dsName

Definition at line 610 of file TaskManager.py.

jobDir

python.TaskManager.TaskAnalyzer.jobDir = jobDir

Definition at line 609 of file TaskManager.py.

nJobs

python.TaskManager.TaskAnalyzer.nJobs = 0

Definition at line 617 of file TaskManager.py.

nJobsCompleted

python.TaskManager.TaskAnalyzer.nJobsCompleted = 0

Definition at line 622 of file TaskManager.py.

nJobsFailed

python.TaskManager.TaskAnalyzer.nJobsFailed = 0

Definition at line 621 of file TaskManager.py.

nJobsPostProc

python.TaskManager.TaskAnalyzer.nJobsPostProc = 0

Definition at line 620 of file TaskManager.py.

nJobsRunning

python.TaskManager.TaskAnalyzer.nJobsRunning = 0

Definition at line 619 of file TaskManager.py.

nJobsSubmitted

python.TaskManager.TaskAnalyzer.nJobsSubmitted = 0

Definition at line 618 of file TaskManager.py.

nResultFiles

python.TaskManager.TaskAnalyzer.nResultFiles = 0

Definition at line 616 of file TaskManager.py.

onDisk

python.TaskManager.TaskAnalyzer.onDisk = TaskManager.OnDiskCodes['UNKNOWN']

Definition at line 615 of file TaskManager.py.

path

str python.TaskManager.TaskAnalyzer.path = jobDir+'/'+dsName+'/'+taskName

Definition at line 612 of file TaskManager.py.

status

python.TaskManager.TaskAnalyzer.status = TaskManager.StatusCodes['UNKNOWN']

Definition at line 614 of file TaskManager.py.

taskName

python.TaskManager.TaskAnalyzer.taskName = taskName

Definition at line 611 of file TaskManager.py.

---

The documentation for this class was generated from the following file:

• TaskManager.py