python.TaskManager.TaskAnalyzer Class Reference

Collaboration diagram for python.TaskManager.TaskAnalyzer:

Public Member Functions
def	__init__ (self, jobDir, dsName, taskName)
def	isOnDisk (self)
def	analyzeFiles (self)
def	updateStatus (self, taskman)

Public Attributes
	jobDir
	dsName
	taskName
	path
	status
	onDisk
	nResultFiles
	nJobs
	nJobsSubmitted
	nJobsRunning
	nJobsPostProc
	nJobsFailed
	nJobsCompleted

Detailed Description

TaskAnalyzer is a class for analyzing the files of a given task.

Definition at line 607 of file TaskManager.py.

Constructor & Destructor Documentation

__init__()

def python.TaskManager.TaskAnalyzer.__init__	(		self,
			jobDir,
			dsName,
			taskName
	)

Definition at line 610 of file TaskManager.py.

    def __init__(self,jobDir,dsName,taskName):
        self.jobDir = jobDir
        self.dsName = dsName
        self.taskName = taskName
        self.path = jobDir+'/'+dsName+'/'+taskName
 
        self.status = TaskManager.StatusCodes['UNKNOWN']
        self.onDisk = TaskManager.OnDiskCodes['UNKNOWN']
        self.nResultFiles = 0
        self.nJobs = 0
        self.nJobsSubmitted = 0
        self.nJobsRunning = 0
        self.nJobsPostProc = 0
        self.nJobsFailed = 0
        self.nJobsCompleted = 0
 
 

Member Function Documentation

analyzeFiles()

def python.TaskManager.TaskAnalyzer.analyzeFiles

(

self

)

Definition at line 635 of file TaskManager.py.

    def analyzeFiles(self):
        onDisk = self.isOnDisk()
        if onDisk:
            self.nJobs = len(glob.glob(self.path+'/*/*.config.py'))
            self.nResultFiles = len(glob.glob(self.path+'/*')) - self.nJobs
            self.nJobsSubmitted = len(glob.glob(self.path+'/*/*.SUBMITTED'))
            self.nJobsRunning = len(glob.glob(self.path+'/*/*.RUNNING'))
            self.nJobsPostProc = len(glob.glob(self.path+'/*/*.POSTPROCESSING'))
            self.nJobsCompleted = len(glob.glob(self.path+'/*/*.COMPLETED'))
            self.nJobsFailed = self.nJobsCompleted - len(glob.glob(self.path+'/*/*.exit.0'))
 
            self.status = TaskManager.StatusCodes['UNKNOWN']
            if self.nJobs>0:
                self.status = TaskManager.StatusCodes['CONFIGURED']
            if self.nJobs==self.nJobsCompleted:
                self.status = TaskManager.StatusCodes['COMPLETED']
 
            if self.nJobsSubmitted>0:
                self.status = TaskManager.StatusCodes['SUBMITTED']
            if self.nJobsRunning>0:
                self.status = TaskManager.StatusCodes['RUNNING']
            if self.nJobsPostProc>0:
                self.status = TaskManager.StatusCodes['POSTPROCESSING']
            if self.nJobsFailed>0:
                if self.nJobsSubmitted>0 or self.nJobsRunning>0 or self.nJobsPostProc>0:
                    self.status = TaskManager.StatusCodes['PARTIALFAILED']
                else:
                    self.status = TaskManager.StatusCodes['FAILED']
 
        return onDisk
 
 

isOnDisk()

def python.TaskManager.TaskAnalyzer.isOnDisk

(

self

)

Check if task directories are still on disk.

Definition at line 627 of file TaskManager.py.

    def isOnDisk(self):
        """Check if task directories are still on disk."""
        onDisk = os.path.exists(self.path)
        if not onDisk:
            self.onDisk = TaskManager.OnDiskCodes['DELETED']
        return onDisk
 
 

updateStatus()

def python.TaskManager.TaskAnalyzer.updateStatus	(		self,
			taskman
	)

Definition at line 667 of file TaskManager.py.

    def updateStatus(self,taskman):
        taskman.updateStatus(self.dsName,self.taskName,
                             self.status,self.nResultFiles,
                             self.nJobs,self.nJobsSubmitted,self.nJobsRunning,self.nJobsPostProc,self.nJobsFailed,self.nJobsCompleted)
 
 
 

Member Data Documentation

dsName

python.TaskManager.TaskAnalyzer.dsName

Definition at line 612 of file TaskManager.py.

jobDir

python.TaskManager.TaskAnalyzer.jobDir

Definition at line 611 of file TaskManager.py.

nJobs

python.TaskManager.TaskAnalyzer.nJobs

Definition at line 619 of file TaskManager.py.

nJobsCompleted

python.TaskManager.TaskAnalyzer.nJobsCompleted

Definition at line 624 of file TaskManager.py.

nJobsFailed

python.TaskManager.TaskAnalyzer.nJobsFailed

Definition at line 623 of file TaskManager.py.

nJobsPostProc

python.TaskManager.TaskAnalyzer.nJobsPostProc

Definition at line 622 of file TaskManager.py.

nJobsRunning

python.TaskManager.TaskAnalyzer.nJobsRunning

Definition at line 621 of file TaskManager.py.

nJobsSubmitted

python.TaskManager.TaskAnalyzer.nJobsSubmitted

Definition at line 620 of file TaskManager.py.

nResultFiles

python.TaskManager.TaskAnalyzer.nResultFiles

Definition at line 618 of file TaskManager.py.

onDisk

python.TaskManager.TaskAnalyzer.onDisk

Definition at line 617 of file TaskManager.py.

path

python.TaskManager.TaskAnalyzer.path

Definition at line 614 of file TaskManager.py.

status

python.TaskManager.TaskAnalyzer.status

Definition at line 616 of file TaskManager.py.

taskName

python.TaskManager.TaskAnalyzer.taskName

Definition at line 613 of file TaskManager.py.

---

The documentation for this class was generated from the following file:

• TaskManager.py