COOLRates.RateQueryHandler Class Reference

Inheritance diagram for COOLRates.RateQueryHandler:

Collaboration diagram for COOLRates.RateQueryHandler:

Public Member Functions
def	__init__ (self, mySignal, numProc=None, verbose=False)
def	createProcesses (self)
def	addQueryBundle (self, queryBundle)
def	beginQuery (self)
def	processResults (self, resultBundle)
def	terminateProcesses (self)
def	collectResults (self)

Public Attributes
	QueryWorkers
	QueryProcesses
	troughQueue
	resultQueue
	result
	counter
	verbose
	timeConverter
	mySignal
	numProc

Detailed Description

Definition at line 491 of file COOLRates.py.

Constructor & Destructor Documentation

__init__()

def COOLRates.RateQueryHandler.__init__	(		self,
			mySignal,
			numProc = None,
			verbose = False
	)

Definition at line 492 of file COOLRates.py.

    def __init__(self,mySignal,numProc=None,verbose=False):
        COOLQueryHandler.__init__(self,mySignal,numProc=numProc,verbose=verbose)    
        self.QueryWorkers = []
        for i in range(self.numProc):
            worker = RateQueryWorker()
            self.QueryWorkers.append(worker)
 

Member Function Documentation

addQueryBundle()

def COOLRates.COOLQueryHandler.addQueryBundle (   self,   queryBundle  )

inherited

Definition at line 174 of file COOLRates.py.

    def addQueryBundle(self,queryBundle):
        self.counter+=1
        self.troughQueue.put(queryBundle)
    

beginQuery()

def COOLRates.COOLQueryHandler.beginQuery (   self )

inherited

Definition at line 178 of file COOLRates.py.

    def beginQuery(self):
        self.createProcesses()
        for i in range(self.numProc):
            self.troughQueue.put(True)
        logger.info('{0} queries distributed over {1} workers'.format(self.counter,len(self.QueryProcesses)))
        for process in self.QueryProcesses: process.start()
        try:
            self.collectResults()
        except KeyboardInterrupt:
            logger.critical('Caught signal, terminating processes')
            self.terminateProcesses()
            return
        for process in self.QueryProcesses: process.join()
        return
    

collectResults()

def COOLRates.COOLQueryHandler.collectResults (   self )

inherited

Definition at line 211 of file COOLRates.py.

    def collectResults(self):
        finished = 0
        startingQueries = self.counter
        target=0.
        while True:
            if not self.mySignal.is_alive():
                raise KeyboardInterrupt
                break
                #sys.exit(0)
            try: resultBundle = self.resultQueue.get(False,0.001)
            except Empty:
                sleep(.001)
                continue
            if resultBundle is True:
                finished+=1
                if finished == self.numProc: break
                continue
            self.counter-=1
            percentComplete = min(100,int(round(float(startingQueries-self.counter)/startingQueries*100+.5)))
            if percentComplete>=target:
                target+=5.
                logger.info('{0}% complete'.format(percentComplete))
            self.processResults(resultBundle)
#       except KeyboardInterrupt:
#           logger.critical('Caught signal, terminating processes')
#           self.terminateProcesses()
        return
 
#====================================================================================================================
 

createProcesses()

def COOLRates.RateQueryHandler.createProcesses

(

self

)

Reimplemented from COOLRates.COOLQueryHandler.

Definition at line 499 of file COOLRates.py.

    def createProcesses(self):
        self.QueryProcesses = []
        for i in range(self.numProc):       
            process = Process(target = RateQueryWorker(), args = (self.troughQueue,self.resultQueue,))
            self.QueryProcesses.append(process)
#====================================================================================================================
 

processResults()

def COOLRates.COOLQueryHandler.processResults (   self,   resultBundle  )

inherited

Definition at line 193 of file COOLRates.py.

    def processResults(self,resultBundle):
        for resultAlias in resultBundle:
            if resultAlias not in self.result: self.result[resultAlias]={}
            self.result[resultAlias].update(resultBundle[resultAlias])  
    

terminateProcesses()

def COOLRates.COOLQueryHandler.terminateProcesses (   self )

inherited

Definition at line 198 of file COOLRates.py.

    def terminateProcesses(self):
        while 1:
            try:self.troughQueue.get(False)
            except Empty: break
        logger.critical('Queue is empty')
        for i in range(self.numProc): self.troughQueue.put(True)
        time.sleep(1)
        for process in self.QueryProcesses:
            process.terminate()
            process.join()
        logger.critical('Processes are joined')
        raise KeyboardInterrupt
 

Member Data Documentation

counter

COOLRates.COOLQueryHandler.counter

inherited

Definition at line 161 of file COOLRates.py.

mySignal

COOLRates.COOLQueryHandler.mySignal

inherited

Definition at line 164 of file COOLRates.py.

numProc

COOLRates.COOLQueryHandler.numProc

inherited

Definition at line 166 of file COOLRates.py.

QueryProcesses

COOLRates.RateQueryHandler.QueryProcesses

Definition at line 500 of file COOLRates.py.

QueryWorkers

COOLRates.RateQueryHandler.QueryWorkers

Definition at line 494 of file COOLRates.py.

result

COOLRates.COOLQueryHandler.result

inherited

Definition at line 160 of file COOLRates.py.

resultQueue

COOLRates.COOLQueryHandler.resultQueue

inherited

Definition at line 158 of file COOLRates.py.

timeConverter

COOLRates.COOLQueryHandler.timeConverter

inherited

Definition at line 163 of file COOLRates.py.

troughQueue

COOLRates.COOLQueryHandler.troughQueue

inherited

Definition at line 157 of file COOLRates.py.

verbose

COOLRates.COOLQueryHandler.verbose

inherited

Definition at line 162 of file COOLRates.py.

---

The documentation for this class was generated from the following file:

• COOLRates.py