COOLRates.RateQueryHandler Class Reference

Inheritance diagram for COOLRates.RateQueryHandler:

Collaboration diagram for COOLRates.RateQueryHandler:

Public Member Functions
	__init__ (self, mySignal, numProc=None, verbose=False)
	createProcesses (self)
	addQueryBundle (self, queryBundle)
	beginQuery (self)
	processResults (self, resultBundle)
	terminateProcesses (self)
	collectResults (self)

Public Attributes
list	QueryWorkers = []
	troughQueue = Queue()
	resultQueue = Queue()
list	QueryProcesses = []
dict	result = {}
int	counter = 0
	verbose = verbose
	timeConverter = timeConverter
	mySignal = mySignal
	numProc = numProc

Detailed Description

Definition at line 491 of file COOLRates.py.

Constructor & Destructor Documentation

__init__()

COOLRates.RateQueryHandler.__init__	(		self,
			mySignal,
			numProc = None,
			verbose = False )

Definition at line 492 of file COOLRates.py.

    def __init__(self,mySignal,numProc=None,verbose=False):
        COOLQueryHandler.__init__(self,mySignal,numProc=numProc,verbose=verbose)    
        self.QueryWorkers = []
        for i in range(self.numProc):
            worker = RateQueryWorker()
            self.QueryWorkers.append(worker)
 

Member Function Documentation

addQueryBundle()

COOLRates.COOLQueryHandler.addQueryBundle ( self, queryBundle )

inherited

Definition at line 174 of file COOLRates.py.

    def addQueryBundle(self,queryBundle):
        self.counter+=1
        self.troughQueue.put(queryBundle)
    

beginQuery()

COOLRates.COOLQueryHandler.beginQuery ( self )

inherited

Definition at line 178 of file COOLRates.py.

    def beginQuery(self):
        self.createProcesses()
        for i in range(self.numProc):
            self.troughQueue.put(True)
        logger.info('{0} queries distributed over {1} workers'.format(self.counter,len(self.QueryProcesses)))
        for process in self.QueryProcesses: process.start()
        try:
            self.collectResults()
        except KeyboardInterrupt:
            logger.critical('Caught signal, terminating processes')
            self.terminateProcesses()
            return
        for process in self.QueryProcesses: process.join()
        return
    

collectResults()

COOLRates.COOLQueryHandler.collectResults ( self )

inherited

Definition at line 211 of file COOLRates.py.

    def collectResults(self):
        finished = 0
        startingQueries = self.counter
        target=0.
        while True:
            if not self.mySignal.is_alive():
                raise KeyboardInterrupt
                break
                #sys.exit(0)
            try: resultBundle = self.resultQueue.get(False,0.001)
            except Empty:
                sleep(.001)
                continue
            if resultBundle is True:
                finished+=1
                if finished == self.numProc: break
                continue
            self.counter-=1
            percentComplete = min(100,int(round(float(startingQueries-self.counter)/startingQueries*100+.5)))
            if percentComplete>=target:
                target+=5.
                logger.info('{0}% complete'.format(percentComplete))
            self.processResults(resultBundle)
#       except KeyboardInterrupt:
#           logger.critical('Caught signal, terminating processes')
#           self.terminateProcesses()
        return
 
#====================================================================================================================
 

createProcesses()

COOLRates.RateQueryHandler.createProcesses

(

self

)

Reimplemented from COOLRates.COOLQueryHandler.

Definition at line 499 of file COOLRates.py.

    def createProcesses(self):
        self.QueryProcesses = []
        for i in range(self.numProc):       
            process = Process(target = RateQueryWorker(), args = (self.troughQueue,self.resultQueue,))
            self.QueryProcesses.append(process)
#====================================================================================================================
 

processResults()

COOLRates.COOLQueryHandler.processResults ( self, resultBundle )

inherited

Definition at line 193 of file COOLRates.py.

    def processResults(self,resultBundle):
        for resultAlias in resultBundle:
            if resultAlias not in self.result: self.result[resultAlias]={}
            self.result[resultAlias].update(resultBundle[resultAlias])  
    

terminateProcesses()

COOLRates.COOLQueryHandler.terminateProcesses ( self )

inherited

Definition at line 198 of file COOLRates.py.

    def terminateProcesses(self):
        while 1:
            try:self.troughQueue.get(False)
            except Empty: break
        logger.critical('Queue is empty')
        for i in range(self.numProc): self.troughQueue.put(True)
        time.sleep(1)
        for process in self.QueryProcesses:
            process.terminate()
            process.join()
        logger.critical('Processes are joined')
        raise KeyboardInterrupt
 

Member Data Documentation

counter

COOLRates.COOLQueryHandler.counter = 0

inherited

Definition at line 161 of file COOLRates.py.

mySignal

COOLRates.COOLQueryHandler.mySignal = mySignal

inherited

Definition at line 164 of file COOLRates.py.

numProc

COOLRates.COOLQueryHandler.numProc = numProc

inherited

Definition at line 166 of file COOLRates.py.

QueryProcesses

COOLRates.COOLQueryHandler.QueryProcesses = []

inherited

Definition at line 159 of file COOLRates.py.

QueryWorkers

list COOLRates.RateQueryHandler.QueryWorkers = []

Definition at line 494 of file COOLRates.py.

result

dict COOLRates.COOLQueryHandler.result = {}

inherited

Definition at line 160 of file COOLRates.py.

resultQueue

COOLRates.COOLQueryHandler.resultQueue = Queue()

inherited

Definition at line 158 of file COOLRates.py.

timeConverter

COOLRates.COOLQueryHandler.timeConverter = timeConverter

inherited

Definition at line 163 of file COOLRates.py.

troughQueue

COOLRates.COOLQueryHandler.troughQueue = Queue()

inherited

Definition at line 157 of file COOLRates.py.

verbose

COOLRates.COOLQueryHandler.verbose = verbose

inherited

Definition at line 162 of file COOLRates.py.

---

The documentation for this class was generated from the following file:

• COOLRates.py