python.MpUtils.SubProcessIterator Class Reference

Inheritance diagram for python.MpUtils.SubProcessIterator:

Collaboration diagram for python.MpUtils.SubProcessIterator:

Public Types
typedef HLT::TypeInformation::for_each_type_c< typenameEDMLIST::map, my_functor, my_result<>, my_arg< HLT::TypeInformation::get_cont, CONTAINER > >::type	result

Public Member Functions
	__init__ (self, itertask, eoi='__eoi__')
	__iter__ (self)
	next (self)

Static Public Member Functions
	work (iterator, master, eoi)

Public Attributes
	client
	master = Pipe()
	end_of_input = eoi
	process = Process(target=self.work, args=pargs)
bool	started = False
	next = self._empty

Protected Member Functions
	_start (self)
	_empty (self, *args, **params)

Detailed Description

Instances of this class process iterators in separate processes.

Definition at line 27 of file MpUtils.py.

Member Typedef Documentation

result

typedef HLT::TypeInformation::for_each_type_c<typenameEDMLIST::map,my_functor,my_result<>,my_arg<HLT::TypeInformation::get_cont,CONTAINER>>::type master_search< typenameEDMLIST::map, HLT::TypeInformation::get_cont, CONTAINER >::result

inherited

Definition at line 90 of file EDM_MasterSearch.h.

Constructor & Destructor Documentation

__init__()

python.MpUtils.SubProcessIterator.__init__	(		self,
			itertask,
			eoi = '__eoi__' )

Create a new subprocess iterator.

itertask : some iterable task to execute in a subprocess
eoi : an end-of-iteration marker - returned from the subprocess
      to signal that iteration is complete.

Definition at line 29 of file MpUtils.py.

    def __init__(self, itertask, eoi='__eoi__'):
        """Create a new subprocess iterator.
 
        itertask : some iterable task to execute in a subprocess
        eoi : an end-of-iteration marker - returned from the subprocess
              to signal that iteration is complete.
        """
        self.client, self.master = Pipe()
        self.end_of_input = eoi
        pargs = [itertask, self.master, eoi]
        self.process = Process(target=self.work, args=pargs)
        self.started = False
 

Member Function Documentation

__iter__()

python.MpUtils.SubProcessIterator.__iter__

(

self

)

Definition at line 53 of file MpUtils.py.

    def __iter__(self):
        if not self.started:
            self._start()
        return self
 

_empty()

python.MpUtils.SubProcessIterator._empty ( self, * args, ** params )

protected

Definition at line 66 of file MpUtils.py.

    def _empty(self, *args, **params):
        raise StopIteration
 

_start()

python.MpUtils.SubProcessIterator._start ( self )

protected

Definition at line 42 of file MpUtils.py.

    def _start(self):
        self.started = True
        self.process.start()
 

next()

python.MpUtils.SubProcessIterator.next

(

self

)

Definition at line 58 of file MpUtils.py.

    def next(self):
        item = self.client.recv()
        if item != self.end_of_input:
            return item
        else:
            self.next = self._empty
            raise StopIteration
 

work()

python.MpUtils.SubProcessIterator.work ( iterator, master, eoi )

static

The actual callable that is executed in the subprocess.

Definition at line 47 of file MpUtils.py.

    def work(iterator, master, eoi):
        """The actual callable that is executed in the subprocess."""
        for chunk in iterator:
            master.send(chunk)
        master.send(eoi)
 

Member Data Documentation

client

python.MpUtils.SubProcessIterator.client

Definition at line 36 of file MpUtils.py.

end_of_input

python.MpUtils.SubProcessIterator.end_of_input = eoi

Definition at line 37 of file MpUtils.py.

master

python.MpUtils.SubProcessIterator.master = Pipe()

Definition at line 36 of file MpUtils.py.

next

python.MpUtils.SubProcessIterator.next = self._empty

Definition at line 63 of file MpUtils.py.

process

python.MpUtils.SubProcessIterator.process = Process(target=self.work, args=pargs)

Definition at line 39 of file MpUtils.py.

started

bool python.MpUtils.SubProcessIterator.started = False

Definition at line 40 of file MpUtils.py.

---

The documentation for this class was generated from the following file:

• MpUtils.py