python.ProphecyPowhegMerge.ProphecyPowhegMerge Class Reference

Base class for configurable objects in the jobOptions. More...

Inheritance diagram for python.ProphecyPowhegMerge.ProphecyPowhegMerge:

Collaboration diagram for python.ProphecyPowhegMerge.ProphecyPowhegMerge:

Public Member Functions
def	__init__ (self, runArgs=None, opts=None)
def	merge (self)
	Initialise runcard with generic options. More...
def	runMerging (configurator, powhegLHE, prophecyLHE4e, prophecyLHE4mu, prophecyLHE2e2mu, random_seed, stdin=None)
def	output_events_file_name (self)
	Get output file name. More...
def	input_powheg_file_name (self)
	Get input Powheg file name. More...
def	input_powheg_file_name (self, value)
	Set input Powheg file name. More...
def	input_prophecy4e_file_name (self)
	Get input Prophecy file name. More...
def	input_prophecy4mu_file_name (self)
	Get input Prophecy file name. More...
def	input_prophecy2e2mu_file_name (self)
def	random_seed (self)
def	input_prophecy4e_file_name (self, value)
	Set input Prophecy file name. More...
def	input_prophecy4mu_file_name (self, value)
	Set input Prophecy file name. More...
def	input_prophecy2e2mu_file_name (self, value)
def	random_seed (self, value)
def	logger (self)
	Get handle to logger. More...
def	merge_lhe_files (self, listOfFiles, outputFile)

Public Attributes
	running_process
	Initialise timer. More...

Private Attributes
	__output_events_file_name
	This needs to be set so that Generate_trf finds an appropriate file format for showering. More...
	__input_powheg_file_name
	Using default output names from PowhegConfig_base and ProphecyConfig. More...
	__input_prophecy4e_file_name
	__input_prophecy4mu_file_name
	__input_prophecy2e2mu_file_name
	__random_seed

Static Private Attributes
	__run_directory = os.environ['PATH']
	Set up run directory and path to Prophecy. More...
	__logger = Logging.logging.getLogger('ProphecyPowhegMerger')
	Setup athena-compatible logger. More...
string	_merger_executable = 'mergeProphecy4f.exe'
	This must be defined by each derived class - don't change it in the jobOptions! More...

Detailed Description

Base class for configurable objects in the jobOptions.

All subprocesses inherit from this class

Definition at line 10 of file ProphecyPowhegMerge.py.

Constructor & Destructor Documentation

__init__()

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.__init__	(		self,
			runArgs = None,
			opts = None
	)

Definition at line 20 of file ProphecyPowhegMerge.py.

  def __init__( self, runArgs=None, opts=None ) :
 
    
    self.__output_events_file_name = 'ProphecyPowhegMergedOTF._1.events'
 
    
    
    self.__input_powheg_file_name        = 'PowhegOTF._1.events'
    self.__input_prophecy4e_file_name    = 'ProphecyOTF4e._1.events'
    self.__input_prophecy4mu_file_name   = 'ProphecyOTF4mu._1.events'
    self.__input_prophecy2e2mu_file_name = 'ProphecyOTF2e2mu._1.events'
    self.__random_seed                   = 0
    
    
    if runArgs is None :
      self.logger.warning( 'No run arguments found! Using defaults.' )
    else :
      # Read values from runArgs
      # Set inputGeneratorFile to match output events file. Otherwise Generate_trf check will fail.
      runArgs.inputGeneratorFile = self.output_events_file_name
 

Member Function Documentation

input_powheg_file_name() [1/2]

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_powheg_file_name

(

self

)

Get input Powheg file name.

Definition at line 179 of file ProphecyPowhegMerge.py.

  def input_powheg_file_name(self) :
    return self.__input_powheg_file_name
 

input_powheg_file_name() [2/2]

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_powheg_file_name	(		self,
			value
	)

Set input Powheg file name.

Definition at line 184 of file ProphecyPowhegMerge.py.

  def input_powheg_file_name(self, value) :
    self.__input_powheg_file_name = value
 

input_prophecy2e2mu_file_name() [1/2]

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy2e2mu_file_name

(

self

)

Definition at line 198 of file ProphecyPowhegMerge.py.

  def input_prophecy2e2mu_file_name(self) :
    return self.__input_prophecy2e2mu_file_name
 

input_prophecy2e2mu_file_name() [2/2]

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy2e2mu_file_name	(		self,
			value
	)

Definition at line 216 of file ProphecyPowhegMerge.py.

  def input_prophecy2e2mu_file_name(self, value) :
    self.__input_prophecy2e2mu_file_name = value
 

input_prophecy4e_file_name() [1/2]

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy4e_file_name

(

self

)

Get input Prophecy file name.

Definition at line 189 of file ProphecyPowhegMerge.py.

  def input_prophecy4e_file_name(self) :
    return self.__input_prophecy4e_file_name
 

input_prophecy4e_file_name() [2/2]

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy4e_file_name	(		self,
			value
	)

Set input Prophecy file name.

Definition at line 207 of file ProphecyPowhegMerge.py.

  def input_prophecy4e_file_name(self, value) :
    self.__input_prophecy4e_file_name = value
 

input_prophecy4mu_file_name() [1/2]

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy4mu_file_name

(

self

)

Get input Prophecy file name.

Definition at line 194 of file ProphecyPowhegMerge.py.

  def input_prophecy4mu_file_name(self) :
    return self.__input_prophecy4mu_file_name
 

input_prophecy4mu_file_name() [2/2]

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy4mu_file_name	(		self,
			value
	)

Set input Prophecy file name.

Definition at line 212 of file ProphecyPowhegMerge.py.

  def input_prophecy4mu_file_name(self, value) :
    self.__input_prophecy4mu_file_name = value
 

logger()

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.logger

(

self

)

Get handle to logger.

Definition at line 225 of file ProphecyPowhegMerge.py.

  def logger(self) :
    return self.__logger
 

merge()

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.merge

(

self

)

Initialise runcard with generic options.

Definition at line 42 of file ProphecyPowhegMerge.py.

  def merge(self) :
 
    self.logger.info( 'Starting ProphecyPowhegMerger merge' )
 
    powhegLHE        = self.input_powheg_file_name
    prophecyLHE4e    = self.input_prophecy4e_file_name
    prophecyLHE4mu   = self.input_prophecy4mu_file_name
    prophecyLHE2e2mu = self.input_prophecy2e2mu_file_name
    random_seed      = str(self.random_seed)
 
    myinputfiles  = powhegLHE
    genInputFiles = myinputfiles.split(',')
    numberOfFiles = len(genInputFiles)
    # if there is a single file, make a symlink.  If multiple files, merge them into one output eventsFile
    if numberOfFiles > 0:
      allFiles = []
      for file in genInputFiles:
        file_1 = file
        # untar as needed
        if tarfile.is_tarfile(file):
          tar = tarfile.open(file)
          tar.extractall()
          tar.close()
          file_1 = file.replace("tar.gz.1","events")
          self.logger.info( 'Extracted tar file, and renaming {0} to {1}'.format ( file, file_1 ) )
          pass
           
        # The only input format where merging is permitted is LHE
        with open(file_1, 'r') as f:
          first_line = f.readline()
          self.logger.info( 'first_line {0}'.format ( first_line ) )
          if(not ("LesHouche" in first_line)):
            raise RuntimeError("%s is NOT a LesHouche file" % file)
          allFiles.append(file_1)
      powhegLHE_input = "merged_powheg_events.lhe"
      self.merge_lhe_files(allFiles, powhegLHE_input)
    
    
    time_start = time.time()
    self.logger.info( 'Input files: {0} {1} {2} {3}'.format( powhegLHE_input, prophecyLHE4e, prophecyLHE4mu, prophecyLHE2e2mu ) )
 
    
    heartbeat = HeartbeatTimer(600., "{}/eventLoopHeartBeat.txt".format(self.__run_directory))
    heartbeat.setName("heartbeat thread")
    heartbeat.daemon = True  # Allow program to exit if this is the only live thread
    heartbeat.start()
 
    
    self.logger.info( 'Checking if {0} exists.'.format( powhegLHE_input ) )
    if not os.path.isfile( powhegLHE_input ):
      self.logger.error( 'File {0} does NOT exist.'.format( powhegLHE_input ) )
      raise ValueError('File {0} does NOT exist.'.format( powhegLHE_input ))
 
    self.logger.info( 'Checking if {0} exists.'.format( prophecyLHE4e ) )
    if not os.path.isfile( prophecyLHE4e ):
      self.logger.error( 'File {0} does NOT exist.'.format( prophecyLHE4e ) )
      raise ValueError('File {0} does NOT exist.'.format( prophecyLHE4e ))
 
    self.logger.info( 'Checking if {0} exists.'.format( prophecyLHE4mu ) )
    if not os.path.isfile( prophecyLHE4mu ):
      self.logger.error( 'File {0} does NOT exist.'.format( prophecyLHE4mu ) )
      raise ValueError('File {0} does NOT exist.'.format( prophecyLHE4mu ))
 
    self.logger.info( 'Checking if {0} exists.'.format( prophecyLHE2e2mu ) )
    if not os.path.isfile( prophecyLHE2e2mu ):
      self.logger.error( 'File {0} does NOT exist.'.format( prophecyLHE2e2mu ) )
      raise ValueError('File {0} does NOT exist.'.format( prophecyLHE2e2mu ))
 
    self.logger.info( 'Input files found. Moving them to temporary files to produce properly named final output {0}.'.format( self.output_events_file_name ) )
 
    try :
      os.rename( prophecyLHE4e, prophecyLHE4e + '.tmp' )
    except OSError :
      self.logger.error( 'Moving of file {0} failed - not expected.'.format( prophecyLHE4e ) )
 
    try :
      os.rename( prophecyLHE4mu, prophecyLHE4mu + '.tmp' )
    except OSError :
      self.logger.error( 'Moving of file {0} failed - not expected.'.format( prophecyLHE4mu ) )
 
    try :
      os.rename( prophecyLHE2e2mu, prophecyLHE2e2mu + '.tmp' )
    except OSError :
      self.logger.error( 'Moving of file {0} failed - not expected.'.format( prophecyLHE2e2mu ) )
 
    self.running_process = []
 
    self.runMerging(powhegLHE_input, prophecyLHE4e + '.tmp', prophecyLHE4mu + '.tmp', prophecyLHE2e2mu + '.tmp', random_seed)
    
    heartbeat.cancel()
 
    
    generation_end = time.time()
    elapsed_time = generation_end - time_start
    self.logger.info( 'Running ProphecyPowhegMerger took {0}.'.format( HeartbeatTimer.readable_duration(elapsed_time) ) )
 
    self.logger.info( 'Removing initial LHE files of Prophecy and Powheg stored as *tmp.' )
 
    
    self.logger.info( 'Finished at {0}'.format( time.asctime() ) )
    return
 
 

merge_lhe_files()

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.merge_lhe_files	(		self,
			listOfFiles,
			outputFile
	)

Definition at line 230 of file ProphecyPowhegMerge.py.

  def merge_lhe_files(self, listOfFiles, outputFile):
      if(os.path.exists(outputFile)):
        self.logger.info( 'outputFile {0} already exists.  Will rename to  {1}.OLD'.format ( outputFile, outputFile ) )
        os.rename(outputFile,outputFile+".OLD")
      output = open(outputFile,'w')
      holdHeader = ""
      nevents=0
      for file in listOfFiles:
         cmd = "grep /event "+file+" | wc -l"
         nevents+=int(subprocess.check_output(cmd,stderr=subprocess.STDOUT,shell=True))
  
      for file in listOfFiles:
         inHeader = True
         header = ""
         self.logger.info( '*** Starting to merge file {0}'.format ( file ) )
         for line in open(file,"r"):
           
            if("<event" in line and inHeader):
               inHeader = False
               if(len(holdHeader)<1):
                  holdHeader = header
                  output.write(header)
               output.write(line)
               
            elif(not inHeader and not ("</LesHouchesEvents>" in line)):
                output.write(line)
            if(inHeader):
              
               if("nevents" in line):
                 
                  tmp = line.split("=")
                  line = line.replace(tmp[0],str(nevents))
               elif("numevts" in line):
                 
                  tmp = line.split(" ")
                  nnn = str(nevents)
                  line = line.replace(tmp[1],nnn)
               header+=line
      output.write("</LesHouchesEvents>\n")
      output.close()
    

output_events_file_name()

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.output_events_file_name

(

self

)

Get output file name.

Definition at line 174 of file ProphecyPowhegMerge.py.

  def output_events_file_name(self) :
    return self.__output_events_file_name
 

random_seed() [1/2]

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.random_seed

(

self

)

Definition at line 202 of file ProphecyPowhegMerge.py.

  def random_seed(self) :
    return self.__random_seed
  

random_seed() [2/2]

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.random_seed	(		self,
			value
	)

Definition at line 220 of file ProphecyPowhegMerge.py.

  def random_seed(self, value) :
    self.__random_seed = value
 

runMerging()

def python.ProphecyPowhegMerge.ProphecyPowhegMerge.runMerging	(		configurator,
			powhegLHE,
			prophecyLHE4e,
			prophecyLHE4mu,
			prophecyLHE2e2mu,
			random_seed,
			stdin = None
	)

Definition at line 145 of file ProphecyPowhegMerge.py.

  def runMerging(configurator, powhegLHE, prophecyLHE4e, prophecyLHE4mu, prophecyLHE2e2mu, random_seed, stdin=None) :
    configurator.logger.info( 'runMerging on {0}, {1}, {2} and {3}'.format( powhegLHE, prophecyLHE4e, prophecyLHE4mu, prophecyLHE2e2mu ) )
    if configurator.logger.level >= Logging.logging.DEBUG :
      configurator.running_process.append(subprocess.Popen( [configurator._merger_executable,'--inPowheg',powhegLHE,'--inProphecy4e',prophecyLHE4e,'--inProphecy4mu',prophecyLHE4mu,'--inProphecy2e2mu',prophecyLHE2e2mu,'--outLHE',configurator.output_events_file_name,'--randomSeed',random_seed,'--debug'], stdout=subprocess.PIPE, stdin=stdin, stderr=subprocess.STDOUT ) )
    else :
      configurator.running_process.append(subprocess.Popen( [configurator._merger_executable,'--inPowheg',powhegLHE,'--inProphecy4e',prophecyLHE4e,'--inProphecy4mu',prophecyLHE4mu,'--inProphecy2e2mu',prophecyLHE2e2mu,'--outLHE',configurator.output_events_file_name,'--randomSeed',random_seed,'--debug'], stdout=subprocess.PIPE, stdin=stdin, stderr=subprocess.STDOUT ) )
    configurator.logger.info( 'runMerging run mergeProphecy4f: --inPowheg {0} --inProphecy4e {1} --inProphecy4mu {2} --inProphecy2e2mu {3} --outLHE {4} --randomSeed {5}'.format( powhegLHE, prophecyLHE4e, prophecyLHE4mu, prophecyLHE2e2mu, configurator.output_events_file_name,random_seed) )
 
    while configurator.running_process :
     # Write output buffer if any
     for process in configurator.running_process :
       while True :
         output = process.stdout.readline().rstrip()
         if len(output) == 0 : break
         configurator.logger.info( '{0}'.format(output) )
       if process.poll() is not None : # process has ended
         # Flush buffer and print final output (if any) to screen
         process.stdout.flush()
         while True :
           output = process.stdout.readline().rstrip()
           if len(output) == 0 : break
           configurator.logger.info( '{0}'.format(output) )
         # Close output stream and remove process from list
         process.stdout.close()
         configurator.running_process.remove( process )
         configurator.logger.info( 'Merging finished - all done.' )
 

Member Data Documentation

__input_powheg_file_name

python.ProphecyPowhegMerge.ProphecyPowhegMerge.__input_powheg_file_name

private

Using default output names from PowhegConfig_base and ProphecyConfig.

Definition at line 27 of file ProphecyPowhegMerge.py.

__input_prophecy2e2mu_file_name

python.ProphecyPowhegMerge.ProphecyPowhegMerge.__input_prophecy2e2mu_file_name

private

Definition at line 30 of file ProphecyPowhegMerge.py.

__input_prophecy4e_file_name

python.ProphecyPowhegMerge.ProphecyPowhegMerge.__input_prophecy4e_file_name

private

Definition at line 28 of file ProphecyPowhegMerge.py.

__input_prophecy4mu_file_name

python.ProphecyPowhegMerge.ProphecyPowhegMerge.__input_prophecy4mu_file_name

private

Definition at line 29 of file ProphecyPowhegMerge.py.

__logger

python.ProphecyPowhegMerge.ProphecyPowhegMerge.__logger = Logging.logging.getLogger('ProphecyPowhegMerger')

staticprivate

Setup athena-compatible logger.

Definition at line 15 of file ProphecyPowhegMerge.py.

__output_events_file_name

python.ProphecyPowhegMerge.ProphecyPowhegMerge.__output_events_file_name

private

This needs to be set so that Generate_trf finds an appropriate file format for showering.

Definition at line 23 of file ProphecyPowhegMerge.py.

__random_seed

python.ProphecyPowhegMerge.ProphecyPowhegMerge.__random_seed

private

Definition at line 31 of file ProphecyPowhegMerge.py.

__run_directory

python.ProphecyPowhegMerge.ProphecyPowhegMerge.__run_directory = os.environ['PATH']

staticprivate

Set up run directory and path to Prophecy.

Definition at line 12 of file ProphecyPowhegMerge.py.

_merger_executable

string python.ProphecyPowhegMerge.ProphecyPowhegMerge._merger_executable = 'mergeProphecy4f.exe'

staticprivate

This must be defined by each derived class - don't change it in the jobOptions!

Definition at line 18 of file ProphecyPowhegMerge.py.

running_process

python.ProphecyPowhegMerge.ProphecyPowhegMerge.running_process

Initialise timer.

Setup heartbeat thread check if input files exist

Definition at line 127 of file ProphecyPowhegMerge.py.

---

The documentation for this class was generated from the following file:

• ProphecyPowhegMerge.py