Base class for configurable objects in the jobOptions. More...

Inheritance diagram for python.ProphecyPowhegMerge.ProphecyPowhegMerge:

Collaboration diagram for python.ProphecyPowhegMerge.ProphecyPowhegMerge:

Public Types
typedef HLT::TypeInformation::for_each_type_c< typenameEDMLIST::map, my_functor, my_result<>, my_arg< HLT::TypeInformation::get_cont, CONTAINER > >::type	result

Public Member Functions
	__init__ (self, runArgs=None, opts=None)
	merge (self)
	Initialise runcard with generic options.
	runMerging (configurator, powhegLHE, prophecyLHE4e, prophecyLHE4mu, prophecyLHE2e2mu, random_seed, stdin=None)
	output_events_file_name (self)
	Get output file name.
	input_powheg_file_name (self)
	Get input Powheg file name.
	input_powheg_file_name (self, value)
	Set input Powheg file name.
	input_prophecy4e_file_name (self)
	Get input Prophecy file name.
	input_prophecy4mu_file_name (self)
	Get input Prophecy file name.
	input_prophecy2e2mu_file_name (self)
	random_seed (self)
	input_prophecy4e_file_name (self, value)
	Set input Prophecy file name.
	input_prophecy4mu_file_name (self, value)
	Set input Prophecy file name.
	input_prophecy2e2mu_file_name (self, value)
	random_seed (self, value)
	logger (self)
	Get handle to logger.
	merge_lhe_files (self, listOfFiles, outputFile)

Public Attributes
	output_events_file_name
	check if input files exist
list	running_process = []
	check if input files exist

Static Protected Attributes
str	_merger_executable = 'mergeProphecy4f.exe'
	This must be defined by each derived class - don't change it in the jobOptions!

Private Attributes
str	__output_events_file_name = 'ProphecyPowhegMergedOTF._1.events'
	This needs to be set so that Generate_trf finds an appropriate file format for showering.
str	__input_powheg_file_name = 'PowhegOTF._1.events'
	Using default output names from PowhegConfig_base and ProphecyConfig.
str	__input_prophecy4e_file_name = 'ProphecyOTF4e._1.events'
str	__input_prophecy4mu_file_name = 'ProphecyOTF4mu._1.events'
str	__input_prophecy2e2mu_file_name = 'ProphecyOTF2e2mu._1.events'
int	__random_seed = 0

Static Private Attributes
	__run_directory = os.environ['PATH']
	Set up run directory and path to Prophecy.
	__logger = Logging.logging.getLogger('ProphecyPowhegMerger')
	Setup athena-compatible logger.

Detailed Description

Base class for configurable objects in the jobOptions.

All subprocesses inherit from this class

Definition at line 10 of file ProphecyPowhegMerge.py.

Member Typedef Documentation

◆ result

typedef HLT::TypeInformation::for_each_type_c<typenameEDMLIST::map,my_functor,my_result<>,my_arg<HLT::TypeInformation::get_cont,CONTAINER>>::type master_search< typenameEDMLIST::map, HLT::TypeInformation::get_cont, CONTAINER >::result

inherited

Definition at line 90 of file EDM_MasterSearch.h.

Constructor & Destructor Documentation

◆ init()

python.ProphecyPowhegMerge.ProphecyPowhegMerge.__init__	(	self,
		runArgs = None,
		opts = None )

Definition at line 20 of file ProphecyPowhegMerge.py.

  def __init__( self, runArgs=None, opts=None ) :
 
    
    self.__output_events_file_name = 'ProphecyPowhegMergedOTF._1.events'
 
    
    
    self.__input_powheg_file_name        = 'PowhegOTF._1.events'
    self.__input_prophecy4e_file_name    = 'ProphecyOTF4e._1.events'
    self.__input_prophecy4mu_file_name   = 'ProphecyOTF4mu._1.events'
    self.__input_prophecy2e2mu_file_name = 'ProphecyOTF2e2mu._1.events'
    self.__random_seed                   = 0
    
    
    if runArgs is None :
      self.logger.warning( 'No run arguments found! Using defaults.' )
    else :
      # Read values from runArgs
      # Set inputGeneratorFile to match output events file. Otherwise Generate_trf check will fail.
      runArgs.inputGeneratorFile = self.output_events_file_name
 

Member Function Documentation

◆ input_powheg_file_name() [1/2]

python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_powheg_file_name ( self )

Get input Powheg file name.

Definition at line 179 of file ProphecyPowhegMerge.py.

  def input_powheg_file_name(self) :
    return self.__input_powheg_file_name
 

◆ input_powheg_file_name() [2/2]

python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_powheg_file_name	(		self,
			value )

Set input Powheg file name.

Definition at line 184 of file ProphecyPowhegMerge.py.

  def input_powheg_file_name(self, value) :
    self.__input_powheg_file_name = value
 

◆ input_prophecy2e2mu_file_name() [1/2]

python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy2e2mu_file_name ( self )

Definition at line 198 of file ProphecyPowhegMerge.py.

  def input_prophecy2e2mu_file_name(self) :
    return self.__input_prophecy2e2mu_file_name
 

◆ input_prophecy2e2mu_file_name() [2/2]

python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy2e2mu_file_name	(		self,
			value )

Definition at line 216 of file ProphecyPowhegMerge.py.

  def input_prophecy2e2mu_file_name(self, value) :
    self.__input_prophecy2e2mu_file_name = value
 

◆ input_prophecy4e_file_name() [1/2]

python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy4e_file_name ( self )

Get input Prophecy file name.

Definition at line 189 of file ProphecyPowhegMerge.py.

  def input_prophecy4e_file_name(self) :
    return self.__input_prophecy4e_file_name
 

◆ input_prophecy4e_file_name() [2/2]

python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy4e_file_name	(		self,
			value )

Set input Prophecy file name.

Definition at line 207 of file ProphecyPowhegMerge.py.

  def input_prophecy4e_file_name(self, value) :
    self.__input_prophecy4e_file_name = value
 

◆ input_prophecy4mu_file_name() [1/2]

python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy4mu_file_name ( self )

Get input Prophecy file name.

Definition at line 194 of file ProphecyPowhegMerge.py.

  def input_prophecy4mu_file_name(self) :
    return self.__input_prophecy4mu_file_name
 

◆ input_prophecy4mu_file_name() [2/2]

python.ProphecyPowhegMerge.ProphecyPowhegMerge.input_prophecy4mu_file_name	(		self,
			value )

Set input Prophecy file name.

Definition at line 212 of file ProphecyPowhegMerge.py.

  def input_prophecy4mu_file_name(self, value) :
    self.__input_prophecy4mu_file_name = value
 

◆ logger()

python.ProphecyPowhegMerge.ProphecyPowhegMerge.logger ( self )

Get handle to logger.

Definition at line 225 of file ProphecyPowhegMerge.py.

  def logger(self) :
    return self.__logger
 

◆ merge()

python.ProphecyPowhegMerge.ProphecyPowhegMerge.merge ( self )

Initialise runcard with generic options.

Definition at line 42 of file ProphecyPowhegMerge.py.

  def merge(self) :
 
    self.logger.info( 'Starting ProphecyPowhegMerger merge' )
 
    powhegLHE        = self.input_powheg_file_name
    prophecyLHE4e    = self.input_prophecy4e_file_name
    prophecyLHE4mu   = self.input_prophecy4mu_file_name
    prophecyLHE2e2mu = self.input_prophecy2e2mu_file_name
    random_seed      = str(self.random_seed)
 
    myinputfiles  = powhegLHE
    genInputFiles = myinputfiles.split(',')
    numberOfFiles = len(genInputFiles)
    # if there is a single file, make a symlink.  If multiple files, merge them into one output eventsFile
    if numberOfFiles > 0:
      allFiles = []
      for file in genInputFiles:
        file_1 = file
        # untar as needed
        if tarfile.is_tarfile(file):
          tar = tarfile.open(file)
          tar.extractall()
          tar.close()
          file_1 = file.replace("tar.gz.1","events")
          self.logger.info( 'Extracted tar file, and renaming {0} to {1}'.format ( file, file_1 ) )
          pass
           
        # The only input format where merging is permitted is LHE
        with open(file_1, 'r') as f:
          first_line = f.readline()
          self.logger.info( 'first_line {0}'.format ( first_line ) )
          if(not ("LesHouche" in first_line)):
            raise RuntimeError("%s is NOT a LesHouche file" % file)
          allFiles.append(file_1)
      powhegLHE_input = "merged_powheg_events.lhe"
      self.merge_lhe_files(allFiles, powhegLHE_input)
    
    
    time_start = time.time()
    self.logger.info( 'Input files: {0} {1} {2} {3}'.format( powhegLHE_input, prophecyLHE4e, prophecyLHE4mu, prophecyLHE2e2mu ) )
 
    
    heartbeat = HeartbeatTimer(600., "{}/eventLoopHeartBeat.txt".format(self.__run_directory))
    heartbeat.setName("heartbeat thread")
    heartbeat.daemon = True  # Allow program to exit if this is the only live thread
    heartbeat.start()
 
    
    self.logger.info( 'Checking if {0} exists.'.format( powhegLHE_input ) )
    if not os.path.isfile( powhegLHE_input ):
      self.logger.error( 'File {0} does NOT exist.'.format( powhegLHE_input ) )
      raise ValueError('File {0} does NOT exist.'.format( powhegLHE_input ))
 
    self.logger.info( 'Checking if {0} exists.'.format( prophecyLHE4e ) )
    if not os.path.isfile( prophecyLHE4e ):
      self.logger.error( 'File {0} does NOT exist.'.format( prophecyLHE4e ) )
      raise ValueError('File {0} does NOT exist.'.format( prophecyLHE4e ))
 
    self.logger.info( 'Checking if {0} exists.'.format( prophecyLHE4mu ) )
    if not os.path.isfile( prophecyLHE4mu ):
      self.logger.error( 'File {0} does NOT exist.'.format( prophecyLHE4mu ) )
      raise ValueError('File {0} does NOT exist.'.format( prophecyLHE4mu ))
 
    self.logger.info( 'Checking if {0} exists.'.format( prophecyLHE2e2mu ) )
    if not os.path.isfile( prophecyLHE2e2mu ):
      self.logger.error( 'File {0} does NOT exist.'.format( prophecyLHE2e2mu ) )
      raise ValueError('File {0} does NOT exist.'.format( prophecyLHE2e2mu ))
 
    self.logger.info( 'Input files found. Moving them to temporary files to produce properly named final output {0}.'.format( self.output_events_file_name ) )
 
    try :
      os.rename( prophecyLHE4e, prophecyLHE4e + '.tmp' )
    except OSError :
      self.logger.error( 'Moving of file {0} failed - not expected.'.format( prophecyLHE4e ) )
 
    try :
      os.rename( prophecyLHE4mu, prophecyLHE4mu + '.tmp' )
    except OSError :
      self.logger.error( 'Moving of file {0} failed - not expected.'.format( prophecyLHE4mu ) )
 
    try :
      os.rename( prophecyLHE2e2mu, prophecyLHE2e2mu + '.tmp' )
    except OSError :
      self.logger.error( 'Moving of file {0} failed - not expected.'.format( prophecyLHE2e2mu ) )
 
    self.running_process = []
 
    self.runMerging(powhegLHE_input, prophecyLHE4e + '.tmp', prophecyLHE4mu + '.tmp', prophecyLHE2e2mu + '.tmp', random_seed)
    
    heartbeat.cancel()
 
    
    generation_end = time.time()
    elapsed_time = generation_end - time_start
    self.logger.info( 'Running ProphecyPowhegMerger took {0}.'.format( HeartbeatTimer.readable_duration(elapsed_time) ) )
 
    self.logger.info( 'Removing initial LHE files of Prophecy and Powheg stored as *tmp.' )
 
    
    self.logger.info( 'Finished at {0}'.format( time.asctime() ) )
    return
 
 

◆ merge_lhe_files()

python.ProphecyPowhegMerge.ProphecyPowhegMerge.merge_lhe_files	(	self,
		listOfFiles,
		outputFile )

Definition at line 230 of file ProphecyPowhegMerge.py.

  def merge_lhe_files(self, listOfFiles, outputFile):
      if(os.path.exists(outputFile)):
        self.logger.info( 'outputFile {0} already exists.  Will rename to  {1}.OLD'.format ( outputFile, outputFile ) )
        os.rename(outputFile,outputFile+".OLD")
      output = open(outputFile,'w')
      holdHeader = ""
      nevents=0
      for file in listOfFiles:
         cmd = "grep /event "+file+" | wc -l"
         nevents+=int(subprocess.check_output(cmd,stderr=subprocess.STDOUT,shell=True))
  
      for file in listOfFiles:
         inHeader = True
         header = ""
         self.logger.info( '*** Starting to merge file {0}'.format ( file ) )
         for line in open(file,"r"):
           
            if("<event" in line and inHeader):
               inHeader = False
               if(len(holdHeader)<1):
                  holdHeader = header
                  output.write(header)
               output.write(line)
               
            elif(not inHeader and not ("</LesHouchesEvents>" in line)):
                output.write(line)
            if(inHeader):
              
               if("nevents" in line):
                 
                  tmp = line.split("=")
                  line = line.replace(tmp[0],str(nevents))
               elif("numevts" in line):
                 
                  tmp = line.split(" ")
                  nnn = str(nevents)
                  line = line.replace(tmp[1],nnn)
               header+=line
      output.write("</LesHouchesEvents>\n")
      output.close()
    

◆ output_events_file_name()

python.ProphecyPowhegMerge.ProphecyPowhegMerge.output_events_file_name ( self )

Get output file name.

Definition at line 174 of file ProphecyPowhegMerge.py.

  def output_events_file_name(self) :
    return self.__output_events_file_name
 

◆ random_seed() [1/2]

python.ProphecyPowhegMerge.ProphecyPowhegMerge.random_seed ( self )

Definition at line 202 of file ProphecyPowhegMerge.py.

  def random_seed(self) :
    return self.__random_seed
  

◆ random_seed() [2/2]

python.ProphecyPowhegMerge.ProphecyPowhegMerge.random_seed	(		self,
			value )

Definition at line 220 of file ProphecyPowhegMerge.py.

  def random_seed(self, value) :
    self.__random_seed = value
 

◆ runMerging()

python.ProphecyPowhegMerge.ProphecyPowhegMerge.runMerging	(	configurator,
		powhegLHE,
		prophecyLHE4e,
		prophecyLHE4mu,
		prophecyLHE2e2mu,
		random_seed,
		stdin = None )

Definition at line 145 of file ProphecyPowhegMerge.py.

  def runMerging(configurator, powhegLHE, prophecyLHE4e, prophecyLHE4mu, prophecyLHE2e2mu, random_seed, stdin=None) :
    configurator.logger.info( 'runMerging on {0}, {1}, {2} and {3}'.format( powhegLHE, prophecyLHE4e, prophecyLHE4mu, prophecyLHE2e2mu ) )
    if configurator.logger.level >= Logging.logging.DEBUG :
      configurator.running_process.append(subprocess.Popen( [configurator._merger_executable,'--inPowheg',powhegLHE,'--inProphecy4e',prophecyLHE4e,'--inProphecy4mu',prophecyLHE4mu,'--inProphecy2e2mu',prophecyLHE2e2mu,'--outLHE',configurator.output_events_file_name,'--randomSeed',random_seed,'--debug'], stdout=subprocess.PIPE, stdin=stdin, stderr=subprocess.STDOUT ) )
    else :
      configurator.running_process.append(subprocess.Popen( [configurator._merger_executable,'--inPowheg',powhegLHE,'--inProphecy4e',prophecyLHE4e,'--inProphecy4mu',prophecyLHE4mu,'--inProphecy2e2mu',prophecyLHE2e2mu,'--outLHE',configurator.output_events_file_name,'--randomSeed',random_seed,'--debug'], stdout=subprocess.PIPE, stdin=stdin, stderr=subprocess.STDOUT ) )
    configurator.logger.info( 'runMerging run mergeProphecy4f: --inPowheg {0} --inProphecy4e {1} --inProphecy4mu {2} --inProphecy2e2mu {3} --outLHE {4} --randomSeed {5}'.format( powhegLHE, prophecyLHE4e, prophecyLHE4mu, prophecyLHE2e2mu, configurator.output_events_file_name,random_seed) )
 
    while configurator.running_process :
     # Write output buffer if any
     for process in configurator.running_process :
       while True :
         output = process.stdout.readline().rstrip()
         if len(output) == 0 : break
         configurator.logger.info( '{0}'.format(output) )
       if process.poll() is not None : # process has ended
         # Flush buffer and print final output (if any) to screen
         process.stdout.flush()
         while True :
           output = process.stdout.readline().rstrip()
           if len(output) == 0 : break
           configurator.logger.info( '{0}'.format(output) )
         # Close output stream and remove process from list
         process.stdout.close()
         configurator.running_process.remove( process )
         configurator.logger.info( 'Merging finished - all done.' )
 

Member Data Documentation

◆ __input_powheg_file_name

str python.ProphecyPowhegMerge.ProphecyPowhegMerge.__input_powheg_file_name = 'PowhegOTF._1.events'

private

Using default output names from PowhegConfig_base and ProphecyConfig.

Definition at line 27 of file ProphecyPowhegMerge.py.

◆ __input_prophecy2e2mu_file_name

str python.ProphecyPowhegMerge.ProphecyPowhegMerge.__input_prophecy2e2mu_file_name = 'ProphecyOTF2e2mu._1.events'

private

Definition at line 30 of file ProphecyPowhegMerge.py.

◆ __input_prophecy4e_file_name

str python.ProphecyPowhegMerge.ProphecyPowhegMerge.__input_prophecy4e_file_name = 'ProphecyOTF4e._1.events'

private

Definition at line 28 of file ProphecyPowhegMerge.py.

◆ __input_prophecy4mu_file_name

str python.ProphecyPowhegMerge.ProphecyPowhegMerge.__input_prophecy4mu_file_name = 'ProphecyOTF4mu._1.events'

private

Definition at line 29 of file ProphecyPowhegMerge.py.

◆ __logger

python.ProphecyPowhegMerge.ProphecyPowhegMerge.__logger = Logging.logging.getLogger('ProphecyPowhegMerger')

staticprivate

Setup athena-compatible logger.

Definition at line 15 of file ProphecyPowhegMerge.py.

◆ __output_events_file_name

str python.ProphecyPowhegMerge.ProphecyPowhegMerge.__output_events_file_name = 'ProphecyPowhegMergedOTF._1.events'

private

This needs to be set so that Generate_trf finds an appropriate file format for showering.

Definition at line 23 of file ProphecyPowhegMerge.py.

◆ __random_seed

int python.ProphecyPowhegMerge.ProphecyPowhegMerge.__random_seed = 0

private

Definition at line 31 of file ProphecyPowhegMerge.py.

◆ __run_directory

python.ProphecyPowhegMerge.ProphecyPowhegMerge.__run_directory = os.environ['PATH']

staticprivate

Set up run directory and path to Prophecy.

Definition at line 12 of file ProphecyPowhegMerge.py.

◆ _merger_executable

str python.ProphecyPowhegMerge.ProphecyPowhegMerge._merger_executable = 'mergeProphecy4f.exe'

staticprotected

This must be defined by each derived class - don't change it in the jobOptions!

Definition at line 18 of file ProphecyPowhegMerge.py.

◆ output_events_file_name

python.ProphecyPowhegMerge.ProphecyPowhegMerge.output_events_file_name

check if input files exist

Definition at line 110 of file ProphecyPowhegMerge.py.

◆ running_process

list python.ProphecyPowhegMerge.ProphecyPowhegMerge.running_process = []

check if input files exist

Definition at line 127 of file ProphecyPowhegMerge.py.

The documentation for this class was generated from the following file:

ProphecyPowhegMerge.py

Public Types

Public Member Functions

Public Attributes

Static Protected Attributes

Private Attributes

Static Private Attributes

Detailed Description

Member Typedef Documentation

◆ result

Constructor & Destructor Documentation

◆ __init__()

Member Function Documentation

◆ input_powheg_file_name() [1/2]

◆ input_powheg_file_name() [2/2]

◆ input_prophecy2e2mu_file_name() [1/2]

◆ input_prophecy2e2mu_file_name() [2/2]

◆ input_prophecy4e_file_name() [1/2]

◆ input_prophecy4e_file_name() [2/2]

◆ input_prophecy4mu_file_name() [1/2]

◆ input_prophecy4mu_file_name() [2/2]

◆ logger()

◆ merge()

◆ merge_lhe_files()

◆ output_events_file_name()

◆ random_seed() [1/2]

◆ random_seed() [2/2]

◆ runMerging()

Member Data Documentation

◆ __input_powheg_file_name

◆ __input_prophecy2e2mu_file_name

◆ __input_prophecy4e_file_name

◆ __input_prophecy4mu_file_name

◆ __logger

◆ __output_events_file_name

◆ __random_seed

◆ __run_directory

◆ _merger_executable

◆ output_events_file_name

◆ running_process

◆ init()