python.trfUtils.memFileToTable Class Reference

Extract a table of data from a txt file. More...

Collaboration diagram for python.trfUtils.memFileToTable:

Public Member Functions
	getTable (self, filename, header=None, separator="\t")

Protected Member Functions
	_defineTableDictKeys (self, header, fields, separator)
	Define the keys for the tabledict dictionary.

Detailed Description

Extract a table of data from a txt file.

E.g. header="Time nprocs nthreads wtime stime utime pss rss swap vmem" or the first line in the file each of which will become keys in the dictionary, whose corresponding values are stored in lists, with the entries corresponding to the values in the rows of the input file. The output dictionary will have the format {'Time': [ .. data from first row .. ], 'VMEM': [.. data from second row], ..}

Parameters

filename	name of input text file, full path (string).
header	header string.
separator	separator character (char).

Returns

dictionary.

Definition at line 1511 of file trfUtils.py.

Member Function Documentation

_defineTableDictKeys()

python.trfUtils.memFileToTable._defineTableDictKeys ( self, header, fields, separator )

protected

Define the keys for the tabledict dictionary.

Parameters

header	header string.
fields	header content string.
separator	separator character (char).

Returns

tabledict (dictionary), keylist (ordered list with dictionary key names).

Definition at line 1547 of file trfUtils.py.

    def _defineTableDictKeys(self, header, fields, separator):
        tabledict = {}
        keylist = []
 
        if not header:
            # get the dictionary keys from the header of the file
            for key in fields:
                # first line defines the header, whose elements will be used as dictionary keys
                if key == '':
                    continue
                if key.endswith('\n'):
                    key = key[:-1]
                tabledict[key] = []
                keylist.append(key)
        else:
            # get the dictionary keys from the provided header
            keys = header.split(separator)
            for key in keys:
                if key == '':
                    continue
                if key.endswith('\n'):
                    key = key[:-1]
                tabledict[key] = []
                keylist.append(key)
 
        return tabledict, keylist
 
 

getTable()

python.trfUtils.memFileToTable.getTable	(		self,
			filename,
			header = None,
			separator = "\t" )

Definition at line 1513 of file trfUtils.py.

    def getTable(self, filename, header=None, separator="\t"):
        tabledict = {}
        keylist = []
        try:
            f = open(filename, 'r')
        except Exception as e:
            msg.warning("failed to open file: {0}, {1}".format(filename, e))
        else:
            firstline = True
            for line in f:
                fields = line.split(separator)
                fields = [''.join(filter(str.isprintable, field)) for field in fields]
                if firstline:
                    firstline = False
                    tabledict, keylist = self._defineTableDictKeys(header, fields, separator)
                    if not header:
                        continue
                # from now on, fill the dictionary fields with the input data
                i = 0
                for field in fields:
                    # get the corresponding dictionary key from the keylist
                    key = keylist[i]
                    # store the field value in the correct list
                    tabledict[key].append(float(field))
                    i += 1
            f.close()
 
        return tabledict
 

---

The documentation for this class was generated from the following file:

• trfUtils.py