ATLAS Offline Software
Classes | Public Types | Public Member Functions | Static Public Attributes | Protected Member Functions | Private Types | Private Attributes | Friends | List of all members
EventContainers::IdentifiableCacheBase Class Reference

#include <IdentifiableCacheBase.h>

Inheritance diagram for EventContainers::IdentifiableCacheBase:
Collaboration diagram for EventContainers::IdentifiableCacheBase:

Classes

struct  IMaker
 

Public Types

typedef std::true_type thread_safe
 

Public Member Functions

const void * find (IdentifierHash hash) noexcept
 Return payload if there, null if not there. More...
 
const void * findWait (IdentifierHash hash)
 Retrieve ptr, will wait if there is something in progress. More...
 
const void * get (IdentifierHash hash)
 Try to make payload if not there. More...
 
std::vector< IdentifierHashids ()
 In a threaded situation this collection will be valid but will not container hashes later added. More...
 
std::pair< bool, const void * > add (IdentifierHash hash, const void *p) noexcept
 
std::pair< bool, const void * > addLock (IdentifierHash hash, const void *p) noexcept
 
std::pair< bool, const void * > addLock (IdentifierHash hash, void_unique_ptr p) noexcept
 
std::pair< bool, const void * > add (IdentifierHash hash, void_unique_ptr p) noexcept
 
bool IMakerPresent () const
 
int tryLock (IdentifierHash, IDC_WriteHandleBase &, std::vector< IdentifierHash > &)
 Checks if the item is completed if it is not started it extablishes lock (returns 0), If it is started but not completed it adds to wait list (returns 1) If the item is already completed it returns 2 If the item is aborted it does nothing and returns 3. More...
 
int itemAborted (IdentifierHash)
 Returns 1 is the item has been aborted otherwise 0. More...
 
int itemInProgress (IdentifierHash)
 Returns 1 is the item is inprogress otherwise 0. More...
 
const void * waitFor (IdentifierHash)
 Halts the thread until the require hash is completed or aborted. More...
 
void createSet (const std::vector< IdentifierHash > &hashes, std::vector< bool > &mask)
 Create a set of hashes, updates an IDC mask as appropriate. More...
 
size_t fullSize () const
 
size_t numberOfHashes ()
 In a concurrent situation this number isn't necessarily perfectly synchronised with ids().size() More...
 

Static Public Attributes

static constexpr uintptr_t INVALIDflag = UINTPTR_MAX
 
static constexpr uintptr_t ABORTEDflag = UINTPTR_MAX-1
 

Protected Member Functions

 IdentifiableCacheBase (IdentifierHash maxHash, const IMaker *maker)
 
 ~IdentifiableCacheBase ()
 
void clear (deleter_f *deleter)
 
void cleanUp (deleter_f *deleter)
 
void notifyHash (IdentifierHash hash)
 

Private Types

typedef std::mutex mutex_t
 
typedef std::scoped_lock< mutex_tlock_t
 
typedef std::unique_lock< mutex_tuniqueLock
 

Private Attributes

std::vector< std::atomic< const void * > > m_vec
 
const IMakerm_maker
 
mutex_t m_mutex
 
std::atomic< size_t > m_currentHashes
 Holds the number of valid hashes in container, in concurrent use it is not guaranteed to be up to date. More...
 

Friends

class InternalOnline
 

Detailed Description

Definition at line 22 of file IdentifiableCacheBase.h.

Member Typedef Documentation

◆ lock_t

typedef std::scoped_lock<mutex_t> EventContainers::IdentifiableCacheBase::lock_t
private

Definition at line 97 of file IdentifiableCacheBase.h.

◆ mutex_t

Definition at line 96 of file IdentifiableCacheBase.h.

◆ thread_safe

Definition at line 31 of file IdentifiableCacheBase.h.

◆ uniqueLock

Definition at line 98 of file IdentifiableCacheBase.h.

Constructor & Destructor Documentation

◆ IdentifiableCacheBase()

EventContainers::IdentifiableCacheBase::IdentifiableCacheBase ( IdentifierHash  maxHash,
const IMaker maker 
)
protected

Definition at line 29 of file IdentifiableCacheBase.cxx.

31  : m_vec(maxHash),
32  m_maker (maker),
34 {
35 }

◆ ~IdentifiableCacheBase()

EventContainers::IdentifiableCacheBase::~IdentifiableCacheBase ( )
protecteddefault

Member Function Documentation

◆ add() [1/2]

std::pair< bool, const void * > EventContainers::IdentifiableCacheBase::add ( IdentifierHash  hash,
const void *  p 
)
noexcept

Definition at line 205 of file IdentifiableCacheBase.cxx.

206 {
207  if (ATH_UNLIKELY(hash >= m_vec.size())) return std::make_pair(false, nullptr);
208  if(p==nullptr) return std::make_pair(false, nullptr);
209  const void* nul=nullptr;
210  if(m_vec[hash].compare_exchange_strong(nul, p, std::memory_order_release, std::memory_order_relaxed)){
211  m_currentHashes.fetch_add(1, std::memory_order_relaxed);
212  return std::make_pair(true, p);
213  }
214  const void* invalid = INVALID;
215  if(m_vec[hash].compare_exchange_strong(invalid, p, std::memory_order_release, std::memory_order_acquire)){
216  m_currentHashes.fetch_add(1, std::memory_order_relaxed);
217  notifyHash(hash);
218  return std::make_pair(true, p);
219  }
220  return std::make_pair(false, invalid);
221 }

◆ add() [2/2]

std::pair< bool, const void * > EventContainers::IdentifiableCacheBase::add ( IdentifierHash  hash,
void_unique_ptr  p 
)
noexcept

Definition at line 252 of file IdentifiableCacheBase.cxx.

254 {
255  std::pair<bool, const void*> b = add(hash, p.get());
256  if(b.first) p.release();
257  return b;
258 }

◆ addLock() [1/2]

std::pair< bool, const void * > EventContainers::IdentifiableCacheBase::addLock ( IdentifierHash  hash,
const void *  p 
)
noexcept

Definition at line 224 of file IdentifiableCacheBase.cxx.

225 { //Same as method above except we check for invalid state first,
226  // more optimal for calling using writehandle lock method
227  assert(hash < m_vec.size());
228  if(p==nullptr) return std::make_pair(false, nullptr);
229  const void* invalid = INVALID;
230  if(m_vec[hash].compare_exchange_strong(invalid, p, std::memory_order_release, std::memory_order_relaxed)){
231  m_currentHashes.fetch_add(1, std::memory_order_relaxed);
232  notifyHash(hash);
233  return std::make_pair(true, p);
234  }
235  const void* nul=nullptr;
236  if(m_vec[hash].compare_exchange_strong(nul, p, std::memory_order_release, std::memory_order_acquire)){
237  m_currentHashes.fetch_add(1, std::memory_order_relaxed);
238  return std::make_pair(true, p);
239  }
240  return std::make_pair(false, nul);
241 }

◆ addLock() [2/2]

std::pair< bool, const void * > EventContainers::IdentifiableCacheBase::addLock ( IdentifierHash  hash,
void_unique_ptr  p 
)
noexcept

Definition at line 243 of file IdentifiableCacheBase.cxx.

245 {
246  std::pair<bool, const void*> b = addLock(hash, p.get());
247  if(b.first) p.release();
248  return b;
249 }

◆ cleanUp()

void EventContainers::IdentifiableCacheBase::cleanUp ( deleter_f deleter)
protected

Definition at line 79 of file IdentifiableCacheBase.cxx.

80 {
81  std::atomic_thread_fence(std::memory_order_acquire);
82  if(0 != m_currentHashes.load(std::memory_order_relaxed)){ //Reduce overhead if cache was unused
83  size_t s = m_vec.size();
84  for (size_t i=0; i<s ;i++) {
85  const void* p = m_vec[i].load(std::memory_order_relaxed);
86  if(p && p < ABORTED) deleter (p);
87  }
88  }
89 }

◆ clear()

void EventContainers::IdentifiableCacheBase::clear ( deleter_f deleter)
protected

Definition at line 60 of file IdentifiableCacheBase.cxx.

61 {
62  size_t s = m_vec.size();
63  if(0 != m_currentHashes.load(std::memory_order_relaxed)){
64  for (size_t i=0; i<s ;i++) {
65  const void* ptr = m_vec[i].load(std::memory_order_relaxed);
66  m_vec[i].store(nullptr, std::memory_order_relaxed);
67  if (ptr && ptr < ABORTED){
68  deleter (ptr);
69  }
70  }
71  m_currentHashes.store(0, std::memory_order_relaxed);
72  }else{
73  for (size_t i=0; i<s ;i++) m_vec[i].store(nullptr, std::memory_order_relaxed);//Need to clear incase of aborts
74  }
75 }

◆ createSet()

void EventContainers::IdentifiableCacheBase::createSet ( const std::vector< IdentifierHash > &  hashes,
std::vector< bool > &  mask 
)

Create a set of hashes, updates an IDC mask as appropriate.

Definition at line 177 of file IdentifiableCacheBase.cxx.

177  {
178  assert(mask.size() == fullSize());
179  for(IdentifierHash hash : hashes){
180  const void* ptr = get(hash);
181  if(ptr !=nullptr) mask[hash] = true;
182  }
183 }

◆ find()

const void * EventContainers::IdentifiableCacheBase::find ( IdentifierHash  hash)
noexcept

Return payload if there, null if not there.

Definition at line 103 of file IdentifiableCacheBase.cxx.

104 {
105  if (ATH_UNLIKELY(hash >= m_vec.size())) return nullptr;
106  const void* p = m_vec[hash].load(std::memory_order_acquire);
107  if (p >= ABORTED)
108  return nullptr;
109  return p;
110 }

◆ findWait()

const void * EventContainers::IdentifiableCacheBase::findWait ( IdentifierHash  hash)

Retrieve ptr, will wait if there is something in progress.

Definition at line 124 of file IdentifiableCacheBase.cxx.

125 {
126  if (ATH_UNLIKELY(hash >= m_vec.size())) return nullptr;
127  const void* p = waitFor(hash);
128  if(p>=ABORTED) return nullptr;
129  return p;
130 }

◆ fullSize()

size_t EventContainers::IdentifiableCacheBase::fullSize ( ) const
inline

Definition at line 81 of file IdentifiableCacheBase.h.

81 { return m_vec.size(); }

◆ get()

const void * EventContainers::IdentifiableCacheBase::get ( IdentifierHash  hash)

Try to make payload if not there.

Definition at line 137 of file IdentifiableCacheBase.cxx.

138 {
139  // If it's there already, return directly without locking.
140  const void* ptr = nullptr;
141  if (ATH_UNLIKELY(hash >= m_vec.size())) return ptr;
142 
143  if(m_vec[hash].compare_exchange_strong(ptr, INVALID) ) {//Exchanges ptr with current value!!
144  // Make the payload.
145  if(m_maker == nullptr){
146  m_vec[hash].store( ABORTED );
147  return nullptr;
148  }
149  uniqueLock lock(m_mutex, std::defer_lock);
150  if(!m_maker->m_IsReEntrant) lock.lock();//Allow reentrant or non reentrant makers
151 
152  try {
153  ptr = m_maker->typelessMake (hash).release();
154  }
155  catch (...) {
156  // FIXME: Can this be done with RAII?
157  notifyHash(hash);
158  throw;
159  }
160  assert(m_vec[hash] == INVALID);
161  if(ptr){
162  m_vec[hash].store( ptr );
163  m_currentHashes++;
164  }else{
165  m_vec[hash].store( ABORTED );
166  }
167  notifyHash(hash);
168  }
169  else if(ptr == INVALID){
170  ptr= waitFor(hash);
171  }
172  if(ptr == ABORTED) return nullptr;
173  assert(ptr < ABORTED);
174  return ptr;
175 }

◆ ids()

std::vector< IdentifierHash > EventContainers::IdentifiableCacheBase::ids ( )

In a threaded situation this collection will be valid but will not container hashes later added.

Definition at line 191 of file IdentifiableCacheBase.cxx.

192 {
193  std::vector<IdentifierHash> ret;
194  ret.reserve (m_currentHashes.load(std::memory_order_relaxed));
195  size_t s = m_vec.size();
196  for (size_t i =0; i<s; i++) {
197  const void* p = m_vec[i].load(std::memory_order_relaxed);
198  if (p && p < ABORTED)
199  ret.push_back (i);
200  }
201  return ret;
202 }

◆ IMakerPresent()

bool EventContainers::IdentifiableCacheBase::IMakerPresent ( ) const
inline

Definition at line 61 of file IdentifiableCacheBase.h.

61 { return m_maker!=nullptr; }

◆ itemAborted()

int EventContainers::IdentifiableCacheBase::itemAborted ( IdentifierHash  hash)

Returns 1 is the item has been aborted otherwise 0.

Definition at line 91 of file IdentifiableCacheBase.cxx.

91  {
92  const void* p = m_vec[hash].load(std::memory_order_relaxed); //Relaxed because it is not returning a pointer to anything
93  return (p == ABORTED);
94 }

◆ itemInProgress()

int EventContainers::IdentifiableCacheBase::itemInProgress ( IdentifierHash  hash)

Returns 1 is the item is inprogress otherwise 0.

Definition at line 97 of file IdentifiableCacheBase.cxx.

97  {
98  const void* p = m_vec[hash].load(std::memory_order_relaxed); //Relaxed because it is not returning a pointer to anything
99  return (p == INVALID);
100 }

◆ notifyHash()

void EventContainers::IdentifiableCacheBase::notifyHash ( IdentifierHash  hash)
protected

Definition at line 132 of file IdentifiableCacheBase.cxx.

133 {
134  m_vec[hash].notify_all();
135 }

◆ numberOfHashes()

size_t EventContainers::IdentifiableCacheBase::numberOfHashes ( )

In a concurrent situation this number isn't necessarily perfectly synchronised with ids().size()

Definition at line 186 of file IdentifiableCacheBase.cxx.

187 {
188  return m_currentHashes.load(std::memory_order_relaxed); //Not to be used for syncing
189 }

◆ tryLock()

int EventContainers::IdentifiableCacheBase::tryLock ( IdentifierHash  hash,
IDC_WriteHandleBase lock,
std::vector< IdentifierHash > &  wait 
)

Checks if the item is completed if it is not started it extablishes lock (returns 0), If it is started but not completed it adds to wait list (returns 1) If the item is already completed it returns 2 If the item is aborted it does nothing and returns 3.

Definition at line 40 of file IdentifiableCacheBase.cxx.

40  {
41  const void *ptr1 =nullptr;
42 
43  if(m_vec[hash].compare_exchange_strong(ptr1, INVALID, std::memory_order_relaxed, std::memory_order_relaxed)){//atomic swap (replaces ptr1 with value)
44  //First call
45  //Setup the IDC_WriteHandle to "lock" on this hash's pointer
46  lock.LockOn(&m_vec[hash]);
47  return 0;
48  }
49 
50  if(ptr1 == INVALID){
51  //Second call while not finished
52  wait.emplace_back(hash);
53  return 1;
54  }
55  if(ptr1 == ABORTED) return 3;
56  return 2; //Already completed
57 }

◆ waitFor()

const void * EventContainers::IdentifiableCacheBase::waitFor ( IdentifierHash  hash)

Halts the thread until the require hash is completed or aborted.

Definition at line 112 of file IdentifiableCacheBase.cxx.

113 {
114  std::atomic<const void*> &myatomic = m_vec[hash];
115  const void* item = myatomic.load(std::memory_order_acquire);
116  //Wait until pointer is set then retrieve and verify
117  while(item == INVALID){//Loop to check for spurious wakeups
118  myatomic.wait(item, std::memory_order_relaxed);
119  item = myatomic.load(std::memory_order_acquire);
120  }
121  return item;
122 }

Friends And Related Function Documentation

◆ InternalOnline

friend class InternalOnline
friend

Definition at line 93 of file IdentifiableCacheBase.h.

Member Data Documentation

◆ ABORTEDflag

constexpr uintptr_t EventContainers::IdentifiableCacheBase::ABORTEDflag = UINTPTR_MAX-1
staticconstexpr

Definition at line 28 of file IdentifiableCacheBase.h.

◆ INVALIDflag

constexpr uintptr_t EventContainers::IdentifiableCacheBase::INVALIDflag = UINTPTR_MAX
staticconstexpr

Definition at line 27 of file IdentifiableCacheBase.h.

◆ m_currentHashes

std::atomic<size_t> EventContainers::IdentifiableCacheBase::m_currentHashes
private

Holds the number of valid hashes in container, in concurrent use it is not guaranteed to be up to date.

Definition at line 101 of file IdentifiableCacheBase.h.

◆ m_maker

const IMaker* EventContainers::IdentifiableCacheBase::m_maker
private

Definition at line 94 of file IdentifiableCacheBase.h.

◆ m_mutex

mutex_t EventContainers::IdentifiableCacheBase::m_mutex
private

Definition at line 99 of file IdentifiableCacheBase.h.

◆ m_vec

std::vector<std::atomic<const void*> > EventContainers::IdentifiableCacheBase::m_vec
private

Definition at line 92 of file IdentifiableCacheBase.h.


The documentation for this class was generated from the following files:
EventContainers::ABORTED
const void *const ABORTED
Definition: IdentifiableCacheBase.cxx:25
python.root_lsr_rank.hashes
hashes
Definition: root_lsr_rank.py:34
SGTest::store
TestStore store
Definition: TestStore.cxx:23
EventContainers::IdentifiableCacheBase::get
const void * get(IdentifierHash hash)
Try to make payload if not there.
Definition: IdentifiableCacheBase.cxx:137
EventContainers::INVALID
const void *const INVALID
Definition: IdentifiableCacheBase.cxx:24
EventContainers::IdentifiableCacheBase::IMaker::m_IsReEntrant
bool m_IsReEntrant
Definition: IdentifiableCacheBase.h:37
EventContainers::IdentifiableCacheBase::m_mutex
mutex_t m_mutex
Definition: IdentifiableCacheBase.h:99
EventContainers::IdentifiableCacheBase::m_maker
const IMaker * m_maker
Definition: IdentifiableCacheBase.h:94
ATH_UNLIKELY
#define ATH_UNLIKELY(x)
Definition: AthUnlikelyMacros.h:17
python.RatesEmulationExample.lock
lock
Definition: RatesEmulationExample.py:148
dbg::ptr
void * ptr(T *p)
Definition: SGImplSvc.cxx:74
python.utils.AtlRunQueryLookup.mask
string mask
Definition: AtlRunQueryLookup.py:459
PyPoolBrowser.item
item
Definition: PyPoolBrowser.py:129
python.utils.AtlRunQueryDQUtils.p
p
Definition: AtlRunQueryDQUtils.py:209
lumiFormat.i
int i
Definition: lumiFormat.py:85
EventContainers::IdentifiableCacheBase::fullSize
size_t fullSize() const
Definition: IdentifiableCacheBase.h:81
EventContainers::IdentifiableCacheBase::uniqueLock
std::unique_lock< mutex_t > uniqueLock
Definition: IdentifiableCacheBase.h:98
plotBeamSpotMon.b
b
Definition: plotBeamSpotMon.py:76
EventContainers::IdentifiableCacheBase::notifyHash
void notifyHash(IdentifierHash hash)
Definition: IdentifiableCacheBase.cxx:132
EventContainers::IdentifiableCacheBase::m_currentHashes
std::atomic< size_t > m_currentHashes
Holds the number of valid hashes in container, in concurrent use it is not guaranteed to be up to dat...
Definition: IdentifiableCacheBase.h:101
EventContainers::IdentifiableCacheBase::m_vec
std::vector< std::atomic< const void * > > m_vec
Definition: IdentifiableCacheBase.h:92
EventContainers::IdentifiableCacheBase::IMaker::typelessMake
virtual void_unique_ptr typelessMake(IdentifierHash hash) const =0
CaloCondBlobAlgs_fillNoiseFromASCII.hash
dictionary hash
Definition: CaloCondBlobAlgs_fillNoiseFromASCII.py:108
EventContainers::IdentifiableCacheBase::waitFor
const void * waitFor(IdentifierHash)
Halts the thread until the require hash is completed or aborted.
Definition: IdentifiableCacheBase.cxx:112
EventContainers::IdentifiableCacheBase::add
std::pair< bool, const void * > add(IdentifierHash hash, const void *p) noexcept
Definition: IdentifiableCacheBase.cxx:205
python.SystemOfUnits.s
float s
Definition: SystemOfUnits.py:147
IdentifierHash
This is a "hash" representation of an Identifier. This encodes a 32 bit index which can be used to lo...
Definition: IdentifierHash.h:25
EventContainers::IdentifiableCacheBase::addLock
std::pair< bool, const void * > addLock(IdentifierHash hash, const void *p) noexcept
Definition: IdentifiableCacheBase.cxx:224