prov/gni: Multiplex kdreg events

[jswaro]

With this commit, a shared memory registration notifier is created to multiplex events from the kdreg notifier to the various memory registration caches.

Also, if kdreg is not present, the lazy deregistration feature for the internal cache will be forced to a disabled state to ensure MDDs stay synchronized with virtual memory mappings

Signed-off-by: James Swaro jswaro@cray.com

closes #1350 #1064

[hppritcha]

bot:lanl:retest

[hppritcha]

@jswaro jenkins is complaining -

In file included from prov/gni/src/gnix_smrn.c:33:0:
./prov/gni/include/gnix_smrn.h:48:2: error: unknown type name 'fastlock_t'
  fastlock_t lock;
  ^~~~~~~~~~
./prov/gni/include/gnix_smrn.h:55:2: error: unknown type name 'fastlock_t'
  fastlock_t lock;
  ^~~~~~~~~~
prov/gni/src/gnix_smrn.c: In function '_gnix_smrn_init':
prov/gni/src/gnix_smrn.c:41:2: error: implicit declaration of function 'fastlock_init' [-Werror=implicit-function-declaration]
  fastlock_init(&global_smrn.lock);
  ^~~~~~~~~~~~~
prov/gni/src/gnix_smrn.c: In function '_gnix_smrn_open':
prov/gni/src/gnix_smrn.c:55:2: error: implicit declaration of function 'fastlock_acquire' [-Werror=implicit-function-declaration]
  fastlock_acquire(&tmp->lock);
  ^~~~~~~~~~~~~~~~
prov/gni/src/gnix_smrn.c:61:2: error: implicit declaration of function 'fastlock_release' [-Werror=implicit-function-declaration]
  fastlock_release(&tmp->lock);
  ^~~~~~~~~~~~~~~~
prov/gni/src/gnix_smrn.c: In function '_gnix_smrn_monitor':
prov/gni/src/gnix_smrn.c:105:3: error: implicit declaration of function 'GNIX_DEBUG' [-Werror=implicit-function-declaration]
   GNIX_DEBUG(FI_LOG_FABRIC,
   ^~~~~~~~~~
prov/gni/src/gnix_smrn.c:105:14: error: 'FI_LOG_FABRIC' undeclared (first use in this function)
   GNIX_DEBUG(FI_LOG_FABRIC,
              ^~~~~~~~~~~~~
prov/gni/src/gnix_smrn.c:105:14: note: each undeclared identifier is reported only once for each function it appears in
prov/gni/src/gnix_smrn.c: In function '__gnix_smrn_read_events':
prov/gni/src/gnix_smrn.c:137:15: error: 'FI_LOG_FABRIC' undeclared (first use in this function)
    GNIX_DEBUG(FI_LOG_FABRIC,

[jswaro]

Not sure why I didn't see them locally, but I think I've fixed them.

[jswaro]

bot:lanl:retest