search

saltstack / salt

Software to automate the management and configuration of any infrastructure or application at scale. Get access to the Salt software package repository here:
https://repo.saltproject.io/
Apache License 2.0
14.12k stars 5.47k forks source link

Mine data not getting updated #18505

Closed samos123 closed 9 years ago

samos123 commented 9 years ago

Mine data was not getting updated so I tried removing the cache and doing sync_all without success.

Steps to reproduce: Create cluster with existing nodes, delete all nodes and add new nodes, the new nodes mine won't get updated and previous cluster data is still in mine.

Version: salt 2014.7.0 (Helium) OS: Ubuntu 14.04 for all master and minions

sudo service salt-master stop
rm -rf /var/cache/salt/master
sudo service salt-master start

I have tried two different approaches to define the mine_functions: define in every minion and define via pillar on master

Pillar config on master pillar/top.sls:

base:
  '*':
     - common_pillar

pillar/common_pillar.sls

# java_home: /usr/lib/java

hadoop:
  version: hdp-2.2.0 # ['apache-1.2.1', 'apache-2.2.0', 'hdp-1.3.0', 'hdp-2.2.0', 'cdh-4.5.0', 'cdh-4.5.0-mr1']
  users:
    hadoop: 6000
    hdfs: 6001

mine_functions:
  network.ip_addrs: [eth0]
  grains.items: []

The mine config on every minion /etc/salt/minion.d/mine_functions

mine_functions:
    network.interfaces: []
    grains.items: []

Some related commands demonstrating the issue

root@salt-master:/srv/salt/hadoop-formula# salt '*' mine.update
hadoop-slave-fcd76705-b316-4b82-8547-22097e5c0eb8:
    True
hadoop-slave-715fcd45-53a6-4aa7-9edd-2ae9163f4f97:
    True
hadoop-slave-708a8d73-c093-49f3-a73f-4a46ba1e7238:
    True
hadoop-master:
    True                                                                                                                                             
root@salt-master:/srv/salt/hadoop-formula# salt '*' mine.get '*' network.interfaces
hadoop-slave-fcd76705-b316-4b82-8547-22097e5c0eb8:
    ----------
hadoop-slave-708a8d73-c093-49f3-a73f-4a46ba1e7238:
    ----------
hadoop-slave-715fcd45-53a6-4aa7-9edd-2ae9163f4f97:
    ----------
hadoop-master:
    ----------
root@salt-master:/srv/salt/hadoop-formula# salt '*' mine.get '*' grains.items
hadoop-slave-708a8d73-c093-49f3-a73f-4a46ba1e7238:
    ----------
hadoop-slave-fcd76705-b316-4b82-8547-22097e5c0eb8:
    ----------
hadoop-slave-715fcd45-53a6-4aa7-9edd-2ae9163f4f97:
    ----------
hadoop-master:
    ----------
root@salt-master:/srv/salt/hadoop-formula# salt '*' saltutil.sync_all
......
root@salt-master:/srv/salt/hadoop-formula# salt '*' mine.get '*' grains.items
hadoop-slave-fcd76705-b316-4b82-8547-22097e5c0eb8:
    ----------
hadoop-slave-715fcd45-53a6-4aa7-9edd-2ae9163f4f97:
    ----------
hadoop-slave-708a8d73-c093-49f3-a73f-4a46ba1e7238:
    ----------
hadoop-master:
    ----------
root@salt-master:/srv/salt/hadoop-formula# salt '*' mine.get '*' network.interfaces                                                                                    
hadoop-slave-708a8d73-c093-49f3-a73f-4a46ba1e7238:
    ----------
hadoop-slave-fcd76705-b316-4b82-8547-22097e5c0eb8:
    ----------
hadoop-slave-715fcd45-53a6-4aa7-9edd-2ae9163f4f97:
    ----------
hadoop-master:
    ----------
root@salt-master:/srv/salt/hadoop-formula# salt '*' config.option mine_functions
hadoop-slave-fcd76705-b316-4b82-8547-22097e5c0eb8:

hadoop-slave-708a8d73-c093-49f3-a73f-4a46ba1e7238:

hadoop-master:

hadoop-slave-715fcd45-53a6-4aa7-9edd-2ae9163f4f97:
samos123 commented 9 years ago

Edit: it seems that configuration from /etc/salt/minion.d/mine_functions isn't working??

Edit 2: Found the issue, so files inside /etc/salt/minion.d have to end with *.conf by default else they dont get picked up.