Module chargés dans le broker
| Code Block |
|---|
[2019-09-17 16:49:59] INFO : [broker-dev4 ] I correctly loaded the modules: [sla,Simple-log,WebUI,Livestatus,Graphite-Perfdata] |
Création du module
| Code Block |
|---|
[2019-09-17 15:33:19] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] Creating new SLA module name : sla for broker [2019-09-17 15:33:20] INFO : [WebUI ] [sla ] [INITIALISATION ] Creating new SLA module name : sla for webui |
Parametre de connection à la base mongo
| Code Block |
|---|
[2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] Parameter load for database connection [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - database ------------------------- :[shinken] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - uri ------------------------------ :[mongodb://localhost/?w=1&fsync=false] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - replica_set ---------------------- :[] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - use_ssh_tunnel ------------------- :[False] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - ssh_keyfile ---------------------- :[~shinken/.ssh/id_rsa] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - ssh_user ------------------------- :[root] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - use_ssh_retry_failure ------------ :[1] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - auto_reconnect_max_try ----------- :[3] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - auto_reconnect_sleep_between_try - :[3] |
Démarrage du process d'archive
| Code Block |
|---|
[2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] Sub process ready to work. [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] Parameter load for database connection [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] - database ------------------------- :[shinken] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] - uri ------------------------------ :[mongodb://localhost/?w=1&fsync=false] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] - replica_set ---------------------- :[] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] - use_ssh_tunnel ------------------- :[False] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] - ssh_keyfile ---------------------- :[~shinken/.ssh/id_rsa] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] - ssh_user ------------------------- :[root] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] - use_ssh_retry_failure ------------ :[1] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] - auto_reconnect_max_try ----------- :[3] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] - auto_reconnect_sleep_between_try - :[3] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] Parameter load for build sla archive [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] - time_before_shinken_inactive:[30] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] Parameter load for archiving sla [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] - size_chunk_to_archive:[10000] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] - time_between_two_chunks:[0.1] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] - keep_raw_sla_day:[7] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] - Initialisation of the archive process done [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] Try to open a Mongodb connection to mongodb://localhost/?w=1&fsync=false:shinken [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] Open mongo connection done in 0.002s [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] Open mongo connection done in 0.002s [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] [MONGO] Ensure mongo index done in 0.004s [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [archive (pid:13227) ] [INITIALISATION ] Load 55 elements info in cache done in 0.001s |
Archivage en cours
| Code Block |
|---|
[2019-09-18 00:08:45] INFO : [broker-dev4 ] [sla ] [archive (pid:1434) ] Archiving the day 17-09-2019 [2019-09-18 00:08:45] INFO : [broker-dev4 ] [sla ] [archive (pid:1434) ] 55 items to archive in 1 blocks ( max size block : 10000 ) [2019-09-18 00:08:45] INFO : [broker-dev4 ] [sla ] [archive (pid:1434) ] - block 0: archiving 55 elements [2019-09-18 00:08:45] INFO : [broker-dev4 ] [sla ] [archive (pid:1434) ] Found first monitoring start time at 10-09-2019 23:51:30 [2019-09-18 00:08:45] INFO : [broker-dev4 ] [sla ] [archive (pid:1434) ] - block 0: insert 55 archive in mongo done in 0.003s [2019-09-18 00:08:45] INFO : [broker-dev4 ] [sla ] [archive (pid:1434) ] - block 0: archiving block elements done in 0.043s [2019-09-18 00:08:45] INFO : [broker-dev4 ] [sla ] [archive (pid:1434) ] 55 entries archive for the day 17-09-2019 in 0.157ss nb block 1 |
Démarrage du process de migration
| Code Block |
|---|
[2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] Sub process ready to work. [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] Parameter load for database connection [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] - database ------------------------- :[shinken] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] - uri ------------------------------ :[mongodb://localhost/?w=1&fsync=false] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] - replica_set ---------------------- :[] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] - use_ssh_tunnel ------------------- :[False] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] - ssh_keyfile ---------------------- :[~shinken/.ssh/id_rsa] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] - ssh_user ------------------------- :[root] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] - use_ssh_retry_failure ------------ :[1] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] - auto_reconnect_max_try ----------- :[3] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] - auto_reconnect_sleep_between_try - :[3] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] Parameter load for migrating [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] - daily_clean_batch_size:[10000] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] - daily_clean_pause_time:[2] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] - nb_stored_days:[INFINITE] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] Try to open a Mongodb connection to mongodb://localhost/?w=1&fsync=false:shinken [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] Open mongo connection done in 0.001s [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] Open mongo connection done in 0.001s [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] [MONGO] Ensure mongo index done in 0.003s [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] [INITIALISATION ] Load 55 elements info in cache done in 0.001s [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [migration (pid:13226) ] check raw sla collection format collections:[Date(yday=260, year=2019):True] all is migrate:[True] |
Migration check :
Pas de migration :
| Code Block |
|---|
[2019-09-18 00:08:55] INFO : [broker-dev4 ] [sla ] [migration (pid:1433) ] No archive need migration. Check done in:0.001s. |
Démarrage d'un worker
| Code Block |
|---|
[2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] Sub process ready to work. [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] Staring new worker. [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] Parameter load for database connection [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] - database ------------------------- :[shinken] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] - uri ------------------------------ :[mongodb://localhost/?w=1&fsync=false] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] - replica_set ---------------------- :[] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] - use_ssh_tunnel ------------------- :[False] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] - ssh_keyfile ---------------------- :[~shinken/.ssh/id_rsa] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] - ssh_user ------------------------- :[root] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] - use_ssh_retry_failure ------------ :[1] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] - auto_reconnect_max_try ----------- :[3] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] - auto_reconnect_sleep_between_try - :[3] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] Try to open a Mongodb connection to mongodb://localhost/?w=1&fsync=false:shinken [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] Open mongo connection done in 0.002s [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] Open mongo connection done in 0.002s [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] Ensure mongo index done in 0.002s [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] Load previous state of 1 elements done in 0.000s. [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] Parameter load for build raw sla [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] - time_before_shinken_inactive:[30] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] - store_output:[True] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] - store_long_output:[True] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] - list_of_stored_output_status:[set([])] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] New worker start in 0.007s. [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] [sla[0]]: Now running.. |
Nombre de mise à jour en base par worker par secondes
| Code Block |
|---|
[2019-09-17 16:50:11] INFO : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] 0 raw data update in database for the day 17-09-2019 |
Les logs du module SLA
| Code Block |
|---|
Fail to archive collection 150_2020 (for date 29-05-2020) because it was lock by [broker-int-13 sla2 archive (pid:23460)] and i am [broker-int-13 sla2 archive (pid:23058)] (an other process try to archive this day) |
Dans le cas ou où 2 modules SLA écrive écrivent dans la même base, les 2 modules vont tenter de faire l'archive du jour en même temps alors . C'est pourquoi nous avons mis un lock pour éviter afin d'avoir des éviter les doublons dans les entrées SLA en double.
Si vous avez se ce log vérifiez votre configuration si vous avez n’avez pas 2 modules SLA ou 2 broker brokers qui écrivent dans la même base Mongo.