Module chargés dans le broker
| Code Block |
|---|
[2019-09-17 16:49:59] INFO : [broker-dev4 ] I correctly loaded the modules: [sla,Simple-log,WebUI,Livestatus,Graphite-Perfdata] |
Initialisation du module SLA
Sur le Broker
Création du module
| Code Block |
|---|
[20192021-0904-1713 15:3303:1908] INFO : [ broker-dev4master ] [ sla ] [INITIALISATION ] Creating new SLA module name : sla for] broker [2019-09-17 15:33:20] INFO : [WebUI ] [sla ] [INITIALISATION ] Creating new SLA module name : sla for webui |
Parametre de connection à la base mongo
| Code Block |
|---|
[2019-09-17 16:49[ INITIALISATION ] ============= Starting module initialisation ============== [2021-04-13 15:07:59] INFO : [ broker-dev4master ] [ sla ] [ INITIALISATION ] Creating [MONGO] Parameter load for database connection [2019-09-17 16:49new migration process named : broker [ - Module: sla - migration] [2021-04-13 15:07:59] INFO : [ broker-dev4master ] [ sla ] [ ] [ INITIALISATION ] Creating new archive process named : broker [MONGO] - database ------------------------- :[shinkenModule: sla - archive] [20192021-0904-1713 1615:4908:5902] INFO : [ broker-dev4master ] [ sla ] [ INITIALISATION ] [MONGOCreating a queue manager process for the module. [2021-04-13 15:08:04] INFO : [ broker-master ] [ sla ] [ INITIALISATION ] Reading module configuration [2021-04-13 15:08:04] INFO : [ broker-master ] [ sla ] [ INITIALISATION ] Creating 1 workers |
Paramètre de connexion à la base mongo
| Code Block |
|---|
[2021-04-13 15:08:04] INFO : [ broker-master ] [ sla ] [ INITIALISATION ] [ MONGO ] Creating connection to sla database [shinken] [2021-04-13 15:08:04] INFO : [ broker-master ] [ sla ] [ INITIALISATION ] [ MONGO ] Parameter load for database connection [2021-04-13 15:08:04] INFO : [ broker-master ] [ sla ] [ INITIALISATION ] [ MONGO ] - database -] - uri ------------------------------ :[mongodb://localhost/?w=1&fsync=false] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - replica_set ---------------------- :[] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - use_ssh_tunnel ------------------- :[False] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - ssh_keyfile ---------------------- :[~shinken/.ssh/id_rsa] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - ssh_user ------------------------- :[root] [2019-09-17 16:49:59] INFO : [broker-dev4 ] [sla ] [INITIALISATION ] [MONGO] - use_ssh_retry_failure ------------------------ :[1shinken] [20192021-0904-1713 1615:4908:5904] INFO : [ broker-dev4master ] [ sla ] [ INITIALISATION ] [ MONGO ] - auto_reconnect_max_tryuri ----------- :[3------------------- :[mongodb://localhost/?w=1&fsync=false] [20192021-0904-1713 1615:4908:5904] INFO : [ broker-dev4master ] [ sla ] [ INITIALISATION ] [ MONGO ] - auto_reconnect_sleep_between_try - :[3] |
Démarrage du process d'archive
| Code Block |
|---|
[2019-09-17 16:50:02replica_set ---------------------- :[] [2021-04-13 15:08:04] INFO : [ broker-dev4 master ] [ sla ] [archive (pid:13227) INITIALISATION ] [INITIALISATION MONGO ] - use_ssh_tunnel ] Sub process ready to work. [2019-09-17 16:50:02------------------- :[False] [2021-04-13 15:08:04] INFO : [ broker-dev4master ] [ sla ] [archive (pid:13227) INITIALISATION ] [INITIALISATION MONGO ] - ] [MONGO] Parameter load for database connection [2019-09-17 16:50:02ssh_keyfile ---------------------- :[~shinken/.ssh/id_rsa] [2021-04-13 15:08:04] INFO : [ broker-dev4master ] [ sla ] [archive (pid:13227)INITIALISATION ] ] [INITIALISATION MONGO ] [MONGO] - databasessh_user ------------------------- :[shinkenroot] [20192021-0904-1713 1615:5008:0204] INFO : [ broker-dev4master ] [ sla ] [archive (pid:13227) INITIALISATION ] [INITIALISATION MONGO ] [MONGO] - uri -------ssh_tunnel_timeout ----------------------- :[mongodb://localhost/?w=1&fsync=false2] [20192021-0904-1713 1615:5008:0204] INFO : [ broker-dev4master ] [ sla ] [archive (pid:13227) INITIALISATION ] [INITIALISATION MONGO ] [MONGO] - replica_set ----use_ssh_retry_failure ------------------ :[1] [20192021-0904-1713 1615:5008:0204] INFO : [ broker-dev4master ] [ sla ] [archive (pid:13227) INITIALISATION ] [INITIALISATION ] [MONGO MONGO ] - useauto_sshreconnect_tunnelmax_try ------------------- :[False3] [20192021-0904-1713 1615:5008:0204] INFO : [ broker-dev4master ] [ sla ] [archive (pid:13227) INITIALISATION ] [INITIALISATION MONGO ] [MONGO] - auto_reconnect_sleep_between_try - :[3] [2021-04-13 15:08:04] INFO : [ broker-master ] [ sla ] [ INITIALISATION ] [ MONGO ] Try to open a Mongodb connection to mongodb://localhost/?w=1&fsync=false:shinken [2021-04-13 15:08:04] INFO : [ broker-master ] [ sla ] [ INITIALISATION ] [ MONGO ] Mongo connection established in 8.69ms [2021-04-13 15:08:04] INFO : [ broker-master ] [ sla ] [ INITIALISATION ] [ MONGO ] Ensure mongo index done in 5.01ms |
Fin de l'initialisation du module
| Code Block |
|---|
[2021-04-13 15:11:49] INFO : [ broker-master ] [ sla ] [ INITIALISATION ] Load from collection 28 elements info in cache done in 0.84ms
[2021-04-13 15:11:49] INFO : [ broker-master ] [ sla ] [ INITIALISATION ] Found first element monitoring at 17-06-2020 10:42:52
[2021-04-13 15:11:49] INFO : [ broker-master ] [ sla ] [ INITIALISATION ] ============= Module initialized in 234.97ms ============== |
Démarrage du processus de migration
| Code Block |
|---|
[2021-04-13 15:40:56] INFO : [ broker ssh_keyfile ---------------------- :[~shinken/.ssh/id_rsa] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [ sla ] [archive migration (pid:13227) ] [INITIALISATION31197) ] [ INITIALISATION ] Sub process ready to work. [2021-04-13 15:40:56] INFO : [ broker ] [MONGO sla ] [ migration - ssh_user ------------------------- :[root] [2019-09-17 16:50:02(pid:31197) ] [ INITIALISATION ] Migration process broker [ - Module: sla-writer - migration] initialization [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [archive migration (pid:1322731197) ] [ INITIALISATION ] [MONGO] - use_ssh_retry_failure ------------ :[1] [2019-09-17 16:50:02Parameter load for migrating [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [archive migration (pid:1322731197) ] [INITIALISATION ] [MONGO INITIALISATION ] - autodaily_reconnectclean_maxbatch_trysize ----------------- :[310000] [20192021-0904-1713 1615:5040:0256] INFO : [ broker-dev4 ] [sla ] [ sla ] [archive (pid:13227) ] [INITIALISATION ] [ migration (pid:31197) ] [MONGO INITIALISATION ] - autodaily_reconnectclean_sleeppause_between_try -time ----------------- :[32.0] [20192021-0904-1713 1615:5040:0256] INFO : [broker-dev4 broker ] [ sla ] [archive migration (pid:1322731197) ] [ INITIALISATION ] - ] Parameter load for build sla archive [2019-09-17 16:50:02broker_module_sla_migration_batch_size - :[1000] [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [archive migration (pid:1322731197) ] [ INITIALISATION ] - time_before_shinken_inactive:[30broker_module_sla_migration_pause_time - :[0.1] [20192021-0904-1713 1615:5040:0256] INFO : [broker-dev4 broker ] [ sla ] [archive migration (pid:1322731197) ] [INITIALISATION [ INITIALISATION ] ] Parameter load for archiving sla [2019-09-17 16:50:02- nb_stored_days ------------------------- :[INFINITE] [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [archive migration (pid:1322731197) ] [ INITIALISATION ] - ] - size_chunk_to_archive:[10000] [2019-09-17 16:50:02time_when_delete_old_SLA --------------- :[03:02] [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [archive migration (pid:1322731197) ] [ INITIALISATION ] [ MONGO ] Creating connection to ]sla - time_between_two_chunks:[0.1database [shinken] [20192021-0904-1713 1615:5040:0256] INFO : [broker-dev4 broker ] [ sla ] [archive migration (pid:1322731197) ] [ INITIALISATION ] [ MONGO ] Try to open ]a Mongodb connection - keep_raw_sla_day:[7] [2019-09-17 16:50:02to mongodb://localhost/?w=1&fsync=false:shinken [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [archive migration (pid:1322731197) ] [ INITIALISATION ] [ MONGO ] Mongo connection - Initialisation of the archive process done [2019-09-17 16:50:02established in 6.62ms [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [archive migration (pid:1322731197) ] [ INITIALISATION ] [ MONGO ] TryEnsure tomongo openindex adone Mongodb connection to mongodb://localhost/?w=1&fsync=false:shinken [2019-09-17 16:50:02] INFO : [broker-dev4in 4.18ms [2021-04-13 15:40:56] INFO : [ broker ] [ sla ] [archive migration (pid:1322731197) ] [ INITIALISATION ] Load from collection 28 elements info ]in [MONGO] Open mongo connection cache done in 0.002s92ms [20192021-0904-1713 1615:5040:0256] INFO : [broker-dev4 broker ] [ sla ] [archive migration (pid:1322731197) ] [ INITIALISATION ] Migration process broker [ - ] [MONGO] Open mongo connection done in 0.002s [2019-09-17 16:50:02Module: sla-writer - migration] initialized |
Démarrage du processus d'archive
| Code Block |
|---|
[2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [ archive (pid:1322731201) ] [ INITIALISATION ] [MONGO]Sub Ensureprocess mongoready index done in 0.004sto work. [20192021-0904-1713 1615:5040:0256] INFO : [broker-dev4 broker ] [ sla ] [ archive (pid:1322731201) ] [ INITIALISATION ] Starting ] Load 55 elements info in cache done in 0.001s |
Archivage en cours
| Code Block |
|---|
[2019-09-18 00:08:45initialization of archive process [broker [ - Module: sla-writer - archive]] [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [ archive (pid:143431201) ] [ INITIALISATION ] Reading configuration Archivingfor thesla day 17-09-2019archive writing [20192021-0904-1813 0015:0840:4556] INFO : [broker-dev4 broker ] [ sla ] [ archive (pid:143431201) ] [ INITIALISATION ] 55 items to archive in 1 blocks ( max size block : 10000 ) [2019-09-18 00:08:45] INFO : [broker-dev4- time_before_shinken_inactive ----------------------------------:[30] [2021-04-13 15:40:56] INFO : [ broker ] [ sla ] [ archive (pid:143431201) ] [ INITIALISATION ] - - block 0: archiving 55 elements [2019-09-18 00:08:45minimal_time_before_an_element_become_missing_data ------------:[0] [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [ archive (pid:143431201) ] [ INITIALISATION ] Found first monitoring start time at 10-09-2019 23:51:30 [2019-09-18 00:08:45 - minimal_time_before_an_element_become_missing_data_at_startup -:[0] [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [ archive (pid:143431201) ] [ INITIALISATION ] Parameter load for - block 0: insert 55 archive in mongo done in 0.003s [2019-09-18 00:08:45sla writing [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [ archive (pid:143431201) ] [ INITIALISATION ] - size_chunk_to_archive --- block 0: archiving block elements done in 0.043s [2019-09-18 00:08:45:[10000] [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [ archive (pid:143431201) ] [ INITIALISATION ] 55 entries archive for the day 17-09-2019 in 0.157ss nb block 1 |
Démarrage du process de migration
| Code Block |
|---|
[2019-09-17 16:50:02- time_between_two_chunks - :[0.1] [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [migration archive (pid:1322631201) ] [ INITIALISATION ] - keep_raw_sla_day -------- ] Sub process ready to work. [2019-09-17 16:50:02:[7] [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [migration archive (pid:1322631201) ] [ INITIALISATION ] [ MONGO ] [MONGO]Creating Parameterconnection loadto forsla database connection[shinken] [20192021-0904-1713 1615:5040:0256] INFO : [broker-dev4 broker ] [ sla ] [migration archive (pid:1322631201) ] [ INITIALISATION ] [ MONGO ] Try to open - database ------------------------- :[shinken] [2019-09-17 16:50:02a Mongodb connection to mongodb://localhost/?w=1&fsync=false:shinken [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [migration archive (pid:1322631201) ] [ INITIALISATION ] [MONGO] - uri ------------------------------ :[mongodb://localhost/?w=1&fsync=false] [2019-09-17 16:50:02 MONGO ] Mongo connection established in 16.50ms [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [migration archive (pid:1322631201) ] [INITIALISATION ] [MONGO] - replica_set ---------------------- :[] [2019-09-17 16:50:02 INITIALISATION ] [ MONGO ] Ensure mongo index done in 6.95ms [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [migration archive (pid:1322631201) ] [ INITIALISATION ] Load from collection 28 elements info ]in [MONGO]cache - use_ssh_tunnel ------------------- :[False] [2019-09-17 16:50:02done in 0.79ms [2021-04-13 15:40:56] INFO : [broker-dev4 broker ] [ sla ] [migration archive (pid:1322631201) ] [ INITIALISATION ] Archive ]process [broker [MONGO] - Module: sla-writer - ssh_keyfile ---------------------- :[~shinken/.ssh/id_rsa] [2019-09-17 16:50:02archive]] initialized in 51.06ms |
Démarrage des workers
| Code Block |
|---|
[2021-04-13 15:11:50] INFO : [ broker-dev4 master ] [ sla ] [migration (pid:13226) ] [INITIALISATION WORKER MANAGER ] [MONGO]Starting - ssh_user ------------------------- :[root] [2019-09-17 16:50:02worker 0 [2021-04-13 15:11:50] INFO : [ broker-dev4 master ] [ sla ] [migration (pid:13226) ] [INITIALISATION WORKER MANAGER ] [MONGO]The worker 0 is now started as pid:29585 |
| Code Block |
|---|
[2021-04-13 15:40:57- use_ssh_retry_failure ------------ :[1] [2019-09-17 16:50:02] INFO : [ broker-dev4master ] [ sla ] [migration Worker: 0 (pid:13226) ] [INITIALISATION 31252) ] [MONGO] INITIALISATION ] Sub - auto_reconnect_max_try ----------- :[3] [2019-09-17 16:50:02process ready to work. [2021-04-13 15:40:57] INFO : [ broker-dev4 master ] [ sla ] [migration Worker: 0 (pid:1322631252) ] [ INITIALISATION ] [MONGO]Staring - auto_reconnect_sleep_between_try - :[3] [2019-09-17 16:50:02new worker. [2021-04-13 15:40:57] INFO : [ broker-dev4 master ] [ sla ] [migration Worker: 0 (pid:1322631252) ] [ INITIALISATION ] [ MONGO ] Creating connection to ]sla Parameter load for migratingdatabase [shinken] [20192021-0904-1713 1615:5040:0257] INFO : [ broker-dev4master ] [ sla ] [migration Worker: 0 (pid:1322631252) ] [ INITIALISATION ] [ MONGO ] Try to open ]a Mongodb connection - daily_clean_batch_size:[10000] [2019-09-17 16:50:02to mongodb://localhost/?w=1&fsync=false:shinken [2021-04-13 15:40:57] INFO : [ broker-dev4 master ] [ sla ] [migration Worker: 0 (pid:1322631252) ] [ INITIALISATION ] [ MONGO ] Mongo connection established - daily_clean_pause_time:[2] [2019-09-17 16:50:02in 5.85ms [2021-04-13 15:40:57] INFO : [ broker-dev4master ] [ sla ] [migration Worker: 0 (pid:1322631252) ] [ INITIALISATION ] [ MONGO ] Ensure mongo index ] - nb_stored_days:[INFINITE] [2019-09-17 16:50:02done in 15.31ms [2021-04-13 15:40:57] INFO : [ broker-dev4master ] [ sla ] [migration Worker: 0 (pid:1322631252) ] [ INITIALISATION ] [MONGO]Load Tryprevious tostate openof a28 Mongodbelements connectiondone to mongodb://localhost/?w=1&fsync=false:shinken [2019-09-17 16:50:02in 466.86ms. [2021-04-13 15:40:57] INFO : [ broker-dev4 master ] [ sla ] [migration Worker: 0 (pid:1322631252) ] [ INITIALISATION ] [MONGO]Parameter Openload mongofor connectionbuild done in 0.001sraw sla [20192021-0904-1713 1615:5040:0257] INFO : [ broker-dev4master ] [ sla ] [migration Worker: 0 (pid:1322631252) ] [ INITIALISATION ] - time_before_shinken_inactive - ] :[MONGO] Open mongo connection done in 0.001s30] [20192021-0904-1713 1615:5040:0257] INFO : [ broker-dev4master ] [ sla ] [migration Worker: 0 (pid:1322631252) ] [ INITIALISATION ] - store_output ] [MONGO] Ensure mongo index done in 0.003s [2019-09-17 16:50:02----------------- :[True] [2021-04-13 15:40:57] INFO : [ broker-dev4master ] [ sla ] [migration Worker: 0 (pid:13226) ] [INITIALISATION ] Load 55 elements info in cache done in 0.001s [2019-09-17 16:50:0231252) ] [ INITIALISATION ] - store_long_output ------------ :[True] [2021-04-13 15:40:57] INFO : [ broker-dev4master ] [ sla ] [migration Worker: 0 (pid:1322631252) ] check[ rawINITIALISATION sla] collection format collections:[Date(yday=260, year=2019):True] all is migrate:[True] |
Migration check :
Pas de migration :
| Code Block |
|---|
[2019-09-18 00:08:55] INFO : [broker-dev4 ] [sla ] [migration (pid:1433) ] No archive need migration. Check done in:0.001s.
|
Démarrage d'un worker
- list_of_stored_output_status - :[set([])]
[2021-04-13 15:40:57] INFO : [ broker-master ] [ sla ] [ Worker: 0 (pid:31252) ] [ INITIALISATION ] New worker start in 468.01ms. |
Sur la WebUI
Création du module
| Code Block |
|---|
[2021-04-13 15:50:24 |
| Code Block |
[2019-09-17 16:50:02] INFO : [broker-dev4 WebUI ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION INITIALISATION ] ============= Starting module ]initialisation Sub process ready to work. [2019-09-17 16:50:02 ============== [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [ sla ] [Worker: 0 (pid:13266) INITIALISATION ] [INITIALISATIONReading configuration for sla ] Staring new worker.archive building [20192021-0904-1713 1615:50:0224] INFO : [broker-dev4 WebUI ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] Parameter load for database connection [2019-09-17 16:50:02 ] [ INITIALISATION ] - time_before_shinken_inactive ----------------------------------:[30] [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO INITIALISATION ] - database minimal_time_before_an_element_become_missing_data ------------------------- :[shinken0] [20192021-0904-1713 1615:50:0224] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [ ]INITIALISATION [MONGO] - uri ------------------------------ :[mongodb://localhost/?w=1&fsync=false] [2019-09-17 16:50:02minimal_time_before_an_element_become_missing_data_at_startup -:[0] [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [MONGO] INITIALISATION ] Reading module configuration |
Paramètre de connexion à la base mongo
| Code Block |
|---|
[2021-04-13 15:50:24 - replica_set ---------------------- :[] [2019-09-17 16:50:02] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [ INITIALISATION ] [ MONGO ] Creating connection to - use_ssh_tunnel ------------------- :[Falsesla database [shinken] [20192021-0904-1713 1615:50:0224] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [ INITIALISATION ] [ MONGO ] Parameter load for - ssh_keyfile ---------------------- :[~shinken/.ssh/id_rsa] [2019-09-17 16:50:02database connection [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [ sla ] [Worker: 0 (pid:13266) ] [ INITIALISATION ] [ MONGO ] - ssh_userdatabase ------------------------- :[rootshinken] [20192021-0904-1713 1615:50:0224] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [ INITIALISATION ] [ MONGO ] - use_ssh_retry_failure uri ------------------------------ :[mongodb://localhost/?w=1&fsync=false] [20192021-0904-1713 1615:50:0224] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [ INITIALISATION ] [ MONGO ] - auto_reconnect_max_tryreplica_set ---------------------- :[3] [20192021-0904-1713 1615:50:0224] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [ INITIALISATION ] [ MONGO ] - autouse_reconnect_sleep_between_try -ssh_tunnel ------------------- :[3False] [20192021-0904-1713 1615:50:0224] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [ INITIALISATION ] [ MONGO ] Try to open a- Mongodb connection to mongodb://localhost/?w=1&fsync=false:shinken [2019-09-17 16:50:02ssh_keyfile ---------------------- :[~shinken/.ssh/id_rsa] [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [ INITIALISATION ] [ MONGO ] Open mongo connection- done in 0.002s [2019-09-17 16:50:02ssh_user ------------------------- :[root] [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [ INITIALISATION ] [ MONGO ] Open mongo connection done in 0.002s [2019-09-17 16:50:02] INFO : [broker-dev4- ssh_tunnel_timeout --------------- :[2] [2021-04-13 15:50:24] INFO : [ WebUI ] [ sla ] [Worker: 0 (pid:13266) INITIALISATION ] [INITIALISATION MONGO ] - ] [MONGO] Ensure mongo index done in 0.002s [2019-09-17 16:50:02use_ssh_retry_failure ------------ :[1] [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [ sla ] [Worker: 0 (pid:13266) INITIALISATION ] [INITIALISATION MONGO ] Load previous state of 1 elements done in 0.000s. [2019-09-17 16:50:02- auto_reconnect_max_try ----------- :[3] [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [ sla ] [Worker: 0 (pid:13266) INITIALISATION ] [INITIALISATION MONGO ] - ] Parameter load for build raw sla [2019-09-17 16:50:02auto_reconnect_sleep_between_try - :[3] [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [ sla ] [Worker: 0 (pid:13266) INITIALISATION ] [INITIALISATION MONGO ] Try to open a Mongodb ]connection - time_before_shinken_inactive:[30] [2019-09-17 16:50:02to mongodb://localhost/?w=1&fsync=false:shinken [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [ sla ] [Worker: 0 (pid:13266) INITIALISATION ] [INITIALISATION MONGO ] Mongo connection established - store_output:[True]in 4.09ms [20192021-0904-1713 1615:50:0224] INFO : [broker-dev4 WebUI ] [ sla ] [Worker: 0 (pid:13266) INITIALISATION ] [INITIALISATION MONGO ] Ensure mongo index done ] - store_long_output:[True] [2019-09-17 16:50:02in 3.35ms [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [sla ] [ sla ] [Worker: 0 (pid:13266) ] [INITIALISATION ] [ INITIALISATION ] Load from collection - list_of_stored_output_status:[set([])] [2019-09-17 16:50:02] INFO : [broker-dev4 ] [sla 28 elements info in cache done in 0.85ms |
Fin de l'initialisation du module
| Code Block |
|---|
[2021-04-13 15:50:24] INFO : [ WebUI ] [Worker: 0 (pid:13266) ] [INITIALISATION sla ] New worker start in 0.007s. [2019-09-17 16:50:02] INFO : [broker-dev4 INITIALISATION ] [sla============= Module initialized ] [Worker: 0 (pid:13266) ] [sla[0]]: Now running.. |
Nombre de mise à jour en base par worker par secondes
| Code Block |
|---|
[2019-09-17 16:50:11in 24.19ms ============== [2021-04-13 15:50:24] INFO : [broker-dev4 WebUI ] [ sla ] [Worker: 0 (pid:13266) INITIALISATION ] 0Found rawfirst dataelement update in database for the daymonitoring at 17-09-201906-2020 10:42:52 |
Cas de 2 modules qui archive le même jour en base
| Code Block |
|---|
[2019-09-18 00:08:45] ERROR : [broker-dev4 ] [sla ] [archive (pid:1434) ] Fail to archive collection 150_2020 (for date 29-05-2020) because it was lock by [broker-int-13 sla2 archive (pid:23460)] and i am [broker-int-13 sla2 archive (pid:23058)] (an other process try to archive this day) |
Dans le cas où 2 modules SLA écrivent dans la même base, les 2 modules vont tenter de faire l'archive du jour en même temps. C'est pourquoi nous avons mis un lock afin d'éviter les doublons dans les entrées SLA.
Si vous avez ce log vérifiez votre configuration si vous n’avez pas 2 modules SLA ou 2 brokers qui écrivent dans la même base Mongo.
Ecriture des états futurs (les états qu'on reporte sur les jours d'après)
Lors de l'écriture des états futurs l'on a le log suivant :
| Code Block |
|---|
[2019-09-18 00:08:45] ERROR : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] Save future states in [31.00ms]. Found [10] entries in base in [0.00ms]. Saving [4] new entries in [31.00ms]. Update [0] entries in [0.00ms] |
Une fois par jour on nettoie aussi les états future à supprimer
| Code Block |
|---|
[2019-09-18 00:08:45] ERROR : [broker-dev4 ] [sla ] [Worker: 0 (pid:13266) ] The clean of future states found [4] entries to delete. There was deleted in [35.00ms (2.00ms for found entries, 33.00ms for delete entries)]. |
Log de migration des données SLA
A chaque démarrage du module on fait une recherche des données à migrer :
| Code Block |
|---|
[2020-07-22 15:11:39] INFO : [broker-master ] [sla ] [migration (pid:32233) ] Need to migrate 931144 archives |
Puis si il y a des données à migrer on log la progression :
| Code Block |
|---|
[2020-07-22 15:11:39] INFO : [broker-master ] [sla ] [migration (pid:32233) ] Migrating in progress 1000/931144 archives [2020-07-22 15:11:39] INFO : [broker-master ] [sla ] [migration (pid:32233) ] Migrating in progress 2000/931144 archives [2020-07-22 15:11:39] INFO : [broker-master ] [sla ] [migration (pid:32233) ] Migrating in progress 3000/931144 archives [2020-07-22 15:11:40] INFO : [broker-master ] [sla ] [migration (pid:32233) ] Migrating in progress 4000/931144 archives |
Puis enfin :
Si il y a eu une migration :
| Code Block |
|---|
[2020-07-22 15:18:37] INFO : [broker-master ] [sla ] [migration (pid:32233) ] Migrate 931144 archive done in:7m 0.14s. |
Sinon:
| Code Block |
|---|
[2020-07-22 09:58:47] INFO : [broker-dev4 ] [sla ] [migration (pid:10878) ] No archive need migration. Check done in:1.09ms. |
Erreurs
La connexion au serveur Mongo n'est pas établie à l'initialisation du module SLA
Avec Tunnel SSH
| Code Block |
|---|
[2021-02-10 10:39:45] ERROR : [ WebUI ] [SLA][INITIALISATION] Initialisation Module: Error : [ WebUI -sla ] [ SSH TUNNEL ] [ MONGODB ] - mongo connection failure : localhost:43577 ==(ssh tunnel)==> 192.168.1.87:22 ==(mongodb)==> 192.168.1.87:27017. |
Sans Tunnel SSH
| Code Block |
|---|
[YYYY-MM-DD HH:MM:SS] ERROR : [ WebUI ] [SLA][INITIALISATION] Initialisation Module: Error : [ broker-master -sla ] [ MONGODB ] - mongo connection failure to 192.168.1.87:27017 |