Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Info
Error: An error occurred: Other restart currently in progress. Aborting

There are different error messages, to which this article may apply. Read the Problem section, to learn which exact error messages are relevant.

Status
colourGreen
titleLAST TESTED ON CHECKMK 2.23.0P1


Panel
borderColorblack
bgColor#f8f8f8
titleTable of Contents

Table of Contents

Problem

If you face this problem while activating changes:

Image Removed
You may face ones of these problems while activating changes. The exact error message might look different, but this article might still apply.

Image Added

Image Added
 

One of these error messages might apply to you:

Code Block
languagebash
themeRDark
titleProgress: Failed
Got invalid data:

Internal automation error: Error running automation call restart (exit code 1)., error:

An error occurred: Other restart currently in progress. Aborting.

Solution

...

Code Block
languagebash
themeRDark
022-02-23 15:13:35,705 [30] [cmk.web.automations
7098] 'check_mk --automation restart' returned 'An error occurred: Other restart currently in progress. Aborting.
2022-02-23 15:13:35,705 [40] [cmk.web.automations 7098] Error running 'check_mk --automation restart' (exit code 1)
2022-02-23 15:13:35,706 [40] [cmk.web.site[<sitename>] 7098] error activating changes

Traceback (most recent call last):
Traceback (most recent call last):
File "/omd/sites/mysite/lib/python3/cmk/gui/wato/pages/automation.py", line 231, in
_execute_automation_command
response.set_data(repr(automation.execute(automation.get_request())))

File "/omd/sites/mysite/lib/python3/cmk/gui/wato/watolibpages/activate_changes.py", line 13881034, in _do_run
configuration_warnings = self._do_activate()
execute
return activate_changes.execute_activate_changes(


File "/omd/sites/mysite/lib/python3/cmk/gui/watolib/activate_changes.py", line 1651,2128. in
execute_doactivate_activatechanges

configuration_warnings = self._call_activate_changes_automation()
- get_config_domain(domain_request name)().activate(domain_request.settings)

File "/omd/sites/mysite/lib/python3/cmk/gui/watolib/activateconfig_changesdomains.py", line 166176, in _call_activate_changes_automation
return execute_activate_changes(domains)
("restart": restart, "reload": reload,)[

File "/omd/sites/mysite/lib/python3/cmk/gui/watolib/activatecheck_mk_changesautomations.py",*. line 1792275, in
execute_activate_changes
warnings = domain_class().activate()restart
automation_serialized("restart", args=hosts_to_update)

File "/omd/sites/mysite/lib/python3/cmk/gui/watolib/configcheck_mk_domainsautomations.py", line 60,53. in activate
return automation_serialized
cmdline, serialized_result check_mk_local_automation(config.wato_activation_method)_serialized(

File "/omd/sites/mysite/lib/python3/cmk/gui/watolib/automations.py",. line 143,148. in check_mk_local_automation_serialized raise _local_automation_failure(command=command,
cmk.utilsgui.watolib.exceptionsautomations.MKGeneralExceptionMKAutomationException: Error running automation call <tt>restart</tt>restart (exit
code 1), error:

<pre>AnAn error occurred: Other restart currently in progress, Aborting


Code Block
languagebash
themeRDark
titleProgress: Locked
The site is currently locked by another activation process. Aborting 

Please try again later.

...

Verification

  1. Log into your central Checkmk site as an administrative user and navigate to Background jobs.

  2. Check the section titles Activate Changes Scheduler for running jobs, which are older than a few minutes.

  3. Take note of the UUID at the end of the job name (activate-changes-scheduler-263383ff-b58b-4a8e-ba77-c6e1ff2d3b94).

If you see one or more of the aforementioned jobs, move forward with this article.

Solution A (recommended)

As you verified in the section above, there are lingering files within the central site's ~/tmp/check_mk/wato/activation/ directory. 

  1. A reboot of your Checkmk server's operating system will clear out these files and should allow you to activate changes again.

Solution B

If for whatever reason you cannot or do not want to reboot the server, you can delete the files manually on the command line. We recommend this only be done by experienced users.


  1. Login to your central site as the site user

    Code Block
    languagebash
    themeRDark
    root@linux:~# omd su mysite


    .

  2. Check to see if you have old directories within $OMD_ROOT/tmp/check_mk/wato/activation/

    Code Block
    languagebash
    themeRDark
    OMD[mysite]:~$
  3. omd stop

    .

  4. Reload the config
     ls -lah $OMD_ROOT/tmp/check_mk/wato/activation/
    total 42
    
    drwxrwx--- 3 mysite mysite 100 Jul 4 00:42 6ecd4860-611e-4a4c-912f-74a6f1123e99/
    drwxrwx--- 3 mysite mysite 100 Jul 4 00:42 bec06bbc-1d35-4668-a421-151828b8500d/
    drwxrwx--- 3 mysite mysite 920 Jul 3 18:34 263383ff-b58b-4a8e-ba77-c6e1ff2d3b94/

    It looks like there is one old directory that couldn't be deleted. The files here are deleted every minute by default.


    .
  5. Remove the lingering directory:

    Code Block
    languagebash
    themeRDark
    OMD[mysite]:~$ rm cmk -O

    .

    Start the site again
    -r $OMD_ROOT/tmp/check_mk/wato/activation/263383ff-b58b-4a8e-ba77-c6e1ff2d3b94/


    .

  6. There will be a corresponding background job in $OMD_ROOT/var/check_mk/background_jobs/, which can be cleaned up as well:

    Code Block
    languagebash
    themeRDark
    OMD[mysite]:~$ omd start ls -lah $OMD_ROOT/var/check_mk/background_jobs/
    total 42
    drwx------  2 mysite mysite 4.0K Jul 4 00:42 activate-changes-scheduler-0897307d-d177-4b6e-a500-1263a5ec3299/
    drwx------  2 mysite mysite 4.0K Jul 4 00:42 activate-changes-scheduler-1ba662c2-374a-4bce-9b6a-59329e9f11a5/
    drwx------  2 mysite mysite 4.0K Jul 3 18:34 activate-changes-scheduler-263383ff-b58b-4a8e-ba77-c6e1ff2d3b94/
    
    OMD[mysite]:~$ rm -R $OMD_ROOT/var/check_mk/background_jobs/activate-changes-scheduler-263383ff-b58b-4a8e-ba77-c6e1ff2d3b94/


    .

  7. Now go back to the UI and try to activate changes.


Related articles

Filter by label (Content by label)
showLabelsfalse
max5
spacesKB
showSpacefalse
sortmodified
reversetrue
typepage
cqllabel in ( "troubleshooting" , "activate_changes" ) and type = "page" and space = "KB"
labelstroubleshooting activate_changes

...