Fix removing the config and sending a SIGUSR1 results in segfault