Safe to perform AiiDA backup with unfinished processes?

I regularly backup my AiiDA profiles with the verdi storage backup command. My approach has always been to make sure all the processes have finished before performing a backup. However, I have been running longer and longer workflows lately and it’s becoming more and more difficult to find a moment where no process is running. To avoid the interval between backups becoming too long, I was wondering if it’s safe to perform a backup if there are still unfinished processes. The documentation says that to be safe you should ensure that the profile is not in use during a backup (How to manage your installation — AiiDA 2.7.1 documentation). Is it sufficient to stop all the daemons, even if there are still unfinished/pending processes? Or do you really need to make sure that all processes are completed whenever you do a backup?

Hi!
For the psql_dos backend, the verdi storage backup is fine to be used even while running workflows. It’s good to stop the daemon, but even without stopping, it should work well.

Note that for optimal backups (fastest speed, best compression, etc), one should first run verdi storage maintain, and the --full version can’t be run at the same time as workflows are running. But this is optional.

1 Like