Ok, so I added another user in configuration.nix, nixos-rebuild switch and *plop*, now I have a logout menu. Nice that it did it dynamically, but ...
I know this isn't Windows, and you often don't actually have to log out, but I did it several times these two weeks, partly because the machine is new and I'm fiddling with things.