I don't know if you want to call it luck or chance, as I tried to switch desktop nothing happened. I took my mouse out of VM, the normal way to put Windows host in focus. For some reason my keyboard was still stuck in VM. I had to force de-select the VM. In order to be able to switch desktop.
Solution: Stop using VirtualWin.