I had that same extremely annoying problem, where deleting empty folder would block while "discovering items".
The moment when I killed TSVNCache.exe and/or TGitCache.exe discovering was done and I didn't have that problem anymore. So, not only all that Tortoise stuff asks you to reboot your PC with every update, it also screws explorer badly.