This only happens from time to time whenever I access folders from the Libraries shortcut tree. It technically does get deleted because if you try to delete the file again before refreshing, the system will say it no longer exists. If you search google with the keywords "windows 7 library refresh delete," you'll see the complaints about it.
Just tried this and yea, it's only happening from the libraries shortcuts. This only just started happening.