To properly remove your USB devices in Windows you must use the Safe Removal option but sometimes in our haste we tend not to do so. You might be worried that your files might disappear once. But, if you have set to quick removal the policy rules for your USB device, you are free to safely remove it without the Safe Removal option.