When viewing a fragment that has had files deleted in it, and you upload a new ZIP over the top, it appears to update the references to the new files (i.e. you can download a ZIP at the latest version and get the binaries that were just uploaded), but in the UI it shows the files as deleted.
Again to restate, this doesn't prevent you from updating fragments to newer versions, the deletion status just appears to be visual in the UI...