This is not the case. You only see the delete button if you have a not released (yellow) version

Why does this matter?