Wordpress append -1 to the image name

For e.g. I deleted apple.jpg. Image is deleted permanently. After a while, I upload apple.jpg. Wordpress still append -1 to the image name apple-1.jpg. However, apple.jpg is no where to be found.

I have not encountered this behaviour with previous versions of Wordpress. What can I do to stop wordpress to append -1 to the deleted image filename?

After some search, this seems to be an issue with latest version of wordpress. Files not deleted from server.