(Note Sep-2017: It seems that the behavior is currently different from the one explained in this article, now the phone files do disappear when we delete the source chat)
The files that we send and receive through Whatsapp are stored in the memory of the phone even if we eliminate the conversations, something that surely not all users know.