Can one put cloves in an esrog for use during Havdola?
Yes, there is no problem in doing this.
The esrog does not have kedushah. It is an object of a mitzvah, and must be treated with respect, but there is no problem of inserting cloves and using it for havdalah.
On the contrary, this is a respectful thing to do with the esrog.