I have added the "Close" icon to my toolbar (i ahve even created a new
toolbar called "Close"), but as soon as Word closes it loses the change.

I have done this change many times before, and word has always kept my
changes.