I’ll have you know that “to’ve” is a real contraction and it’s in the dictionary.

a 1913 dictionary