You are completely right, I was messing with my config and when I changed it back I accidentally put /24 instead of /0. It should be:
[Interface]
#
PrivateKey=
Address=10.253.0.5/32
DNS=192.168.X.X
[Peer]
PresharedKey=
PublicKey=
Endpoint=mydomain.com:51820
AllowedIPs=0.0.0.0/0
I’m not using virtual adapter mode. I’m back at work today and changing my subnet at home to 192.168.200.0 seemed to do what I needed.