I am having this strange problem where I am getting changing axes scales in my seaborn heatmap. As seen in the image below, the scale starts off normal then all of a sudden starts spreading the points out making my plot look very sparse. This should all look like a T shape with a very wide top

I tried setting scales and aspect ratios manually but nothing worked. Honestly I am stumped, I have never seen this problem happen before. I have a suspicion that I need a variable density heatmap but I do not know how to achieve that.