Cool looking bike, I missed this first time round.
I think your frame size is probably correct given how you’re using it. Assuming it’s comfortable the way you have it set up, if you went for a smaller frame you’d end up having to pull your stem right out to get the bars in the same position.