The muscle is just a storage area for the oil deposit. While the steroid in attached to it's ester, it is not active. Over time the ester is slowly broken down and the actual hormone is released into the blood. It is then available to bind to androgen receptors.
Not sure if there would be any site specific advantage to non-esterified steroids? Although, I suspect if there were it would be minimal.