it is highly unlikely that the builder is going to refund or reduce the HOA fee.
the builder might be more amenable to giving townhouse owner's access to the gym/facilities in the apartment complexes while the pool house is in use.
i wonder if there is some way to regularly communicate with all the owners in order to enhance our strengthen our negotiating position with the HOA and builder.