Regulatory changes are taking a bite out of the asset class' desirability as an investment, owners and brokers say.