Memory can only be brought back to lower clocks when setting power_dpm_force_performance_level to "manual" and forcing a lower socclk state eg. "2" in pp_dpm_socclk or by rebooting.