This issue seems to be introduced with commit 251cc826be7dec61e574b291b371362c10dd84ea
https://www.armlinux.org.uk/developer/patches/viewpatch.php?id=9189%2F1 v5.17 with the mentioned Patch + v5.18-rc1 which already contains the patch are both working fine again on the platform.