I gave Asus' DisplayWidget Center a try, but as far as I was able to tell, it does not offer a way to directly configure the resolution of the monitor. The monitor's menu doesn't offer any such options either.
BetterDisplay has options that supposedly override the default resolution and the native resolution of the monitor in the OS profile, but I couldn't get that to make a difference either.
I tried a HDMI 4k @ 120Hz EDID Emulator as suggested earlier, and this finally worked. Starting from both monitors plugged in, I unplugged one cable from the monitor, connected the EDID Emulator, and plugged it back into the monitor; the MacBook didn't detect the monitor at first. But unplugging the other monitor made it detect the one with the emulator, and then re-plugging in the other monitor detected it as well, and so both monitors were working from there on out.
I now have both monitors running at "3008x1692 HiRes @ 120Hz" (which I understand is, in practice, 3840x2160 pixels being pushed to the monitor at 120 Hz).
It's still unclear to me what the root cause here is - whether it worked because the EDID Emulator provided a sufficiently-different ID (which in fact it did, totally different numeric serial number, display name, vendor and model ID, etc.), or because the EDID Emulator forces the signal to 4k @ 120Hz.
It seems to me like the MacBook Pro should be able to detect both monitors "out of the box" though - I imagine the expected behavior when plugging in the monitor is that the system can detect it, and push it a supported resolution that the system can handle.