To clarify, I’m referring to "All activity", not “Recently Played”.

Update: The “You started Playing XXX” activity finally showed up after about 6 days. I’m guessing Apple’s backend needs some time to generate/review the associated data?