The Big Sur 11.3 update did finally fix this issue. You can once again use AppleScript to get the album artwork of the current track even if the track hasn’t been added to your music library.

@blue_lander I noticed that too. Even though song title, artist, and cover art now work, I still can’t get the album name for any track that has not been added to my library.