I just upgraded to big Sur yesterday and since then I'm having the exact same problem. There is frequent spinning when I use finder and it has make my work efficiency extremely slow.