You should install scikit-learn by conda, not pip. as well as numpy, etc.

by the way, the version of numpy should be 1.19.5, not 1.20.x, use conda install numpy==1.19.5