Some will tell you they didn't recruit as well once the FBI opened its investigation, and there's some anectdotal evidence that more five-star players went to schools that aren't your blue blood programs:
Cade Cunningham at Oklahoma State
Evan Mobley to USC
Scottie Barnes to Florida State
Jalen Suggs to Gonzaga (though the Zags are the best team/program in the game today)
In the 2020 class five-star players also signed with Stanford, Arizona State, Howard, Auburn, Tennessee, LSU and Texas - not exactly traditional powers that are annually hanging Final Four banners. So, the elite talent is more dispersed this year and not lumped together at Duke, UNC, Kentucky, Michigan State, etc.
But the obvious answer is those teams that rely so heavily on freshmen and newcomers had less time to work together in the offseason and don't know each other as well as older teams that have been together longer.