Meshless recolors simply don't appear. Recolorless meshes don't appear either. Either way, they can't be used and are harmless. Mostly.
But they'll still be read by the game, if not actually loaded, yes? So a little extra useless load time? But probably not enough to worry about.