Can recessive genes make offspring inferior?

Generally, the ones that don't effect appearance as you said anyway as this would include things like blue eyes, blond hair etc.