There are 2 kinds of noise. A hissing when the volume is turned all the way down and doesn’t increase with volume - this is the amplifier output stage noise. Then there’s noise that increases with volume - this is usually from the source or from the preamp stages. You shouldn’t hear either noise with music playing quietly.