When introducing opamp circuits, or when working out how things are supposed to work, people normally think about the 'perfect' opamp. For a 'perfect' theoretical opamp, the open-loop gain is infinite, and this makes the difference at the inputs zero.