Skip Connection

Skip connections are general architectural structures used to preserve information and gradient flow in very deep networks. Residual blocks are one specific form of this idea, but the concept of skip connections is broader and appears in many network designs. These links can reduce the loss of early-layer information and make optimization significantly easier.