We demonstrate how to reduce the loss in photonic bandgap fibers by orders of magnitude by varying the radius of the corner strands in the core surround. As a fundamental working principle we find that changing the corner strand radius can lead to backscattering of light into the fiber core. Selecting an optimal corner strand radius can thus reduce the loss of the fundamental core mode in a specific wavelength range by almost two orders of magnitude when compared to an unmodified cladding structure. Using the optimal corner radius for each transmission window, we observe the low-loss behavior for the first and second bandgaps, with the losses in the second bandgap being even lower than that of the first one. Our approach of reducing the confinement loss is conceptually applicable to all kinds of photonic bandgap fibers including hollow core and all-glass fibers as well as on-chip light cages. Therefore, our concept paves the way to low-loss light guidance in such systems with substantially reduced fabrication complexity.