Understanding the impact of geometric changes on the properties of otherwise symmetric nanostructures is of essential importance for nanophotonics. Here we show that intra- and inter-unit cell symmetry breaking can substantially modify the optical properties of nanotrimers from both experimental and simulation perspectives. Specifically, shifting the location of one nano-dot within the trimer unit cell leads to the formation of magnetic Fano resonances with loop-like polarization patterns that are not present in the symmetric configuration. We further unlock the impact of lattice modification on the optical response of square arrays of asymmetric trimers with intra-trimer distances as small as 25 nm, showing distinctively different spectral evolutions of the electric and magnetic Fano resonances. The results achieved highlight symmetry breaking as an essential tool to unlock and strengthen predefined resonances, which can have important applications particular in the field of sensing.