We demonstrate a distributed measurement technique to observe temperature changes along pumped Yb-doped fibers. This technique is based on an array of fiber Bragg gratings acting as a temperature sensor line. The Bragg gratings are inscribed directly into the Yb-doped fiber core using high intensity ultra-short laser pulses and an interferometric setup. We studied the temperature evolution in differently co-doped Yb fibers during optical pumping and identified different effects contributing to the observed temperature increase. We found that pre-loading of fibers with hydrogen supports the formation of Yb2+ during UV irradiation and has a large impact on fiber temperature during pumping. The proposed technique can be applied to investigate the homogeneity of pump absorption in active fibers and to support spatially resolved photodarkening measurements.