This dissertation describes energy dissipation and microwave loss due to non-equilibrium quasiparticles in superconducting transmon qubits and titanium nitride coplanar waveguide resonators. During the measurements of transmon T1 relaxation time and resonator quality factor QI, I observed reduced microwave loss as the temperature increased from 20 mK to approximately Tc/10 at which the loss takes on a minimum value. I argue that this effect is due to non-equilibrium quasiparticles. I measured the temperature dependence of the relaxation time T1 of the excited state of an Al/AlOx/Al transmon and found that, in some cases, T1 increased by almost a factor of two as the temperature increased from 30 mK to 100 mK with a best T1 of 0.2 ms. I present an argument showing this unexpected temperature dependence occurs due to the behavior of non-equilibrium quasiparticles in devices in which one electrode in the tunnel junction has a smaller volume, and slightly smaller superconducting energy gap, than the other electrode. At sufficiently low temperatures, non-equilibrium quasiparticles accumulate in the electrode with the smaller gap, leading to a relatively high density of quasiparticles at the junction and a short T1. Increasing the temperature gives the quasiparticles enough thermal energy to occupy the higher gap electrode, reducing the density at the junction and increasing T1. I present a model of this effect, extract the density of quasiparticles and the two superconducting energy gaps, and discuss implications for increasing the relaxation time of transmons. I also observed a similar phenomenon in low temperature microwave studies of titanium nitride coplanar waveguide resonators. I report on loss in a resonator at temperatures from 20 mK up to 1.1 K and with the application of infrared pair breaking radiation (λ=1.55 μm). With no applied IR light, the internal quality factor increased from QI = 800,000 at T < 70 mK up to QI=(2×10^6 ) at 600 mK. The resonant frequency f0 increased by 2 parts per million over the same temperature range. Above 600 mK both QI and f0 decreased rapidly, consistent with the increase in the density of thermally generated quasiparticles. With the application of IR light and for intensities below 1 aW μm^(-2) and T < 400 mK, QI increased in a similar way to increasing the temperature before beginning to decrease with larger intensities. I show that a model involving non-equilibrium quasiparticles and two regions of different superconducting gaps can explain this unexpected behavior.