As a building material, the seismic performance of recycled aggregate concrete (RAC) at low temperature needs to be analyzed before use. At present, the cost of RAC is low, and the demand is large in China. However, seismic performance at low temperatures is uncertain if directly applying the RAC to construction engineering. In view of this problem, a comparative analysis of the seismic resistance of RAC at low temperatures was presented in this paper. The low temperature seismic structure model of RAC was designed through the material ratio of RAC and experimental construction. According to the indicators, low temperature frost resistance, acceleration change, damage index, stiffness stability, and layer displacement change were compared and analyzed. The results of the comparative experiments showed that:(1) with decreasing oxygen content, the heat conservation effect is reduced, and the strength and frost resistance of RAC are also reduced; thus, the durability and stability of RAC are poor, and the seismic behavior is poor; (2) after an earthquake, the displacement and acceleration between the floors vary greatly, so the stability of the floor cannot be guaranteed; and (3), as the displacement and seismic load increase, the RAC gradually undergoes cracking changes. The stiffness decreases rapidly, and the degree of stiffness degradation is large, indicating the low temperature seismic performance of RAC is poor.