At present, landscape architecture design often pays more attention to the view of the building while neglecting safety and stability. This leads to poor seismic response of the landscape building as a whole. Therefore, adding a retaining wall can effectively improve its earthquake resistance. For this reason, a type of retaining wall for landscape buildings with some seismic performance was designed in this paper. The composite fiber material, building refuse, and fiber rope retained in the construction process were used as the filling material of the earthen wall. To maintain the stability of the soil wall, tensile material of certain tensile strength was added to the earth fill. Because the landscape architecture usually pays attention to the visual effect of appearance, the design of "altering flat ground into slope" was used. Plants of a certain visual impact were installed on the wall surface to increase the self-weight of the earthen wall and to promote the stability of the overall structure of the soil wall. The stress state of infinite inclined backfill behind the retaining wall was then analyzed, and the rhombic micro-element was chosen as the research object to calculate the earth pressure strength of the retaining wall. The experimental results showed that the optimized design of the retaining wall structure can effectively enhance the overall seismic capacity of the landscape building.