Energy-based design method for earthquake-induced response of the building is proposed by Akiyama. This method is very useful for evaluation of the cumulative damage. However, the energy-based design method for wind-induced response of the building has not been established yet. In this paper, we establish a prediction method for cumulative damage of high-rise building with hysteretic dampers to fluctuating wind force based on energy. We newly propose optimum yield-shear force coefficient distribution and damage concentration factor for the damage prediction by wind-induced response. The validity of this method is verified by comparing with time history analytical results.