Numerical simulations are powerful tools to study tsunami impacts on building structures. We have developed a CFD code for free-surface flows interacting with floating debris by using Lattice Boltzmann Method (LBM) and Discrete Element Method (DEM). Both methods are suitable for GPU computing and large-scale simulations because they are explicit time-integration schemes. In order to improve the accuracy and the stability of flow computation, the cumulant LBM model has been employed and coupled with the conservative Allen-Cahn equation for the purpose of free-surface capturing. A moving boundary approach based on the interpolated bounce-back scheme is utilized at liquid-solid interfaces. Rigid body dynamics of floating debris is computed by using DEM. A model constructed by multiple small spheres represents complex shapes of debris. We measure the weak scalability on multiple GPUs of the TSUBAME3.0 supercomputer, and the code achieved 83.4% parallel efficiency when scaled 16 to 256 GPUs. As a test case, we demonstrate a tsunami flow with driftwoods using 200×600×3000 lattice nodes and 24 GPUs Tesla P100, and the simulation has completed within 24 hours. The impact force of the driftwoods acting on the wall is about 15 times larger than only water. It shows that effects of driftwoods are important to evaluate the tsunami damage on building structures.