The Metal-Insulator-Metal (MIM) structure which composed of metal nanostructures, an insulator layer, and a metal layer, has been attracting attention in recent years as a plasmonic coloring material capable of producing a wide range of colors in the visible light region. While the shapes and sizes of metal nanostructures had been much reported, there are less report about the variety of insulator materials. In this study, we tried to fabricate a dielectric layer by the LBL method in order to add new functions to the colorant and control the refractive index of the insulator layer. As the first material, we introduce Fe3O4 nanoparticles into the insulator layer of Au-polymer-Pt structures and examined the structural and color characteristics.