As a porous carbon material, oil sludge pyrolysis residue (OSPR) is widely used in the removal of pollutants in water. Due to the blockage of pore structure and low specific area, its adsorption effect is restricted. In this paper, acid etching strategy is adopted to solve the problem of pore blockage, and Fe (II) -ZIF is loaded to improve the specific surface area and adsorption location of material. It can achieve the purpose of efficiently removing phosphate from water and realize the high value utilization of OSPR. Herein, Fe (II) -ZIF/ae-OSPR with Fe (II) metal center and rich vacancy structure was successfully synthesized by using Fe (II) -ZIF as the metal organic skeleton and ae-OSPR as the carrier carbon skeleton for phosphate removal from water. The prepared Fe (II) -ZIF/ae-OSPR has a high adsorption capacity for phosphate, with a maximum adsorption capacity of 198.3 mg g−1, and still maintained a high adsorption capacity for phosphate in the pH range of 1–6. The adsorption kinetics showed that the main mechanism of phosphate adsorption was chemical adsorption (R2Second = 0.9617 > R2First = 0.9357), and the thermodynamic model showed that the adsorption process was endothermic reaction. The adsorption capacity of Fe (II) -ZIF/ae-OSPR for phosphate was not affected by the coexisting anions (Cl−, CO32−, NO3− and SO42−), and the adsorption capacity was still maintained at 190.8 mg g−1 after 6 cycles of regeneration. The adsorption mechanism showed that the removal of phosphate by Fe (II) -ZIF/ae-OSPR was the result of the charge-force effect of amine group and Fe (II) on phosphate group. The adsorption efficiency of Fe (II) -ZIF/ae-OSPR for phosphate in practical wastewater shows that Fe (II) -ZIF/ae-OSPR has a good engineering application prospect.