In this Letter, the mechanism of double forming process phenomenon revealing in ZrO2/HfO2 bilayer resistive random access memory structure is investigated. This phenomenon caused by the formation of TiON interfacial layer can be well explained by using the energy band diagram. The TiON interfacial layer will be a tunneling barrier during the first forming process when a negative voltage applied on the device, while it will breakdown when applying a positive voltage. Besides, due to the double forming process, an asymmetric conductive filament with narrower size at ZrO2/HfO2 interface is formed in the device. The point for formation and rupture of the conductive filament can be confined at the ZrO2/HfO2 interface, and it will suppress the consumption of oxygen ions during endurance test. Therefore, high speed (40 ns) and large endurance (107 cycles) characteristics are achieved in this device structure.