The effect of heterogeneity induced by highly permeable fracture networks on viscous miscible fingering in porous media is examined using high-resolution numerical simulations. We consider the planar injection of a less viscous fluid into a two-dimensional fractured porous medium that is saturated with a more viscous fluid. This problem contains two sets of fundamentally different preferential flow regimes; the first is caused by the viscous fingering, and the second is due to the permeability contrasts between the fractures and the rock matrix. We study the transition from the regime where the flow is dominated by the viscous instabilities, to the regime where the heterogeneity induced by the fractures define the flow paths. Our findings reveal that even minor permeability differences between the rock matrix and fractures significantly influence the behavior of viscous fingering. The interplay between the viscosity contrast and permeability contrast leads to the preferential channeling of the less viscous fluid through the fractures. Consequently, this channeling process stabilizes the displacement front within the rock matrix, ultimately suppressing the occurrence of viscous fingering, particularly for higher permeability contrasts. We explore three fracture geometries: two structured and one random configuration and identify a complex interaction between these geometries and the development of unstable flow. While we find that the most important factor determining the effect of the fracture network is the ratio of fluid volume flowing through the fractures and the rock matrix, the exact point for the cross-over regime is dependent on the geometry of the fracture network.