No, not quite. Refineries close due to corporate decisions on economics, efficiency, and market shifts—not PMs flipping switches.
The image's table is approximate: Mulroney's term (1984-93) saw ~7 closures amid 1980s consolidation (e.g., Gulf Montreal 1986, several Petro-Canada/Shell in 1991-93). Harper's (2006-15): 3 major ones (Shell Montréal 2010, Parkland Bowden 2012, Imperial Dartmouth 2013). Oakville was 2005 (pre-Harper, Liberal era).
Of the ~14 most recent closures (2005-2013 window), it's closer to half during Conservative terms—but many earlier ones (1980s) hit under Liberals too. Overall, Canada went from ~40 refineries in the 1970s to 19 today via consolidation; total capacity rose.