There were multiple extermination camps, multiple work camps (dearh by multiplemeans), the extermination squads, the ghettos (death by poverty), and the war itself resulting in combat deaths. Most did not go to the ovens of Auschwitz.
Plus, concentration camps were 1933-1945.