The coronavirus disease 2019 (COVID-19) pandemic has become a worldwide emergency. In the attempt to search for interventions that would improve outcomes, some researchers have looked at the potential benefit of BCG vaccination. These early studies have found a statistically significant reduction in COVID-19 related mortality in countries with a current universal bacille Calmette-Guerin (BCG) vaccination policy; partially explained by induced heterologous immunity. However, just as the authors themselves noted, the nature of ecological studies make them very prone to the presence of several confounders. This paper tries to answer the question as to whether a statistically significant difference in mortality rates exists between countries with differing BCG vaccination policies; while being the first to try to account for most of these confounders. We compared the number of COVID-19 related deaths per 1 million inhabitants as well as the number of deaths at the time the countries hit the 1000th COVID-19 case. Countries were divided in those which never had a BCG vaccination policy, those with a prior vaccination policy and those with a current vaccination policy. All data was gathered from publicly available sources. It was found that no statistically significant difference exists in mortality rates between countries with differing BCG vaccination policies. This result seems to reflect the notion that heterologous immunity fades with time after administration. Nevertheless, the immunostimulatory potential of the BCG vaccine might still prove useful in the development of future vaccines or other prophylactic measures.