Specific Biases

Understanding Particular Data Quality Concerns in EM-DAT

Time Bias

Time biases result from unequal reporting quality and coverage over time1. The figure below shows the occurrence of disasters in EM-DAT. The figure shows a significant increase that starts in the 1960s. This increase coincides with the creation of OFDA. In 1973, OFDA started compiling disaster data, and CRED was created2. In 1988, CRED took over the disaster database and created EM-DAT. In the meantime, communication technologies have improved, with the first personal computers and satellites appearing in the 1970s and the advent of the World Wide Web in the 1990s (see also History of EM-DAT).

image/svg+xml Matplotlib v3.8.3, https://matplotlib.org/

Technologies and initiatives can be considered responsible for the dominant trend observed. Therefore, it is challenging to draw conclusions about the actual drivers of disasters such as climate change, population growth, or disaster risk management3. Accordingly, excluding pre-2000 data from trend analyses based on EM-DAT is strongly recommended. From September 2023 onward, CRED refers to pre-2000 data as Historic data in the EM-DAT Public Table.

Hazard-related biases result from unequal reporting quality and coverage for different hazard types1. For example, in EM-DAT, data related to biological hazards (e.g., epidemics) and extreme temperature hazards (e.g., heat waves) are less covered, and their coverage is of lower quality. Some hazard-related biases are illustrated in the Accounting Biases and Geographic Biases sections.

Threshold Biases

Threshold biases result from unequal reporting quality and coverage for disasters of different magnitudes1. High-impact disasters attract more attention, resulting in better media coverage and reporting. This could lead to threshold biases in EM-DAT. The EM-DAT entry criteria introduce a kind of threshold bias, as shown in the figure below regarding disaster mortality, while some studies have shown locally that small disasters may have a high cumulative impact, e.g.4. Regarding disasters that fit EM-DAT’s entry criteria, it is fair to assume that disasters close to the entry criteria are more likely to be missing than high-impact disasters. However, as shown in the figure below, the cumulative mortality associated with low-mortality events exceeds the cumulative impact of higher-mortality events.

image/svg+xml Matplotlib v3.8.3, https://matplotlib.org/

Accounting Biases

Accounting biases result from unequal reporting quality and coverage for different impact variables1. For instance, in EM-DAT, the economic losses are, on average, less frequently reported than the human impact variables, which may also depend on the hazard type (see the figure below). Furthermore, insured damages are naturally more reported than uninsured damages, which creates a geographic bias where there is a lack of insurance coverage, as in Africa. For droughts, EM-DAT fails to capture the associated mortality because it is overlooked as an indirect impact, as evidenced by the UNDRR 2021 Global Assessment Report on Droughts.

image/svg+xml Matplotlib v3.8.3, https://matplotlib.org/

Besides, it cannot be assumed that because an impact is reported in EM-DAT, there is no accounting bias. In general, direct impacts are often reported by EM-DAT sources, while indirect impact estimates are less available. For instance, direct deaths for a flood event correspond to the number of fatalities occurring during the event, while indirect deaths result from disease outbreaks due to deteriorated sanitary conditions. Yet, indirect mortality is sometimes higher than direct mortality, for example5.

Geographic Biases

Geographic biases result from unequal reporting quality and coverage across space1. In general, EM-DAT has a relatively worse coverage for sub-Saharan Africa regarding the occurrence and the accounting of impact variables6. Any disaster type may be subject to geographic biases in EM-DAT as there may be discrepancies between reporting systems from one country to another (see General Issues).

This issue is particularly pronounced regarding heat waves7, as shown in the figure below. Heat waves are often overlooked in sub-Saharan Africa8. About a third (32%) of the 275 heatwave events recorded in EM-DAT between 2000 and 2024 occurred in seven countries: Japan, India, Pakistan, the USA, and Western European countries (Belgium, France, and the United Kingdom).

image/svg+xml Matplotlib v3.8.3, https://matplotlib.org/

References


  1. Gall, M., Borden, K. A., & Cutter, S. L. (2009). When do losses count? Six fallacies of natural hazards loss data. Bulletin of the American Meteorological Society, 90(6), 799–810. https://doi.org/10.1175/2008BAMS2721.1 ↩︎ ↩︎ ↩︎ ↩︎ ↩︎

  2. Centre for Research on the Epidemiology of Disasters. (2023, July). Happy birthday, CRED: Celebrating 50 years of disaster epidemiological research, data collection, and international cooperation (CRED Crunch No. 71). https://www.cred.be/sites/default/files/CredCrunch71.pdf ↩︎

  3. Ritchie, H., & Rosado, P. (2024). Is the number of natural disasters increasing? Our World in Data. https://ourworldindata.org/disaster-database-limitations ↩︎

  4. Marulanda, M. C., Cardona, O. D., & Barbat, A. H. (2010). Revealing the socioeconomic impact of small disasters in Colombia using the DesInventar database. Disasters, 34(2), 552–570. https://doi.org/10.1111/j.1467-7717.2009.01143.x ↩︎

  5. Alderman, K., Turner, L. R., & Tong, S. (2012). Floods and human health: A systematic review. Environment International, 47, 37–47. https://doi.org/10.1016/j.envint.2012.06.003 ↩︎

  6. Osuteye, E., Johnson, C., & Brown, D. (2017). The data gap: An analysis of data availability on disaster losses in sub-Saharan African cities. International Journal of Disaster Risk Reduction, 26, 24–33. https://doi.org/10.1016/j.ijdrr.2017.09.026 ↩︎

  7. Brimicombe, C., Di Napoli, C., Cornforth, R., Pappenberger, F., Petty, C., & Cloke, H. L. (2021). Borderless heat hazards with bordered impacts. Earth’s Future, 9(9), Article e2021EF002064. https://doi.org/10.1029/2021EF002064 ↩︎

  8. Harrington, L. J., & Otto, F. E. L. (2020). Reconciling theory with the reality of African heatwaves. Nature Climate Change, 10(9), 796–798. https://doi.org/10.1038/s41558-020-0851-8 ↩︎