An Experiment in Assessing End of Year Predictions: How Did they Fare? (2)

Here are the results of our experiment on the evaluation of a sample of 2012 end of year predictions, following up on the post explaining the methodology used (spreadsheet and an interactive version of the charts can be found here).

Let us start with the bad news. As a whole, the percentage of success is relatively low, 27%, i.e. 44 predictions were correct out of the 165 made. However, this global figure hides very different results.

In terms of method, as shown below, classical analysis (that may cover the use of other methods or not) obtains the whole range of results, from complete inaccuracy to excellent. The validity of the judgement on the future depends upon the knowledge, understanding and genius of the analyst.

predictions, 2012, success rate, evaluationRisk analysis fares better than overall sample, but is still below 50%. This might be related to the absence of differentiation between likelihood and impact as explained in the previous post.

Our sole example of scenario is relatively unsuccessful. However, this is also linked to the very specific form and place scenarios have in terms of foresight: fictionalized narratives mainly aim at making one plausible version of the future real for the target audience. They intend to break cognitive biases and other lenses. They must be built upon a coherent model, which can be seen as the principle, the essence, but the unfolding discrete events themselves are only one example of what might happen. In Kant’s understanding, a scenario is a phenomenon, built upon noumena.

Unsurprisingly, analysis that includes, more or less, a part of recommendation and advocacy, what we could see as normative predictions, do not fare very well.

This brief evaluation, however, tells only one part of the story. As explained in the methodological post, we can draw much more interesting conclusions out of an assessment that is less drastic and marks each prediction first according to the plausibility of the content and second to the accuracy of the timing, despite the inherent subjectivity of the approach.

Issues and countries: a conventional view of national security

The first very interesting result this experiment gives us is about the topic of the predictions itself, what was deemed as relevant and interesting enough to be the object of anticipation.

The overwhelming majority of predictions were made according to countries, be they focused on economics, political economy, geopolitics or politics. The map below shows the intensity of the number of predictions made, the brightest the colour, the more numerous the prediction. Some countries were off the radar, when, for example, coups in Mali and Guinea-Bissau happened, as correctly predicted by Jay Ulfelder, whose forecasts were not included in the experiment. This underlines the danger to leave some countries out when making judgements on the future, because one will automatically tend to focus on those countries where events or problems occurred in the recent past, or on those that were of interest for one reason or another. The limited character of resources however most of the time forces such initial selection, which thus must be made with great care and kept in mind.

nbre per countries scaled1Very few assessments concerned other global problems, when they belong to what is called unconventional national security. Among those identified in our sample, we find: oil, water, gold, the virtual and digital world (although hardly with a cyber-security dimension), augmented reality, and the environment (but only in terms of regime and debates, not in terms of actual natural events and their impacts). Many issues such as most transformational technologies, from nano to biosecurity, health concerns, cyber threats, extreme weather events or resources competition beyond oil were thus left out. One possible explanations is that we are still operating within specializations inherited from the last three centuries, and that for each new issue appearing on the agenda of national security, a new sector of expertise is created, with serious potential adverse consequences on our identification of threats. We may very well become perfect in terms of predictions on old topics, this will always remain insufficient if interactions and feedbacks with new threats are ignored. For example, International Relations – or geopolitical – analysis must fully include the cyber dimension, and cyber-security in terms of national security cannot be fully understood without the international, geopolitical and political dimensions.

Systematically including horizon scanning for emergence of novel dangers and pluri-disciplinary/multi-expertise work would be needed. Another possible explanation is that those unconventional security issues were left out because they were estimated as beyond the 2012 time horizon. We may only wish this latter hypothesis to be correct.

Inaccurate timing and relatively plausible content

If we now look at the countries, object of predictions, and colour them first according to the plausibility of content of the predictions, and second according to the accuracy of the timing, we have the two following maps. The averaged accuracy of the results goes from deep red (inaccuracy) to deep green (accuracy).

2012, prediction, evaluation 2012, prediction, evaluation

The maps confirm the hunch I wished to test: our capacity to predict timing is less good than our ability to understand content and thus foresee coming evolutions. We know quite well what will most probably happen, but we do not know precisely when.

Interestingly, China, Russia and the U.S. fare relatively badly for both content and timing. This could be explained by strong cognitive and ideological biases existing for those three countries, including, for the U.S., which also ranks first for the number of predictions, those biases related to partisan politics… and analysis. Regarding our initial conclusions on methodology, and considering the lack of explanations given by authors, this shows that we should, ideally, and as underlined by forecaster, futurist and strategist Scott Smith in his Year-end lists are hazardous to your health, identify precisely who the author is, his/her target audience, and in which context the predictions were made. The category mixing classical and normative analysis would most probably swell as a result.

Timing for Brazil is completely wrong, and this would be even worse if the prediction made for the BRICS (0 on all counts) had been added, while the results would have been less good for all the other BRICS. Again, we are seeing an ideological bias at work, a “pro-BRICS” bias, which is also the reflect of a global power struggle we can see enacted in any international fora.

These results point towards the absolute necessity to struggle against all biases when making judgements on the future, if proper decisions are to result from this foresight (which is of most probably not the case with our sample, but we have to consider that many decision-makers also read open source predictions and may be influenced by them, knowingly or not).

Novelty and pace

Finally, let us observe the evaluation for all predictions, without aggregation and average (click here to open the chart in full in another window).

results 2012 predictions scaled 1

Besides the points we already made, what is most striking is the way various water issues were erroneously foreseen. If, true enough, only one author is concerned – and he had the merit to select this issue when the corresponding U.S. ICA was not yet published - we can always learn from all mistakes. This erroneous judgements on water security may underline the difficulty of properly estimating issues when those are relatively newly integrated in assessments. First, there is an insufficient accumulated knowledge and understanding. Second, the eagerness to promote a topic that may still be debated and belittled may lead to overstatement.

The wrong timing on various European countries stems most probably from our very imperfect knowledge of internal political dynamics, as those last decades mainstream political science has tended to focus on elite politics and public policy – one of the major cause of the warning failure regarding the “Arab Spring” – even more so in the case of the so-called rich countries. Furthermore, time is very rarely an object of research. Finally, we tend collectively to forget that the political time is long – even very long – and that much of our (recent) habits, approaches and institutions do not accommodate for it… but this will not change the reality of political dynamics.

————-

Nota: The surprising, at first glance, cases when timing gets a better mark than content correspond to predictions that were accurate (or almost accurate) in terms of timing, accompanied by explanation of dynamics that were partly or fully wrong, illogical, or inaccurate.

An Experiment in Assessing End of Year Predictions (1)

experiment, assessing, evaluating, foresight, forecast, prediction Evaluating predictions, or more broadly the end-products resulting from methodologies used to anticipate possible futures, should become the norm rather than the exception, as explained in a previous post. Such exercise should improve methods and processes and direct our efforts towards further research. We shall here make the experiment to assess a sample of open source predictions for the year 2012. This part will address the methodological problems encountered while creating the evaluation itself, and underline the related lessons learned. The second part (forthcoming) will discuss results.

Actually, there is nothing new here as estimating results for “predictions” is one of the fundamental principles of science (a scientific theory must have explanatory, descriptive and predictive power). If a theory does not fulfill the predictive criteria, then it must be disqualified. Things are relatively straightforward when dealing with hard science. They are much more complex when we are in he field of social science, and the very possibility to obtain predictive power is hotly discussed, debated and often discarded. If we consider the family of disciplines, sub-disciplines and methodologies – what we call here strategic foresight and warning (foresight for short) – that deal with future(s)-related analysis, then we are faced with even more challenges. Some methodologies will be considered as scientific, and among them, some are close to hard science, while others belong to the realm of social science. Other approaches will be seen as art and thus are considered as not having to be tested. Furthermore, everyone has her/his own vision of what constitutes good future(s) related analysis, what should be done and used, what is valuable and what is not.

Despite these difficulties, it is still worth our while evaluating those future(s) related efforts, which had the courage to make an evaluation for the future located on a timeline. This is, of course, a very small exercise and experiment, compared with what is done by The Good Judgement project, led by Philip Tetlock, Barbara Mellers, and Don Moore with funding by the Intelligence Advanced Research Projects Activity (IARPA) and explained in this article by Dan Gardner and Philip Tetlock, “Overcoming our aversion to acknowledging our ignorance.” Nevertheless, hopefully, it will also bring interesting results, and the reflection it imposes, the questions it brings are in themselves a very constructive practice.

For this experiment, the sample used is constituted of open source predictions for the year 2012 posted on the web from December 2011 to January 2012, as presented here.

The result of the evaluation, in a Google spreadsheet, can be downloaded here or viewed below. Explanations and discussion follow.

The sources used to evaluate the foresight are given in the seventh column (except when the answer is obvious or common knowledge, and thus does not necessitate reference to a specific source e.g. the European Union still exists).

The variety of format and methodologies, furthermore more or less explained, was a first challenge. How to evaluate consistently “predictions” delivered in ways as varied as classical analysis (e.g. The Financial Times – Beyond BRICS), scenarios (e.g. Tick by Tick Team), risks (e.g. CFR – Preventive Priorities Survey: 2012) or predictions mixed with policy recommendations and advocacy, what could be seen as a version of normative foresight (e.g. Foreign Policy with the International Crisis Group – 10 conficts to watch in 2012)?

The Council on Foreign Relations, risk and making likelihood explicit

The Council on Foreign Relations’ approach is a perfect example of this hurdle. Its risk list for 2012 was particularly difficult to evaluate considering the way it is formulated and the lack of information regarding the methodology (those challenges have been removed or to the least improved with the 2013 version, where we find more detailed explanations and where likelihood and impact are separated). To find out what the CFR exactly meant I had to turn to a companion article to the risk list published in the Atlantic, “Gauging Top Global Threats in 2012“. There we read:

“The contingencies that were introduced for the first time or elevated in terms of their relative importance and likelihood in 2012 included an intensification of the eurozone crisis, acute political instability in Saudi Arabia that threatens global oil supplies, and heightened unrest in Bahrain that spurs further military action.”

A contingency means “an event (as an emergency) that may but is not certain to occur”.

Thus we can deduce that the CFR saw all the events (their “risks”) listed as possible for the year 2012 – if not probable. This is on this basis that the evaluation was made. Hence, all the CFR “risk-statements” were mentally expanded as follows: “a mass casualty attack on the U.S. homeland or on a treaty ally” means, for evaluation, “a mass casualty attack on the U.S. homeland or on a treaty ally” in 2012 is possible and would have a major impact for US National Interest (according to the tier to which the risk belongs) or “a major military incident with China involving U.S. or allied forces” means ”a major military incident with China involving U.S. or allied forces” is possible in 2012 and would have a major impact etc.

Making the “risk-statements” more explicit for evaluation (however not transforming the statement itself) immediately underlines how the fusion of likelihood and impact existing most commonly in the idea of risk (until the concept itself was revised by the new ISO31000: 2009 norm) creates supplementary difficulties in terms of evaluation, hence my personal reluctance to use the concept, despite its fashionable character. What are we to judge: a likelihood? an estimation of impact? a timing? As already mentioned, the CFR Preventive Priorities Survey tackled indeed this problem and now (2013) gives detailed results in terms of impact and likelihood.

This underlines how crucial it would be, ideally, to always include, for all results of future(s)-analysis an estimation of likelihood, as done, for example, in the Intelligence Assessments (see p.14 of the ICA on Global Water Security).

In our sample, each prediction, or series thereof, corresponds to one or another methodology. Yet, rather than trying to standardize thoughts, for example transforming what the authors wanted to write in a sentence easy to evaluate, I chose to keep the text as it was, breaking it down in various paragraphs most of the time, sometimes expanding it mentally as explained above for the CFR, and in agreement with their methodology, but not altering it, and to evaluate it as such. The exercise was constructive in itself and led to interesting points. We shall see with the next post if the results will also say something about the foresight methodology itself.

When the text was far too removed from something that looked like a judgement on the future, for example when it was only an opinion on what was happening, or when it was a 50/50 possibility, I excluded the sentence or paragraph from the sample (in red in the spreadsheet).

Scenarios, timing and content

As I started the concrete phase of evaluating statements with the fictionalized scenario made by Tick by Tick Team (Finance), it very quickly became clear that I had to make two types of assessment: one regarding the plausibility and logic of the content of the prediction itself, the other the accuracy of the timing. Indeed, some of the predictions made still sounded plausible, had not happened in 2012 but could not be ruled out for the short to medium term, e.g. “Greece leaves the Euro, returns to the Drachma.” (3002 – this number corresponds to the identification given in the database, to facilitate reference). To me there is a large difference with a prediction that is plainly wrong in terms of content and thus impossible in terms of timing: e.g. Syria deals with the “initial post-Assad stages” (2011) or “Obama decides not to run for elections” (3011).

Furthermore, this approach will allow me to test a hunch according to which we are in general much better to explain phenomena than to time them, would it be only because we hardly ever work on timing (outside the hard science realm).

Evaluating content and timing: a difficult, uncertain, never-ending task?

Thus, columns 4 and 5 display marks for content and timing, ranging from 0 (completely wrong) to 1 (completely accurate). There is, however, a major hurdle with this approach. First, by judging the content in terms of plausibility of dynamics, I evaluate one understanding (the author’s) against another (mine). There is little we can do about it as this is the core of research and debates in social science, besides giving evidence (column 7, the sources), developing a coherent argument and/or pointing out flaws in the argument subjected to the evaluation. A commissioned report would need to be more detailed and specified than I could be in the framework of a volunteered experiment.

foresight, prediction, evaluationSecond, it implies that by evaluating the plausibility of something happening in the future, then I am myself making a judgement on the future, thus a prediction. Ultimately, those challenges should be resolved through the happenstance of events and facts, which suggests that evaluations should themselves be reviewed and followed in time. This is certainly not ideal, but still better than to lose the information on timing and content, which would happen if one chose with black and white, true or false, 0 and 1 answers.

Objectivity (as much as biases allow) of the person assessing the predictions is crucial, and the use of teams that would discuss and confront their analyses would be best. Furthermore, the latter would also allow overcoming plain lack of knowledge on one issue or another.

This leads us to a last challenge that is not easily overcome for some predictions: the information that is available to the person doing the evaluation. Still using the CFR example, and more particularly the risk of ”a mass casualty attack on the U.S. homeland or on a treaty ally”, some actions taken throughout the year by authorities may have prevented a risk to materialize, thus the prediction could be seen as false. Certainly, had no intelligence, defense and diplomatic actions existed, then such risk would have materialised. Such state’s actions are ongoing, and, as an outsider, we can only estimate (without complete certainty) that it is because of them that the threat did not materialize, not because the risk was incorrectly identified. An evaluation made by an insider with access to all classified documents would be made with more confidence. Here, I could only estimate the reality of the risk to the best of my understanding and knowledge, for example with the use of counterfactuals.

Should all those challenges, the existence of uncertainty even in evaluation, lead us to conclude that trying to evaluate foresight products is useless? My first answer, at this stage, is no because all the questions one asks or should ask oneself and that are forced by the evaluation are crucial and may only lead to better methodologies and thus to better judgements on the future. It is thus a gage of quality. We shall see next what the results of the assessment, keeping in mind all their imperfections, may tell us.

—–

“Gauging Top Global Threats in 2012″ - Interviewee: Micah Zenko, Fellow for Conflict Prevention, 
Interviewer: Robert McMahon, Editor, 
December 8, 2011, The Atlantic.

A Beautiful Timeline Visualisation: TimelineJS by VéritéCo

Last week, as I was looking for good websites and twitter users to follow the students’ movement in Quebec, its support by and links to the other worldwide opposition movements, and to try to assess how it could evolve, I found this really useful, informative and beautiful website displaying a timeline of the events done by Xavier K. Richard, @xkr.

Today, I found that this timeline, or rather the incredible tool to make such a timeline, TimelineJS, created by VéritéCo, is a free web-based application. I could not resist the temptation to try it, continuing on the series of timelines created for “the Tragic Events that strike Everstate.” It is truly very easy to use (just use the Google spreadsheet template provided on the website, and enter your data instead of those given as example), then follow the directions given on the TimelineJS website and, finally, embed it on your website. You can include videos and photographs, and, compared with the two others that were previously tried, you can create as many timelines as you want, which is a great advantage.

Here is the result:

2018 – 2023 EVT – From Grievances to Political Mobilisation (Mamominarch)

Last weeks’ summary: In 2012 EVT, Everstate (the ideal-type corresponding to our very real countries created to foresee the future of governance and of the modern nation-state) knows a rising dissatisfaction of its population. To face the various difficulties and widespread discontent, in a first scenario, Everstate’s governing bodies implement the Mamominarch programme of drastic reduction of state spending over five years through devolution, privatisation and outsourcing. By 2018 EVT, the result is involution, with a fragilised governance including and implying the rise of lawlessness domestically, an abandoned mastery over international security, an inefficient economy and, as consequence, a rising insecurity for most Everstatans. The first set of tragic events - a tornadoes outbreak followed by a heat wave – that hits the West of Everstate soon becomes a complex catastrophe with dramatic direct and indirect impacts.

(The reader can click on each picture to see a larger version in a new tab – a navigating map of posts is available to ease reading).

Faced with destruction and a difficult and very slow reconstruction, Westerners are definitely dissatisfied with the way their political authorities, entrusted with the mission to ensure their security, have dealt with the complex catastrophe that befell them. Many are forced to leave as their survival is threatened and start moving towards other areas. However, they nevertheless expect recognition of their hardship, help and solidarity when they arrive somewhere else.

Yet, nothing is organised nationally. The way they are greeted varies greatly according to areas and even towns. In some cities, local authorities engineer emergency support for newcomers in the name of national solidarity, while everything is done to help them find temporary shelter and work. In others, only family network, when they exist, are active, and the refugees are not only ignored, but also rejected as they are seen as swelling the mass of the poor, homeless and unemployed, as potential criminals, as people lowering wages when they end up taking any job to survive. In those areas, as the refugees remind inhabitants of a selfishness they do not want to confront and of problems they want to deny, rejection hardens quickly.

All Everstatans, finally, feel unjustly treated, one way or another, which only feeds grievances. Those multiply as central political authorities do not acknowledge problems, give no recognition, and do nothing in a timely way. The victims are not supported in those areas where they are best welcomed and those who help them are left to their own device and funding, while the central administrative machine and policies continue as if nothing had happened, sometimes thus enhancing difficulties. Elsewhere fear is not assuaged, its roots are not dealt with. Notably, no one wants to face the fact that the refugees have become a disturbing symbol of a dysfunctional and outdated model of socio-political organisation, when so much hope had been invested in the Mamominarch system.

Over the summer, oil prices surge, with some spikes even reaching 200$ a barrel, as a result of renewed international tensions in the Middle East. This trend intensifies the overall situation in Everstate, as for most Everstatans, save the richest and best connected, life becomes increasingly difficult. Indeed, whatever the efforts the people have previously made, the result of their actions to improve or to the least stabilise their life is reduced to naught by the severe disturbance implied by the energy price. As, furthermore, the food produced in Everstate has become suspect – and sometimes rightly so – because of the industrial disasters, many Everstatans feel that they are left with only two bad choices: either starve because they cannot afford imported food, or kill themselves with polluted food.

The legitimacy of the Mamominarch system is now overtly questioned, and all remember that the governing bodies that decided to convene the Mamominarch commission were already facing similar problems, which only contributes to further de-legitimize the system.

The rising tension spreads throughout the whole country. If all have grievances, those accumulated complaints tend to coalesce and join along different fault lines according to areas and groups, because there is not anymore one national situation but many, notably as a result of the devolution  (spatial variations) and of the privatizations (end of the concept and practice of public good). With time, events and a large variety of responses, the conditions have grown to be very diverse.

External observers are surprised when, building on the tension existing in 2012 EVT, then on those that simmered over the past five years of Mamominarch system, and triggered by the recent events, a Movement for the Independence of the Trueland, a region covering the South-East of Everstate (notably the mouth of the river and the seaside), is created and rapidly takes off. The usual inflow of money that used to bring wealth, and, during the last years, release, to the country with tourism is abruptly halted by the complex catastrophe, as tourists fear coming to Everstate. The inhabitants of the seaside area being relatively richer were thought as much calmer and less likely to mobilise politically. But this is without considering the sudden relative deprivation they feel, which is, furthermore, from their point of view, none of their making.  Other small areas, sometimes only cities, follow suit and also start voicing their desire for local independence and direct membership to the Regional Union.

Yet, not all citizens of those areas share the same views, and those who are dissatisfied with the two main political parties, spearheaded by Occupy Everstate, respond by creating a Movement for the Renewal of Everstate, which is soon joined by large parts of the Westerners, by the refugees and many in those towns that put solidarity first. The CEO of Evernet, as reported by international media, decides to join the movement she sees as prefiguring the future. She offers the technical support of Evernet, providing even funding and sometimes directly hardware to the Renewers, as they are soon called, when those cannot afford anymore access to social networks considering the degraded overall situation.

Meanwhile, Novstate and its friends companies make sure they remain officially neutral, offering their services to all, while they continue promoting the system that made their fortune.

Many of those joining the new Movements did not belong, previously, to any political party. They had even often abstained during previous elections. Yet, the two main parties, the conservative and the social-democrat, with still their headquarters in the capital, start losing sympathisers. The classical elite groups remain faithful to the two traditional parties, which have created the Mamominarch system, and start worrying about the evolution of the situation. First, the Western quagmire has marred the international ideological standing of the Mamominarch system, which seriously limits the opportunities offered to the elite.

Then, those new Movements imply a loss of power for the two parties that constitute the usual political framework of the elite, indeed the way its members think and live. The elite groups initially try to dismiss the new Movements because they do not enter the familiar right/left, conservative/social-democrat way to think and thus, certainly, do not correspond to anything serious… yet the political mobilisation is there, as well as the grievances and the tension and altogether they completely deny everything the elite has ever believed in and stood for. The new Movements have not even tried to include them.

The Renewers then pick up on a report according to which a terrorist group has infiltrated a Novcybio laboratory in its home country a few weeks ago, stolen some deadly pathogens and manipulated others, mixing them with some of the genes experimented. Considering the existence of Novcybio Everstate, the news goes viral through social networks, among Renewers initially.

To be continued

2018 – 2023 EVT – Complex Catastrophes (Mamominarch)

Last weeks’ summary: In 2012 EVT, Everstate (the ideal-type corresponding to our very real countries created to foresee the future of governance and of the modern nation-state) knows a rising dissatisfaction of its population. To face the various difficulties and widespread discontent, in a first scenario, Everstate’s governing bodies implement as policies the conclusions of the Mamominarch Commissiona programme of drastic reduction of state spending over five years through devolution, privatisation and outsourcing. By 2018 EVT,  the result is involution, with a fragilised governance including and implying the rise of lawlessness domestically, an abandoned mastery over international security, an inefficient economy and, as consequence, a rising insecurity for most Everstatans. A series of tragic events then strike Everstate.

(The reader can click on each picture to see a larger version in a new tab – a navigating map of posts is available to ease reading).

The tornadoes outbreak that hits the Western part of Everstate in May, as well as the other tragic events of the year, results of global pressures accumulated over the years, including in terms of ecological setting.*

Two of those tornadoes  are deadly. They are rated EF5 on the Enhanced Fujita Scale and have a very long track reaching almost 70km.

Hundreds of power transmission towers are taken down, and, as a result, electricity outage occurs in a large part of Everstate’s West.** The scope of civilian disaster is huge. So much of the population is hit. To the fatalities, casualties and people unaccounted for, must be added people finding themselves overnight without shelter. Furthermore, as all communications are severed, evaluation and first emergency is terribly difficult. The tornadoes also hit two industrial sites in this recently industrialised part of Everstate. A corner of the dam of a reservoir containing liquid waste collapses, releasing toxic muds. First, the wave of mud reaches a nearby small town, miraculously spared by the tornadoes and then spills inexorably to reach the Everstatan main river.***

Not far from there, one of the storages of an agrochemical company is ground to pieces. Highly toxic levels of pesticides are released in the air.****

Panic presides to the outbreak and to the first days. Then comes the extreme difficulty of dealing with “complex catastrophes.” In the words of Paul N. Stockton, the assistant Secretary of Defense for Homeland Defense and Americas’ Security Affairs,

“Complex catastrophes differ from normal disasters in two ways. First, the scale of destruction is vastly greater… Second,… complex catastrophes may create cascading, region-wide failures of critical infrastructure, starting with the disruption of the commercial electric power grid….This loss of power could create cascading effects on communications and other critical infrastructure. From a public safety perspective, the most immediate concern might be the impact on municipal water systems, ..  Transportation infrastructure could be degraded as well; gas and diesel fuel pumps, for example, depend on electric power to function. While many hospitals and other facilities critical to disaster response efforts have backup diesel-powered generators, we anticipate few will have sufficient fuel on hand to offset power outage lasting weeks to months, and that companies responsible for resupplying them could face a radical mismatch between supply and demand.” in Stockton, ”Ten Years After 9/11: Challenges for the Decade to Come,” Homeland Security Affairs, Volume 7, The 9/11 Essays (September 2011).*****


Locally, as the Western areas have never known any natural catastrophe, are not located in a seismic zone, and are not considered as sensitive defense-wise, no preparedness for any natural or even man-made emergency exists.

Novstate, which is contracted for the management of crisis and emergency response nationally, should have had at least the beginning of an emergency plan ready, and should start implementing it. However, it is without counting with a few crucial factors. First, the electricity outage considerably slows and delays all communications, evaluations, transport and logistics, while rapidly increasing hazards to the population as hospitals, notably, will soon run out of fuel for their backup diesel-powered generators. Second, Novstate has not planned for any type of such multi-risk emergencies spreading on large areas, both urban and rural. It has mainly focused on terrorist attacks in the major Everstatan cities. Finally, the involvement of many different companies responsible for so many types of infrastructures, including hospitals, and in charge of various outsourced services creates a highly complex picture of independent intervening actors that have to be identified, organised, and put to work on an emergency, solidarity and not for-profit basis. Furthermore, Novstate’s mandate includes no specific authority to act in such a way. Meanwhile, the political authorities who do have this legitimacy have now to do with a reduced Everstatan central administrative staff, soon overwhelmed by a catastrophe of a type and scale never envisioned.

Finally, after 4 days, prompted by international calls from his counterparts and from the Regional Union, Everstate’s Prime Minister finally asks for international help. Meanwhile, thousands of Everstatans lost their lives; the Everstatan main river has become severely polluted, toxic mud spreading towards the agricultural South and the touristic mouth of the river. The toxic dust has spread with the very strong winds and the full extent of damages will only be discovered with time, but have created health hazards for human beings, biodiversity and most probably impacted soil and water.

Again, the initial absence of overall coordination runs contrary to the efficiency of the assistance, and the Regional Union, incorporating in the lead team Everstatan regional civil servants to respect Everstate’s sovereignty and the Novstate executive responsible for emergencies, has to firmly take over.

Thanks to international help, the crisis is finally contained, but it takes a few months before such services as electricity, which were previously taken for granted, are fully reestablished. Worse damages such as epidemics are avoided. Yet, the terrible environmental impacts are there.  Furthermore, the drought that follows dries up the river helping spread the toxic mud changed in dust over even larger areas of the country.

The Everstatan quagmire has highlighted the high difficulty of complex catastrophes’  management and intervention, notably in a context of privatised infrastructures and outsourcing. It is reviewed and criticised internationally by multiple instances. As a result, Everstate’s model begins to be seriously questioned, which has indirect negative effects on the export of services, as the Everstatan Mamominarch-type of knowledge and skills is now considered as inadequate. Yet, Novstate manages to turn the tragedy to its advantage, and can now sell its unique expertise.

The overall direct and indirect cost of the tornadoes outbreak is very high. Security has definitely not been ensured and, seeing the slow rate of reconstruction, the absence of hope of much help considering the already overall difficult situation of Everstate before the tornadoes, Western refugees start moving towards other areas.

To be continued

——-

* According to Munich-Re, “A sequence of devastating earthquakes and a large number of weather-related catastrophes made 2011 the costliest year ever in terms of natural catastrophe losses….With some 820 loss-relevant events, the figures for 2011 were in line with the average of the last ten years. 90% of the recorded natural catastrophes were weather-related – however, nearly two-thirds of economic losses and about half the insured losses stemmed from geophysical events, principally from the large earthquakes. Normally, it is the weather-related natural catastrophes that are the dominant loss drivers.” Munich-Re, “Review of Natural Catastrophes in 2011,” 4 January 2012. Download pdf.

** The video was published on Nov 17, 2011 by AssociatedPress and posted on YouTube: “A tornado ravaged three neighborhoods in the outskirts of the Bolivian city of Cochabamba, damaging dozens of private homes and warehouses but was not responsible for any deaths. (Nov. 17).” For a recent example of a very destructive tornadoes outbreak, see the U.S. 2011 Super Outbreak, which occurred from April 25 to 28, 2011.

*** Inspiration for this part comes from the Ajka alumina plant accident in Hungary (4 October 2010) – The video on YouTube ”VÖRÖSISZAP” – “RED SLUDGE” was uploaded by  on Oct 14, 2010.

**** The idea came from the sadly famous Bophal disaster in India (2–3 December 1984). Watch “Seconds From Disaster – Bhopal nightmare [Full Episode 45:05],” National Geographic Channel.

***** Stockton also emphasises that local authorities would need to ask for (in the case of the U.S., federal) help.

“Responding to those requests in a timely manner could create complex challenges for the department [of defense] in sourcing the requested capabilities, transporting them, and then providing for their reception, staging, onward movement, and integration in a severely disrupted environment.”

2013 – 2018 EVT – Tragic events

Gallery

This gallery contains 9 photos.

The tragic events that strike Everstate are instances of the various conditions presiding to Everstate’s destiny, considering what has been done, or not, globally, regionally and within Everstate. The same set of events will be used to stress test each … Continue reading

Building upon the 2012 “Global Water Security” IC Assessment

This post was selected to be re-posted as part of AlertNet’s special multimedia report “The Battle for Water:” The Battle for Water – Global water security: moving towards worldwide assessment

Considering any issue in terms of strategic foresight and warning for national security demands, first and foremost, a minimal understanding of the issue itself, which is notably obtained by reaching out to experts in the related fields, as done by the ICA. This is true for water as for any other issue. Without this initial enquiry, it is impossible to even hope delivering proper foresight and warning to policy-makers. It is only after the issue is understood that we may sieve our analysis through the various filters of national security, mission of the institution carrying the analysis and finally complex policy-making system.

Focusing initially on an understanding of water, without any self-imposed restriction, will underline three major points, already sparsely evidenced in the ICA, and upon which we could build more systematically for an even better, and more actionable strategic foresight and warning on water related security issues.

Moving beyond a deceptive anthropocentric water usage

by US ICA p.ii

First, and as underlined by all studies on water, including by the ICA, water on Earth is distributed according to various forms and places.

The most widely used estimate of water distribution was established by Igor Shiklomanov (1993) and is similar to a more recent assessment (Gleick, 1996), as the two tables below, extracted from the USGS website, show. It would appear that the ICA uses the same figures, approximations on percentages apart.*

As a result, most studies dealing with water as security issue mainly focus on freshwater, especially freshwater most commonly used by human beings, i.e. rivers and lakes, as well as groundwater. This is how the ICA proceeds, indeed emphasising that “we do not do a comprehensive analysis of the entire global water landscape” (Scope Note). However, one also finds throughout the assessment, evidence that the ICA does not actually limit itself to this approach, as we shall see.

It is indeed necessary to define and most often reduce the scope of any study, as well as to focus on specific objectives, here national interest. Human usage of water is obviously crucial for survival, likely to generate tensions and thus of primary importance to national security. However, because we are here considering potential threats and opportunities to national security, are we sure we can reduce our area of concern to human usage?

Indeed, usage on the one hand and threats or opportunities on the other are not synonymous, notably in the context of climate change and other anthropogenic changes  (i.e. changes caused by humans) we must face nowadays.

For example, we now know that a drop in biodiversity may enhance the risks of epidemics (Suzán et al. 2009; Sohn 2009). Hence, if biodiversity is reduced as a result of water-related changes, then we could have increased risks of diseases, which go beyond those already underlined by the ICA p.5.

“Patterns of threat” by Rivers in Crisis – data

Instances of such risks to biodiversity have been identified, for example, in “Global Threats to Human Water Security and River Biodiversity” (published in Nature in 2010 and with a dedicated website showing, among other, interactive maps of threats). This study finds notably that “80% of the world’s population is exposed to high levels of threat to water security… while “biodiversity,” is jeopardized, “with habitats associated with 65% of continental discharge classified as moderately to highly threatened.” It shows that technological efforts in richer countries focus on reducing threats to human water security, but do not pay attention to biodiversity.

Thus, most probably, the risks of epidemics are not only higher than emphasised in the ICA, but also present on a much larger territory – including most of the so-called richer world, as shown  in yellow on the map – and could involve a wider range of diseases. Such qualifications of threats cannot be neglected in terms of national security.

This example means that our assessments would be enhanced if we were changing the initial focus of investigation. Security issues related to water usage for humans are only one aspect we must address. We need to consider water even when it is not of direct use to humans, i.e. when it affects biodiversity.

Interestingly, the ICA itself underlines this point – and more – when it judges “that, from now through 2040, improved water management will afford the best solutions for water problems” and explains that efficient water management is the “use of an integrated water resource management framework that assesses the whole ecosystem and then uses technology and infrastructure for efficient water use, flood control, redistribution of water, and preservation of water quality” (p.6).

It would be highly beneficial – if difficult – to start working towards a process allowing us to  also include systematically such integrated approach for threats (and opportunities) assessment.

Integrating the whole water cycle

Second, as far as water is concerned, the Earth is most often considered as a closed system (USGS), i.e. a system that only exchanges energy with its environment.**

If we are in the case of a closed system, this means that the overall amount of water on earth, whatever its form, does not vary. It can neither augment nor diminish but is transformed and transported through the water cycle, as depicted by the USGS picture below, where humans are represented as part of fauna. Animals will take in water from freshwater storage and plants and then return water through evapotranspiration and waste products.

The water cycle shows, even more than the previous point, the need to stop limiting ourselves to freshwater usable by humans. We must, on the contrary, consider all types of water. Indeed, freshwater is obviously heavily dependent upon other types of water, spheres (as in biosphere or hydrosphere) and processes.

Any change either to one component of the cycle, to the flow, or, worst, to the cycle itself – and this at both global and local (ecosystems) levels – has a potential to produce threats to security – or opportunities – to alter timelines for both threats occurrence and response, and to change likelihood. For example, to completely remove anything related to the oceans from water-related threats assessment may create very unfortunate blind spots indeed. As, in terms of national security, this “cycle approach” is already adopted in the case of snow, glaciers and melt-water, including in the ICA, it only needs to be applied systematically.

Considering interactions between cycles

Finally, the water cycle is also linked to two other major cycles, the carbon and nitrogen cycles.

The Carbon Cycle by Wikipedia

The water and carbon cycles are linked, notably through the processes of respiration (living beings). Thus, any change in one cycle has the potential to feed back on the other, creating chain reactions with potential threatening impacts, or, on the contrary, opportunities.

Nitrogen is a vital element of life. As explained by John Arthur Harrison, it is “an essential component of DNA, RNA, and proteins, the building blocks of life” (VisionLearning). Without entering into the details of the complex nitrogen cycle (see for example “The Global Water and Nitrogen Cycles” by the University of Michigan), the water and nitrogen cycles can interact in many ways, for example through atmospheric nitrogen and acid rains, changed water pH, freshwater polluted by excess nitrogen, eutrophication, etc. Again, change to one cycle will affect the other with impact on threats and opportunities assessment.

Parts of the feedbacks between cycles are already considered, for example, through the increasingly reduced availability of safe drinking water, and through various water-related impacts on food security. However, it would be necessary to develop a multi-disciplinary effort that would allow us to truly and exhaustively envision potential feedback effects between cycles aiming at improving threats and opportunities identification and evaluation (including impact, timeline and likelihood).

Water Dolphin by JJ Harrison (http://www.noodlesnacks.com/) (Own work) GFDL 1.2 or CC-BY-SA-3.0, via Wikimedia Commons

Grounding systematically global water security and related threats and opportunities assessment  in an approach moving away from restrictive and deceptive anthropocentric usage, focusing on the whole water cycle at both global and local level and integrating feedbacks with other related cycles would yield crucial further insights in terms of likelihood, timeline, impacts as well as nature of threats. It would thus enhance the overall product, as well as pertinence for policy-makers and decision-makers. It would also generate vital improvements in terms of indicators and monitoring, which would need to be organised with outreach, considering the scope of the endeavour. Transition towards such an approach is already underway as many of its elements, besides the more classical national security orientation, are found in the ICA, if we take the “Global Water Security” assessment as representative of anticipatory products for national security. Change needs however to be systematised, for example through building bridges and integration with or similar to such crucial forward–looking multi-disciplinary endeavour as the FuturICT project.***

————-

* The source given by the ICA, “World Bank 2010,” is incomplete and insufficient to trace the data used.

** We should however note that the endogenous and the exogenous (for example “having been delivered by comet impacts – e.g. Morbidelli et al 2000”) appearance of water on Earth seem to be still debated (UCLA IGPP) and that the water system can also be considered as open through exchanges at the level of the atomic constituents of water (hydrogen and oxygen).

*** I heard first about FuturICT through Philip Payet, Afrikasources

———-

References

FuturICT website. Accessed 27 March 2012.

Gleick, P. H., 1996: “Water resources.” In Encyclopedia of Climate and Weather, ed. by S. H. Schneider, (Oxford University Press, New York, vol. 2).

Harrison, John Arthur, “The Nitrogen Cycle: Of Microbes and Men.” VisionLearning, Accessed 27 March 2012.

Morbidelli A. Chambers J. Junine J.I. Petit J.M. Robert F. Valsecchi G.B. and Cyr K.E. 2000. “Source regions and timescales for the delivery of water to the Earth.” Meteoritics & Planetary Science 35: 1309-1320.

Shiklomanov, Igor “World fresh water resources” in Peter H. Gleick (editor), 1993, Water in Crisis: A Guide to the World’s Fresh Water Resources (Oxford University Press, New York).

Sohn, Emily, ”Animal Biodiversity Keeps People Healthy.”  Discovery News, May 19, 2009.

Suzán G, Marcé E, Giermakowski JT, Mills JN, Ceballos G, et al. (2009), “Experimental Evidence for Reduced Rodent Diversity Causing Increased Hantavirus Prevalence.” PLoS ONE 4(5): e5461. doi:10.1371/journal.pone.0005461.

U.S. Intelligence Community Assessment, Global Water Security, 2 February 2012.

UCLA IGPP Center for Astrobiology – NASA Astrobiology Institute;  ”Cosmochemistry in an astrophysical context – relating the origin of the Solar System to processes of planet building elsewhere (Hansen, Lyons, McKeegan, Morris, Shuping, Wasson, Young); accesed 27 March 2012.

University of Michigan, ”The Global Water and Nitrogen Cycles.” Accessed 27 March 2012.

USGS, Water Science fo Schools, last updated 2012. Accessed 27 March 2012.

Vörösmarty, C. J. et al. “Global threats to human water security and river biodiversity.” Nature 467, 555–561 (30 September 2010) doi:10.1038/nature09440.

Wikipedia, various entries, Accessed 27 March 2012.