For example, a key theme of Nassim Taleb’s “The Black Swan” is to pay close attention to the possibility of the rare event, the outlier that brings devastating consequence. Taleb forcefully and intelligently argues that these outliers are much more common than we think (1 in 100 year floods happen every 3-5 years) especially when we base our statistical analysis on the assumptions of a normal distribution of data and independence.
However, some interesting research by Didier Sornette at the Swiss Federal Institute of Technology shows that while power laws can explain some of the extreme events that have taken place in history, there are some extreme outliers that even defy classic power laws.
A post in MIT’s Technology Review blog cites the following:
“Sornette gives as an example the distribution of city sizes in France, which follows a classic power law, meaning that there are many small cities and only a few large ones. On a log-to-log scale, this distribution gives a straight line–except for Paris, which is an outlier and many times larger than it ought to be if …
For example, a key theme of Nassim Taleb’s “The Black Swan” is to pay close attention to the possibility of the rare event, the outlier that brings devastating consequence. Taleb forcefully and intelligently argues that these outliers are much more common than we think (1 in 100 year floods happen every 3-5 years) especially when we base our statistical analysis on the assumptions of a normal distribution of data and independence.
However, some interesting research by Didier Sornette at the Swiss Federal Institute of Technology shows that while power laws can explain some of the extreme events that have taken place in history, there are some extreme outliers that even defy classic power laws.
A post in MIT’s Technology Review blog cites the following:
“Sornette gives as an example the distribution of city sizes in France, which follows a classic power law, meaning that there are many small cities and only a few large ones. On a log-to-log scale, this distribution gives a straight line–except for Paris, which is an outlier and many times larger than it ought to be if it were to follow the power law.”
The article also mentions that the city of London also follows this same example.
Sornette calls these extreme outliers “Dragon Kings.” A sobering commentary from the article ensues; “(The) seemingly ubiquitous presence of these dragon kings in all kinds of data sets means that extreme events are significantly more likely than power laws suggest.”
This in turn suggests that the Mother of all Black Swans might be unaccounted for in your data set. And if this is the case, does this mean that we cannot only not predict these extreme events, but that preparation is futile?
I would love to hear your thoughts!
