{"id":2751,"date":"2021-03-29T17:30:42","date_gmt":"2021-03-29T15:30:42","guid":{"rendered":"https:\/\/ofcourseimright.com\/?p=2751"},"modified":"2021-03-29T20:47:39","modified_gmt":"2021-03-29T18:47:39","slug":"can-the-internet-get-walled","status":"publish","type":"post","link":"https:\/\/ofcourseimright.com\/?p=2751","title":{"rendered":"Can the Internet Get \u201cWalled\u201d?"},"content":{"rendered":"\n<div class=\"wp-block-image\"><figure class=\"alignleft size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/upload.wikimedia.org\/wikipedia\/commons\/b\/b6\/Ever_Given_Suez_Canal_24_March_2021.jpg\" alt=\"The Ever Given blocking the Suez Canal\" width=\"158\" height=\"107\"\/><figcaption>Ever Given<\/figcaption><\/figure><\/div>\n\n\n\n<p class=\"has-drop-cap\">Over the last few days we bore witness to a minor economic disaster, thanks to the Ever Given having firmly planted itself into both walls of the Suez Canal.  <a rel=\"noreferrer noopener\" href=\"https:\/\/www.ft.com\/content\/171c92ec-0a44-4dc5-acab-81ee2620d3c1\" target=\"_blank\">The Financial Times gives a very good overview<\/a> of the factors that to this mishap. In that article, Brendan Greeley describes how the Ever Given got \u201cwalled\u201d more so than just grounded, because it implanted itself into the canal walls.<\/p>\n\n\n\n<p>For those of us whose life is about providing resilient services, one has to ask: where was the failure?  Mr. Greeley goes into some depth about how the sheer height (beam), weight, and width of the ship, the shape of the canal, the water forces and wind all contributed to this mishap.  He also pointed out that the economics favor larger vessels.  This is an externality- there is no chance that the owners will ever pay for the amount of damage the blocked canal has caused, which is estimated to have been up to $10 billion.  Syria was reportedly rationing fuel because of the blockage, and fuel prices across the globe ticked up.  Several ships rerouted to go around the horn of Africa, risking hijackings.<\/p>\n\n\n\n<p>The other <strong>far<\/strong> <strong>bigger<\/strong> failure here is that there is but one canal through which upon which large portions of the world economy depends.  One big <strong>anything<\/strong> doesn&#8217;t make for good resilience.  That canal could fail again.  Knowing this, <a rel=\"noreferrer noopener\" href=\"https:\/\/www.middleeastmonitor.com\/20210328-iran-proposes-alternative-shipping-line-to-suez-canal\/\" target=\"_blank\">Iran<\/a> has offered to create an alternate shipping lane, adding at least a bit of redundancy into the system.  Ultimately, manufacturers throughout the supply chain can re-evaluate how to manage this sort of delivery delay.  Should new lanes be formed?  Should more production be closer to the end consumer?  A new canal would surely cost tens of billions of dollars, and may offer only limited resilience.  After all, why wouldn&#8217;t the same failure happen in <strong>both<\/strong> canals?  In all likelihood it won\u2019t be this precise \u201cwalling\u201d, the hope being that  canal operators and pilots will update their procedures to limit the risk.<\/p>\n\n\n\n<p>We Internet geeks understand this class of problem in great detail, in many dimensions.  A major benefit of cloud computing is to spread load across multiple CPUs in multiple locations, so that no single failure would cause disruption.<\/p>\n\n\n\n<p>Taken individually and impacting individual customers, it\u2019s a sure bet that cloud services are far more reliable than people rolling their own, just as it is safer to use a container vessel than trying to carry one\u2019s products across in a dingy.  However, the flip side of that coin is the impact those services have when they fail.  Some examples:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>When<\/td><td>What<\/td><td>Impact<\/td><\/tr><tr><td>2016<\/td><td><a href=\"https:\/\/en.wikipedia.org\/wiki\/Mirai_(malware)\" target=\"_blank\" rel=\"noreferrer noopener\">Mirai BOTNET<\/a> \/ DYN attack<\/td><td>Twitter, other services out for a day<\/td><\/tr><tr><td>2020<\/td><td><a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2020-12-18\/google-blames-gmail-youtube-outage-on-error-in-user-id-system\" target=\"_blank\" rel=\"noreferrer noopener\">GMail, YouTube, Google Docs<\/a><\/td><td>Services disrupted for an hour<\/td><\/tr><tr><td>2020<\/td><td><a href=\"https:\/\/www.theverge.com\/2020\/11\/25\/21719396\/amazon-web-services-aws-outage-down-internet\" target=\"_blank\" rel=\"noreferrer noopener\">Amazon Web Services East Coast Data Center<\/a><\/td><td>Large numbers of application services failed<\/td><\/tr><tr><td>2020<\/td><td><a href=\"https:\/\/techcrunch.com\/2020\/07\/17\/cloudflare-dns-goes-down-taking-a-large-piece-of-the-internet-with-it\/?guce_referrer=aHR0cHM6Ly93d3cuZ29vZ2xlLmNvbS8&amp;guce_referrer_sig=AQAAAJ6x7GKLBsq7DOMjq4k4dtogoUvrAwMBB_5WlC1lAW1S9XSfhpbMSs142-ASpNU94I_L0zHaRIVeLSAaNRt289PoHwr2afRq3Pg39Azei47oIPLkL9rwhPns2yN63haXC8jVSrlUwOxVn0DHmYvK-DDK4nKIQ-MpKOOsWMHvKUwj&amp;_guc_consent_skip=1617023323\" target=\"_blank\" rel=\"noreferrer noopener\">Cloudflare DNS outage<\/a><\/td><td>Client resolvers failed for 27 minutes<\/td><\/tr><tr><td>2021<\/td><td><a href=\"https:\/\/www.bleepingcomputer.com\/news\/microsoft\/microsoft-explains-the-cause-of-yesterdays-massive-service-outage\/\" target=\"_blank\" rel=\"noreferrer noopener\">Microsoft Teams and Office 365<\/a><\/td><td>Services to their customers unavailable for four hours<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>Can an Internet-wide failure happen?  Where\u2019s that \u201cInternet canal\u201d bottleneck?  <a rel=\"noreferrer noopener\" href=\"https:\/\/blogs.cisco.com\/networking\/improving-dns-security-while-preserving-resiliency\" target=\"_blank\">I wrote about that for Cisco not long ago.<\/a>  It could very well be cloud-based DNS resolvers, such as Cloudflare&#8217;s 1.1.1.1.   What we know is that these services can fail because they have done so in the past.  Last year, MIT sage Dan Geer looked at market concentration effects on  <a rel=\"noreferrer noopener\" href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/23738871.2020.1728355\" target=\"_blank\"> cybersecurity risk<\/a>, which opens up a bigger question.  This time, The Ever Given failed without any malice.  Geer\u2019s major point is that there is an asymmetric attack on large targets, like popular cloud services.  The same perhaps can be said about the Suez Canal.<\/p>\n\n\n\n<p>Note that large cloud services are not the only aggregate risk we face.  Geer\u2019s earlier work looked at software monocultures.  When a large number of systems all use the same software, a single attack can affect all, or at least a great many, of them.  This is just another example of a Suez Canal.<\/p>\n\n\n\n<p>The economic drivers are always toward economies of scale, whether that&#8217;s a large cloud service or a single supplier, but at the often hidden price of aggregate resiliency.  The cost  generally amounts to an externality because of the size and scope of the service as well as the impact of an outage on others are not understood until an event happens. Having not considered it a week ago, some producers are considering this question today.<\/p>\n\n\n\n<hr>\n\n\n\n<p class=\"has-small-font-size\">Courtesy of  Copernicus Sentinel data 2021, https:\/\/commons.wikimedia.org\/w\/index.php?curid=102251045<\/p>\n","protected":false},"excerpt":{"rendered":"<p>What&#8217;s the Suez Canal of the Internet?<\/p>\n","protected":false},"author":172,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[17,87],"tags":[594,593],"class_list":["post-2751","post","type-post","status-publish","format-standard","hentry","category-economics","category-internet","tag-redundancy","tag-resilience"],"_links":{"self":[{"href":"https:\/\/ofcourseimright.com\/index.php?rest_route=\/wp\/v2\/posts\/2751","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ofcourseimright.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ofcourseimright.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ofcourseimright.com\/index.php?rest_route=\/wp\/v2\/users\/172"}],"replies":[{"embeddable":true,"href":"https:\/\/ofcourseimright.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2751"}],"version-history":[{"count":4,"href":"https:\/\/ofcourseimright.com\/index.php?rest_route=\/wp\/v2\/posts\/2751\/revisions"}],"predecessor-version":[{"id":2813,"href":"https:\/\/ofcourseimright.com\/index.php?rest_route=\/wp\/v2\/posts\/2751\/revisions\/2813"}],"wp:attachment":[{"href":"https:\/\/ofcourseimright.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2751"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ofcourseimright.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2751"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ofcourseimright.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2751"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}