Is Networking a Cognitive-Gap in Hyper-Convergence?

My background over nearly 20 years has been Oracle Database, more recently focusing on the supporting infrastructure of large-scale databases. While many of the IT silos we know have come apart, even with Software-Defined Everything (SDx), knowledge of IT Networking has remained an apparent dark-art, at least to me. So, on the basis that if I feel this way, at least one other person does, here’s a trip around what I am calling “Networking, the Cognitive-Gap in Hyper-Converged Infrastructure”.

Let’s start the conversation by asking – why is it that many articles promoting awesome new 2U+ rack-oriented technology, that can scale to 10-100 nodes, make little mention of networking? I want to know more about what a ToR Switch and 10GbE Fabric are, and if you’re like me, today we want to be able to find a sufficiently technical level of information on our own, not have to approach vendors directly to ask for it means we don’t feel burdened by being sold to.

Given my need to know, I approached a former EMCer, Dennis Smith (now at Brocade), with my problem of understanding and I got this great reply;

Most hyperconverged appliance solutions today are delivered in a single rack.  However, if you need multi-rack the most common architecture is leaf and spine with fixed config 40GbE spine switches.  For us it would be the VDX 6740 at the leaf, VDX 6940 at the spine.  We generally recommend using a flat L2 fabric for hyperconvergence (VCS fabric) since it’s the simplest to deploy, but an IP fabric using BGP or OSPF can also be deployed if desired.  And if it’s just a couple of racks, a dense 10GbE VDX 6940 could be used as a “top-of-racks” switch (“racks” in plural).

Dennis also provided a couple of links to papers they prepared in collaboration with VMware and Nutanix, respectively.

Brocade VDX 6740 Deployment Guide for VMware® EVO:RAIL

Nutanix Hyperconverged Appliance with the Brocade VDX ToR Switch

These are great papers that I encourage everyone to read, they are very clear and discuss the networking at a level I can understand. 

If you need more background on network topology, old and new, I found this post from West Monroe Partners helpful;

A Beginner’s Guide to Understanding the Leaf-Spine Network Topology

There’s also a really fun podcast that helps a lot to deepen understanding of ToR, Spanning Tree, Leaf-Spine, East-West and more;

Datanauts 011: Understanding Leaf-Spine Networks

In summary, this post is a journey to close a gap in understanding that the network is perhaps the most important component in hyperconverged infrastructure, that is the least well understood.

I want to assure everyone, the omission of similar material from Cisco, Simplivity, and anyone else is unintentional, I intend to become familiar with their offerings, and more. I am certain with the recent announcements of 2nd-generation offerings from EMC, HPE and now Cisco, Hyperconverged Infrastructure is about the get even more attention.

Researching this post has helped me better understand networking at the “leaf”-level, in a follow-up post I plan to explore the “spine” of Hyperconvergence. Hopefully with some great feedback from you, comments and links to more supporting material that I did not manage to find are most welcome.

Yours truly, @DBAStorage


Attending #UKOUG_LME16? It’s next week!





Next week, I will be attending the inaugural UKOUG Licence Management Event 2016 (#UKOUG_LME16) on the 15th March in London at the Kensington Close Hotel.

This feels a lot like how I remember my first CloudExpo in London, 4 years ago now, it was a little “rough around the edges”, at the same time, it felt like we were all still learning what cloud computing could become, much less about marketing.

In this age of automation, it’s not enough just to count CPU sockets/cores that I need to make sure I am fully licensed for; I also want to know when my DBA has inadvertently enabled a feature we don’t pay for, therefore are not licensed to use.

I am optimistic bringing together a lot of folks interested to understand and improve what we know about Oracle Licence Management is an outstanding idea. In the longer term, with our support, I believe it can even help elevate the conversation to a new level by making Software Asset Management more accessible to everyone.

For sure there will be animated discussions around Oracle Audit challenges. Let’s not forget, while Oracle is in the business of selling software licenses, it is our responsibility to make sure we are correctly licensed for the software we use.

At #UKOUG_LME16, I will be engaging with as many exhibitors, presenters and attendees as possible to help move the conversation forward on the following:

  • What simple methods should be used when virtualizing Oracle servers?
  • What solutions are available to help monitor Oracle license usage?
  • How can I prevent or at least detect usage of unlicensed features?

Hope to see you there, I have been looking forward to this event since it was first announced, will do my best to share experiences on Twitter, feel free to follow me, the hashtag #UKOUG_LME16, or both. You can find the Agenda here.

Yours truly, Peter Herdman-Grant