Software-defined is emerging as a hot topic among organizations as a means to transform data centers into an IT facility focused on increasing the agility and speed at which they support their application and increase developer productivity. Now that software-defined has become the everyday talk for many IT professionals and business leaders, we have identified some of the most common questions they are asking about software-defined environments. And to help answer those questions in a more effective way, I recently interviewed one of the most influential personalities in a software-defined world: Matt Hogstrom, who is also a Distinguished Engineer and a Chief Technology Officer at IBM. Here are his excerpts:
Q.1) We’re seeing different software-defined terms being used in the industry like software-defined data center, software-defined infrastructure, etc. What does IBM mean when it comes to software-defined?
Matt: Software-defined at its core means a programmatic access to infrastructure. Over the past few years, the industry has shifted from traditional IT to an API driven consumption model of infrastructure. At IBM, we are considering the consumers, as well as the providers of programmatic infrastructure and use the term Software Defined Environment (SDE) to refer to the architecture. The Software Defined Environment framework transforms static infrastructure into a dynamic, constantly optimized, workload-aware virtualized resource that allows line-of-business users to take advantage of IT when needed without delay, hence enabling far greater business agility. Given the velocity of Systems of Engagement (SoE), there is new kind of interaction between the consumer and the infrastructure provider to express workloads in a way where the infrastructure can respond to the needs of the workload.
Q.2) Many industry experts call software-defined as a marketing hype. What is your opinion? Can you point out the three underlying attributes of SDE?
Matt: SDE is not hype at all. I think it’s a rapidly evolving reality. Infact, software-defined evolves more out of the realization by the industry of how the consumption model has changed. When we talk about the attributes of SDE, one of its most significant attributes is velocity. Customers are expecting to consume infrastructure resources on demand quite honestly. Today the velocity of IT consumption in a business is much more instantaneous. The second attribute is uniformity. Today consumers are less concerned about the particular devices on the back-end. They are not concerned if it’s a converged storage infrastructure or if it’s a V7000 back-end, etc. But they are more concerned about they just need a block storage if its 20 terabytes or 50 terabytes. An SDE brings uniformity by automating, standardizing and integrating end-to-end IT infrastructure. The third attribute is really more focused on IT providers rather than building unique systems, networks, storage infrastructures for applications like we used to do in the past. We have got the infrastructure providers looking for how do they take large pool of resources and put them together in a way that they can deliver programmatically to the consumers. So from that standpoint, it’s changing the way IT providers are thinking about how their engineering systems are on the back-end.
Q.3) When we say a software-defined environment, that means there will be no role of the hardware?
Matt: That’s not correct. There is always an assumption that there is hardware somewhere that’s going to host these containers, whether they are the operating systems, hypervisors, etc. This implies that the hardware is there. However, the difference is that there is less concern about how that hardware is hosted and more concern about how I consume that hardware. So again, it goes back to the idea of SDE that automatically orchestrates all the infrastructure resources (compute, storage, networks and management) to meet workload requirements in real-time. So we can say that in a Software Defined Environment, infrastructure matters.
Q.4) Is SDE a matured technology now?
Matt: The concept of SDE consumption is fairly mature. I think the movement is well underway. One area which is not fully settled is on whether the consumption APIs have to be uniform or not. Many vendors including IBM have its set of APIs for developing and deploying applications. In order to be as effective and efficient as possible, I believe having some kind of uniform way of accessing these different pools of resources is going to be important. We think OpenStack is one of the means of leveling those consumption models. We are also seeing customers are asking themselves questions about how to take large pools of data and analyze them to gain insights. Companies are in various stages of embracing and exploiting SDE, they all are looking at it in a way to complete tasks faster and more agile than they have done in the past.
Q.5) What are the challenges customers find while embracing SDE?
Matt: Today, customers are more concerned about the nature, utilization and placement of data because the data at its very core is one of the most significant parts of SDE. Data is not something that is easily moved from one location to another. As such, data is a significant consideration in how the software-defined consumption model is going to work because the farther you get away from the data, the more latency you introduce to a running workload. Determining the value, sensitivity and placement of the data, etc. is one of the challenges in organizations moving to SDE. I think we have moved into a next chapter of SDE where we are going to see a lot more innovation around data location both in terms of performance as well as legal and other restrictions on placement.
Q.6) Do you think SDE is the enabler for Cloud, Analytics, Mobile and Social (CAMS)?
Matt: Yes, absolutely. Software Defined Environments are optimized to deliver the agility, efficiency and performance needed for today’s workloads. Cloud is itself a SDE. Software Defined Environments help cloud service providers offer the most efficient and scalable cloud solutions, even the analytics. Let me quote an example here. Recently I was listening to a customer talking about data and the sources. They were looking at taking data from a lot of sources like close circuit TVs and using that data in real-time, analyzing it for facial recognition, for security purposes, determining locations and even how to associate discounts with customers. That’s a tremendous amount of data, their data is coming from a particular locality, then they are going to stream it in, set analytics on it. That’s a very unique kind of data analysis application so it’s not all about applications that evolve web UIs. So analytics is how I quickly take that data and quickly act on it, hence making SDE a critical part of how they structure their environment. In Mobile, SDE is the next source of transaction and requests as in worldwide, the number of devices is exploding and even looking at that data and drawing tons of information out of it. SDE for Social helps in getting sentiment analysis, understanding what customers are thinking, what is happening in the world, how can we make an opportunity out of data. So I believe you can’t really do any of the CAMS workloads without SDE. If you don’t have that, your ability to react in a timely fashion is going to be limited. As a result, it will make actions irrelevant because by the time you get something stood up and running, it’s too late and the opportunity will be missed.
Q.7) What about the security concerns when implementing SDE?
Matt: From the Security standpoint, it’s in the evaluation of data and how sensitive it is. As new applications are coming online, new data sources are identified, and the processing of those data sources is evaluated. We are going to see some interesting innovations in the storage space in terms of being able to tag and identify data, identify its location geographically as well as the ability to move the data from one place to another. So the security concerns there come down to where it is located, how I manage it overtime, how I identify it, and how I maintain it in the audit trail from the governance standpoint. I think that continues to be an aspect of how data evolves overtime.
Q.8) What is IBM’s plan for SDE? How do IBM SDE’s offerings differ from the competition?
Matt: At IBM, we have traditional ways of delivering compute, network and storage on-premise as well as means of delivering it programmatically via APIs in a hosted environment like at SoftLayer. We acknowledge with the industry shift we need to be able to provide those IT resources through either channel whether it’s an on-premise or off-premise solutions. One of the significant efforts that we have made to help unify is we’ve standardized on OpenStack as our consumption model. We believe Open is a critical aspect of SDE, it’s really more in order to consume and use resources across different types of environment as you have to be able to get a common language to do that. And we believe OpenStack is the language to be able to serve this up. We’re also focusing heavily on delivery of services or SoftLayer as a service first on the public web via SoftLayer in addition to providing packages that live on-premise. So we’re changing the way we deliver code and we are also following the trend toward improving velocity by moving software releases much more aggressively that we had in the past when the market was a traditional IT. We are now much moving towards an aggressive delivery model that moves faster and faster in terms of how we deliver new capabilities.
What makes us different from the competition is - IBM has such a broad portfolio of software, services and expertise. We have portfolios in software that help developers be more productive, we have middleware that can be hosted on a variety of platforms -- from System z, Power and System x being able to deliver middleware technology to host applications across broad set of heterogeneous environment. We have a services business with SDE at its core and we also have a public cloud presence. So from a breadth of portfolio, IBM is really looking at the very large picture of compute, storage and network, public cloud, host private cloud, and on-premise cloud. This broad portfolio puts us in a very unique position to help customers make the transition from traditional IT to a new velocity model around SDE and with that we are moving aggressively to meet customer needs and help them meet the needs of their consumers whether line-of-business, developers, etc. So IBM’s broad portfolio puts us in a very unique position to see a holistic view of how the software-defined revolution is going to evolve.
Q.9) Tell us something about IBM’s Software Defined Networking strategy?
Matt: IBM was the impetus behind OpenDaylight and is very active in Software Defined Networking (SDN) environment. OpenDaylight is an open source based, SDN controller project under the Linux Foundation. Since its inception, OpenDaylight has gained significant traction in the industry. IBM is making significant contributions to OpenDaylight, which have includes IBM’s DOVE overlay networking code. IBM continues to invest in SDN development and is committed to the consumption of SDN as a means to achieve the kind of velocity that we want to achieve with application deployment. With SDN VE announced last year, we made huge strides and are working towards introducing many more breakthrough innovations in Software Defined Networking, including the inclusion and automation of network appliances in system patterns.
Q.10) So, what’s next in Software Defined Environments?
Matt: I think the interesting lessons learned as we move forward is SDE is all about a programmatic infrastructure and we very often associate programmatic infrastructure with virtualization, which has been a critical technology over the past couple of decades in getting efficiency out of the environment. One of the evolving areas which is very interesting is the use of container-based deployments around packaging message like docker, etc. This technology has been around with us for many years. I think the ability to leverage containers is its deployment mechanisms that really help customers with two significant advantages: 1) Containers are much faster than traditional virtual deployment machines, so you can get greater density of applications of particular physical footprint, which drives efficiency and reduction in your capex and opex. 2) They are smaller, lighter weight, they start and shut-down faster. And so it’s very consistent in this over-arching idea in SDE, focusing on the velocity of consumption infrastructure. The containers also change the way we think about hypervisors. May be hypervisors are less relevant going into the future as we move to containers in lighter way consumption models because our goal is to move faster, to be nimbler, to react in market quicker, to get insights faster and any new technology that helps us to do that in a way that is effective and efficient is going to be embraced. I think looking at the container deployment model is one of the next ways of SDE as we go forward!
Matt Hogstrom has more than 30 years of experience ranging across zSeries mainframes distributed systems like Linux, Solaris and AIX as well as J2EE / JEE Middleware engineering and performance analysis on all of these platforms. In his current role as Distinguished Engineer and CTO at IBM, Matt is responsible for the architecture and strategy for Software Defined Environments (SDE). His prior roles included Architect of the IBM Workload Deployer (previously known as WebSphere CloudBurst Appliance), Chief Architect of WebSphere AppServer Community Edition and as the Architect of the WebSphere performance team across all runtime environments.
If you like to know how to build end-to-end software defined environments architecture, write to Matt at firstname.lastname@example.org or connect with him on Twitter @hogstrom.
For more updates, follow @IBMSDE.
IBM Systems & Technology Group