Wednesday, February 18, 2015

Mexican ISP Telum Gains Operational ITSM Advantages Via Identifying and Monitoring of Vast Network Elements

Transcript of a BriefingsDirect discussion on how Mexican ISP Telum leverages HP ITSM tools to deliver better quality and reliability across a carrier-grade network.

Listen to the podcast. Find it on iTunes. Download the transcript. Sponsor: HP.

Dana Gardner: Hello, and welcome to the next edition of the HP Discover Podcast Series. I’m Dana Gardner, Principal Analyst at Interarbor Solutions, your host and moderator for this ongoing sponsored discussion on IT innovation and how it’s making an impact on people’s lives.

Gardner
Once again, we're focusing on how companies are adapting to the new style of IT to improve IT performance and deliver better user experiences, as well as better business results.

This time, we're coming to you directly from the recent HP Discover 2014 Conference in Las Vegas. We're here to learn directly from IT and business leaders alike how big data, cloud, and converged infrastructure implementations are supporting their goals.

Our next innovation case-study interview highlights how Telum in Northeast Mexico improves their reliability through quality assurance and higher availability using software. To help us learn more about how they do that we are joined by Max Garza O'Ward, Head of IT Operations at Telum, an ISP based in Monterrey, Mexico. Welcome.
What secrets will your data tell you?
In the HP Toolkit for Operations Analytics
Max Garza O'Ward: Thank you, Dana.

Gardner: Good to have you with us. First, tell me why reliability and high performance are so important to your business?

O'Ward: It’s a very competitive business for the telecommunications industry. We're not the top dog in Mexico or Northeast Mexico. Everything that we put into our customer effort is to bring in customers that we need to keep. So reliability is a key part of our commitment to our customers.

Gardner: And you're not just using technology. You're delivering technology. So it seems essential to have a handle on what you have, what it's doing, and maybe even get out in front and have predictive capabilities when problems might arise.

O'Ward: That’s very true. Prediction is where we need to focus. To ensure good services we need to make sure that all those systems are up and running, and we use software to precisely do that.

Gardner: For our listeners who might not be familiar with your organization, tell us about your size, how many subscribers, how many services. Just give us a description of your organization, both in terms of the breadth of services and the size of your audience?

O'Ward: We're part of the Northeast Mexico market, basically Monterrey, which is the biggest city up north. We have three different customer markets. The residential market is roughly over 500,000 customers. We have small business or SOHO businesses, with between 3,000 and 6,000 customers. And we also have a large enterprise market, around 1,500 large enterprises.

Unwieldy network

Gardner: Let’s dig a little bit into the problems that you face. Several years ago, you were looking at a network that was perhaps a bit unwieldy, maybe not well-defined. You had some difficulties predicting how certain things that you did on your network would impact your customers. Perhaps you can walk us through your problem set, your challenges, and then how you started to solve them.

O'Ward
O'Ward: That’s a very good approach. In terms of network, we basically started noticing that we were committing a lot of unplanned outages, or unplanned downtimes. So we started to reinforce our monitoring solutions based on HP software. We came in and provided better solutions to what we were looking into as a network element point of view.

Based on that, we refurbished our inventory and made sure that all of our network elements were replaced promptly, based on events. So prediction was key to our better service-level agreement (SLA) offerings.

Gardner: Max, was this a function of changing just the software or was there a cultural component to this? Did you have to change the way you were thinking about monitoring and quality assurance in addition to employing some new technology?

O'Ward: Yes, it was a cultural change. As a matter of fact, just two years ago, we revamped the way the operations department is composed. So a big gap that was closed because of culture. Culture needed to be changed.

Previously, we had all these disparate teams working on only their solution. Once we came under one head of operations, we decided that service was the only thing that matters. So we bridged that gap and now we have all these cross-functional teams working for the same response, which is service offerings.
Now, it's a combination of culture, teamwork, and understanding where the failures are.

Gardner: So IT service management (ITSM) has led to the ability to maintain your quality and performance. Are there any indicators of how much -- perhaps the number of failures from one period to more recent failures?

O'Ward: There are a lot of numbers. I will give you top figures. IT is the department that I head, and most of these departments are based on different engineering groups.

When we started working toward service and focusing only on services, on video services, for example, we had over 10 percent failures globally, not every month, but throughout the year. Once we got under this new management and using our new HP tools, we have been bringing that number down consistently.

Now, it's a combination of culture, teamwork, and understanding where the failures are. Sometimes software tells us where the problem is and sometimes software is needed to understand where the problem is.

In this particular case, we soon understood what the problem was and we decided to change out equipment that was failing via either obsolescence or just a defective part.

Transparency and visibility

Gardner: In addition to changing culture, putting in some better processes and better tools, it seems to me that for a lot of companies that I speak to, a lot of the process involves getting to know yourself better, providing transparency and visibility.

Then, it's dashboarding that information so that people can access it, regardless of whether it’s firefighting or just ongoing maintenance. Tell me about this journey from having a lot of elements, perhaps not always visible, to getting this new-found ability to have greater inventory control.

O'Ward: To start off, transparency is key. Once you have an approach of letting the upper management know where your failures are, that creates concern. And in order for us to create business, we need to have a reputation to uphold.

We started with monitoring basic monitoring elements. We created awareness of where our failures were, and at the same time, we asked for more budget to focus on all these defective parts.
What secrets will your data tell you?
In the HP Toolkit for Operations Analytics
That, in turn, made management very aware of what the engineering departments were actually doing -- either as an IT department or as engineering by itself, which is basically hardware.

Once we had all these components, and they were publicly scrutinized or they were publicly shown in a quarterly meeting, that helped create a dashboard. Now, dashboards are really fun if you really know what you're talking about, but if you give upper management the wrong information, wrong decisions are going to be made. So that’s key.

We're working on creating a huge dashboard. Maybe this year is going to be the year. We have the elements and we're providing that information for the dashboard to be built, but we are waiting to do the next step.

Right now, we're focused on getting the elements straightened out, monitoring all of our key systems, and we have done just that in the last year. So we've upheld our end of the bargain, which is service, quality, and capacity. The next step is going to be providing automatic dashboards. Right now, dashboards are manual.

Gardner: So the good news is that you're getting much more reliable information about what's going on. The bad news is, is you have got a whole lot of information coming in.

O'Ward: That's correct.

Aligning data

Gardner: Big data is a big topic here at HP Discover. What are your thoughts about how to get that data, be it structured or unstructured, into an alignment so that you can improve on your situation, know more about it, get better predictions, and better analysis? I suppose the capstone for this is how important will big data become for you to maintain and improve on your reliability over time.

O'Ward: Big data is a big name, it’s a big trend, and everybody is talking about it. A lot of people, especially people who aren't technology-oriented, talk about it as if if they know it. The way big data is coming into our shop is focused more on customers.

If we're talking about big data, unstructured data, that’s coming in from our traps or alerts and stuff like that. Yes, we need to go into that particular scenario. We're looking at two different projects.

We're going to look into a big-data project that actually brings capacity and quality for our services. At the same time, there's going to be another effort from big data that is a customer-facing effort. So yes, it’s going to be a reality in the next year.
The software is awesome, just great software, and if you have the right people and the right potential, that software can bring you very good benefits.

Gardner: So it’s safe to say that big data is going to have an impact on your IT operations, but perhaps also in your marketing, to understand what’s going on in the field very quickly and then be able to react to it. Big data sort of ties together business and technology.

O'Ward: That's correct. That’s the way we're looking at it. As I said, there are two different teams of people working on it. We're going to be working on the operations part first and then at the marketing part as well.

Gardner: We're here at the beginning of HP Discover. Are there any things in particular that you're going to be out there looking for in terms of how to accomplish your goals over the next several years. What would you like to see HP doing?

O’Ward: Very much what they have been doing in the past. The software is awesome, just great software, and if you have the right people and the right potential, that software can bring you very good benefits.

Our head of operations for the whole company is here with us this week. I'm going to make sure he attends all these meeting in which we can talk about big data and how we can mold out all of the strengths and all of the key performance indicators (KPIs) that he needs. I hope that HP continues to be an innovative software company. I have really enjoyed working with them for the last five or six years.

Gardner: Okay, last question. Going from a failure rate of 5-10 percent down to less than 1 percent is enviable. A lot of people want to make those kinds of strides. Now that you have had experience in doing this, do you have any 20/20 hindsight? What would you suggest to other organizations that are also trying to get a better handle on their systems and their network, get to know their inventory, and gain visibility? What have you learned that you might share now that you have been through it?

O'Ward: It doesn't matter how much we monitor things or how many green lights or red lights we see on any given dashboard. If we're not focused on business processes and business outcomes, this isn't going to work.

My take would be to focus on a business process that you actually know it's critical and start from that. Go top-down from that. That would be the best approach. It's worked for us. It actually bridges a gap between management and the engineering departments. It also provided us with sound budgeting information. Once you understand what the problem really is, it gets approved easier.

So look at business processes first, get to know your business outcomes, and work on that toward your infrastructure.
What secrets will your data tell you?
In the HP Toolkit for Operations Analytics
Gardner: Excellent. I'm afraid we will have to leave it there. We've been learning about how Telum has been improving on their reliability via software quality assurance and delivering much higher availability and performance to their end users.

Please join me in thanking our guest, Max Garza O’Ward, Head of IT Operations at Telum. Thank you.

O'Ward: Thank you, Dana.

Gardner: And thanks also to our audience as well for joining us for this special new style of IT discussion, coming to you directly from the recent HP Discover 2014 Conference. I'm Dana Gardner, Principal Analyst at Interarbor Solutions, your host for this ongoing series of HP-sponsored discussions. Thanks again for listening, and come back next time.

Listen to the podcast. Find it on iTunes. Download the transcript. Sponsor: HP.

Transcript of a BriefingsDirect discussion on how Mexican ISP Telum leverages HP ITSM tools to deliver better quality and reliability across a carrier-grade network. Copyright Interarbor Solutions, LLC, 2005-2015. All rights reserved.

You may also be interested in:

Tuesday, February 17, 2015

California Natural Resources Agency Gains Agility Through Software-Defined Data Center Strategy

Transcript of a BriefingsDirect discussion on how a large state agency harnesses broad virtualization to do more with less in IT while remaining agile and efficient.

Listen to the podcast. Find it on iTunes. Download the transcript. Sponsor: VMware.

Dana Gardner: Hello, and welcome to the special BriefingsDirect podcast series coming to you directly from the recent VMworld 2014 Conference. I'm Dana Gardner, Principal Analyst at Interarbor Solutions, your host throughout this series of BriefingsDirect IT Strategy Discussions.

Gardner
We’re in San Francisco to explore the latest developments in hybrid cloud computing, end-user computing, software-defined data center (SDDC), and virtualization infrastructure management.

Our next innovator case study interview focuses on the California Natural Resources Agency (CNRA) in Sacramento. They have a large purview, overseeing some 25 different agencies. They've set up a SDDC and are deep into the process of maturing its value and utility.

To learn more about how the CNRA gains agility from a SDDC strategy, we welcome Tony Morshed, Chief Technology Officer for the California Resources Data Center in the California Department of Water Resources. Welcome, Tony.

Tony Morshed: Thanks.

Gardner: We’re also here with Michael Hom, Data Center Chief in the IT Infrastructure Services Branch for the California Department of Water Resources. Welcome, Michael.

Michael Hom: Good morning.

Gardner: First, gentlemen, help us understand a little bit about the size of your organization. This is a large state government department, but you're really a department of departments. Help me understand the breadth of your agency.

Morshed: Our department, Water Resources, consists of 3,500 people that are part of the agency that comprises many departments. The bigger ones are Parks and Rec, Cal Fire, and Fish and Wildlife. There are about 28 agencies and conservancies and 25,000 people onboard.

http://www.cold.ca.gov/agency_display.asp?ATRID=WTRRSC
Morshed
Gardner: So in order to support all these people and all these different agencies, a common infrastructure is important, but also it sounds like you need to have differentiation and customization for their specific needs. How do you accomplish both the goal of a common infrastructure for efficiency, but also still be able to meet all your requirements for all those different people?

Morshed: When we started our consolidation effort, we decided to transform ourselves more to an ISP-style setup. We know that most departments have their own IT shops, and you know there is still that trust thing. So we just built the common infrastructure. We let them share the infrastructure, but they have their own security posture. We segregate all their traffic, so each department can still feel like they're autonomous, but yet we all share the infrastructure, in which case we all share the savings.

Mandate to consolidate

Hom: With that, we had a mandate to also consolidate. First, the State of California is really about cost savings. Each of the 25-plus organizations mostly had their own IT shops. By combining the infrastructure as a service (IaaS) in our multitenancy data center, they're able to reap the benefits of cost savings for infrastructure, but also concentrate each department's specific needs and applications.

Hom
Gardner: It sounds as if you have a private-cloud approach, multi-tenancy, and trying to get that elasticity and efficiency going. It also sounds like you’re well on the way to an  SDDC, but you know that means different things to different people. I'd like to get your take on what SDCC means.

Also, are you exploring software-defined storage, software-defined networking, or more on the workload support for the servers. How does it shape up in your mind and in your particular implementation?

Morshed: When the software-defined stuff came out, for me, one of the big things was disaster recovery (DR). If I could stretch my data center into another facility, DR becomes a non-issue, because those workloads can shift between sites without any trouble with automation.

That was the next piece for us -- automation. We realize that we’re part-way there, but to get all the way there, we need to do fuller automation. This means that we need to quit tinkering with the network and storage every time we want to do something new.

Those were big driving factors for going to SDDC. To us, it means that we’re obfuscating the hardware. The hardware’s there. It’s just running. We’re working and tweaking everything at the software layer -- so we could be a lot more agile.

Gardner: Michael, SDDC, how do you define that and to what degree are you into that journey?

Separating the physical

Hom: For the SDDC we really wanted to provide a logical data center to each of our organizations. We wanted to separate the physical, which allows our folks to support more of a logical infrastructure, where they still have autonomy, but the physical layer is basically one and the same.

Today, from a functional point of view, they get what they’ve had before, but without the overhead of physical support. We've used the VMware vSphere and vCloud Suite to provide that software-defined queuing. Right now, we're embarking on a software-defined networking, using VMware NSX and third-party vendors to support that.

We’re looking to use automation soon to help us decrease overhead, and pass those savings on to each of the organizations.

Gardner: Given that you have a common set of infrastructure and, I imagine, lot of common data, are you well into the VMware Virtual SAN adoption for software-defined storage as well? How does that shape up?

Morshed: For Virtual SAN, we're looking at these cases right now and we see some. We’re not quite there yet, and so we’ll focus on the software-defined networking or automation as well. Prior to Virtual SAN, which will probably come later, we’re still evaluating and determining what our needs are in that area.
For me, the greater organizational problems and the structure of your processes become the harder things, because we’re not as used to dealing with those things.

Gardner: It’s complicated, right? There are lot of interdependencies. Certain things happen that ripple across others, and so it’s a crawl-walk-run. Yet the benefits come from a whole greater than the sum of the parts, if I could use a couple of clichés, but it is an interesting time in the business.

What are some of the challenges you have in terms of getting closer to a full SDDC? Are these technology, culture, process, or all of the above?

Morshed: At first it was technology, but the culture and the organizational mindset are the bigger challenge. You can find solutions and work through technology. We're IT people, and we’re used to the technology problems. For me, the greater organizational problems -- and the structure of your processes -- become the harder things, because we’re not as used to dealing with those things.

Gardner: Now, Michael, part of the adoption of a complex, long-term journey on IT is to show results early and get buy-in. Are there instances where you look at that? Maybe, it's the DR, where you can have a sense of better dependability on your resources? Any way to describe what you’ve done early on that has lead to a greater emphasis to adopt more aggressively?

Better service levels

Hom: Definitely. One of the key things with early wins is providing a better service level for provisioning, and that’s something that everybody has been struggling with. With the cloud infrastructure, we've been able to provision within days, if not a day. And that typically beats most of the service tools that each of the organizations have had. So that was an early win.

It’s things like that where we decrease overhead and make IT more accessible for business. That makes it a win, and starts to have the ball rolling as far as other features, such as DR, greater capacity, and things that would be tough for each individual organization to do on their own.

Gardner: Of course, when you do well in a state agency, it’s apparent, right? They're representing services to the public, and you’re the largest US state. You have a large bureaucracy, probably the size of what many countries have. Is there something different about the public sector in terms of accountability or response? How do you have a different set of requirements as a public organization and perhaps enterprises, too?

Morshed: We do have a difference. Our procurement is much harder. Getting people is much harder. We live within a lot of constraints that the private sector doesn’t realize. We have a hard time adjusting our work levels. Can we get more people now? No. It takes forever to get more people, if you can ever get them.
We live within a lot of constraints that the private sector doesn’t realize.

Gardner: So it’s doing more with less over and over again.

Morshed: Constantly doing more with less. Part of this virtualization is survivability. We would never be able to survive or give our business the tools they need to do their business without this. We would just be a sinking ship.

Gardner: So the whole philosophy, Michael, of SDDC and virtualization, is of doing more with less, of automating, of boiling out the manual processes and going to more real-time responsive technology driven infrastructure makes total sense for your organization?

Hom: Definitely. To go with what Tony says, we really don’t have much overhead when we need to respond to future projects. When there's an uptick in activity, there is no way to have more resources available. So we need to build that into our infrastructure to allow for that dynamic bandwidth to happen from a personal level.

Gardner: We’re here of course at VMworld 2014. There’s lot of news going on. Anything in particular piquing your interest, perhaps with the OpenStack support in the EVO Hyper-Converged Infrastructure? What is now on your agenda after hearing some news to reach those goals as you describe them?

EVO looks pretty nice

Morshed: There are a couple of things. EVO looks pretty nice. I was out on the floor and looking at it yesterday and talking with the CIO and I see it as something that we might be able to use for some of our outlying offices, where we have around 100 to 150 people. We can drop something like that in, put virtual desktop infrastructure (VDI) on it, and deliver VDI services to them locally, so they don't have to worry about that traffic going over the wide area network (WAN).

The other piece is the acquisition made recently with CloudVolumes and looking at how we can use that to leverage our VDI structure. We're using another product right now in that space, but again with CloudVolumes it’s been a part of VMworld. It’s more interesting, because we know that the chances of all the software being upgraded and updated in at the same time in interoperability is greater if it’s a VMware product.

For us, it’s been a real struggle to make sure that all the products that we use, interact and as there’s an upgrade, everything upgrades at the same time. To me, those are the two biggest things that I'm getting out of the announcements.
The business could come up with more dollars, but to be able to be more agile and more flexible is where it really pays off.

Gardner: Right and it’s like building a virtuous cycle of adoption benefit because when you do the SDDC built on virtualization that provides a public-cloud benefit. Then, you can start realizing those end-user computing benefits like VDI. So, there’s really this snowball effect.

Is that something that you’ve been able to demonstrate? Do you have any metrics of success that you can point to?

Morshed: We do have some tangible benefits. We have reduced our CAPEX by somewhere around 40 percent and our OPEX around 32 percent. I don’t have the numbers, but we have deployed VDI in the Department of Water Resources and we already virtualized about 600 to 800 desktops. Not only is it helping us save costs there; it’s also used as a strategy for a remote access as a strategy to help protect our server infrastructure by using VDI for admins.

So there are those tangible things that you can reach out and measure and those intangible things, where it’s allowing us to do something easier and more flexible. That, for me, is the bigger win. The business could come up with more dollars, but to be able to be more agile and more flexible is where it really pays off.

Gardner: So we get productivity, we've got DR, which reduces your risk, and we've got some hard savings and economics. It's pretty compelling. Michael, any thoughts about how those fit together, and which ones are more important to you?

More flexible

Hom: Definitely, this allows us to be more flexible, as Tony said, and there are some things that we're trying to do that we would never imagine without a SDDC. So they increased security, greater capacity, capabilities to our business.

Gardner: How about VMware specifically? Is there some differentiator in terms of how they produce this products that has allowed you to follow this journey? Is this more of a partnership than a procurement relationship? It sounds like the track that VMware takes in its strategy very much aligns with yours.

Morshed: It’s very much a partnership. In fact, we basically only want to work with business partners. We don’t want to work with vendors, because we don’t need someone to sell us something and walk away. VMware has been hand-in-hand with us for this whole journey.

When we look at other products for the mix, we look for the deep partners with VMware because we know virtual machines (VMs) are core. So, when we look in the storage partners and we’re looking at networking partner, we’re making sure that those partners are partners of VMware.
We don’t want to work with vendors, because we don’t need someone to sell us something and walk away. VMware has been hand-in-hand with us for this whole journey.

One of the things that we find is the inoperability once everything has been virtualized. Everything has to connect, and it’s not a single stack. So if one thing gets upgraded, we need to make sure that everything across a stack can accept that upgrade. Otherwise, we lose the ability to take the advantage of the upgrade until everybody else catches up.

Early on, we were in that position and we’re doing everything we can to remove ourselves from that position.

Gardner: Michael, any thoughts on the nature of the VMware relationship that you could point to in terms of legacy in an approach that others might want to consider.

Hom: Definitely. We consider VMware a strategic partner. A couple of things that illustrate that is that we’ve been involved with the VMware’s Excellware and Velocity program and that's been two-fold. For the velocity side, we have marked up a fully working SDDC with SX, with virtualized automation, operations in business as a stack.

Gardner: One of the things we've heard here at VMworld is be bold, be brave, be a little bit aggressive. Go out there and do these things. Any thoughts for other organizations that are just dipping their toes into the water? Is it higher risk than reward to be bold and brave in getting early? Or is it perhaps something that allows you to then be a differentiator and be better in your own environment, whether it’s a public or private sector?

Set in stone

Morshed: The first thing is always question what you’ve got that's set in stone, because most of it is not set in stone. We've all heard a lot of things that you can't do. You can’t virtualize Oracle, but you can. You can't do this, you can't do that, you can't get the network focused at the top of the storage. That's all that stuff that you actually can do.

You have to really look at it, peel it back, make sure that "you can't" is an actual thing, and then figure out how to get around it. The way I see it is that, as the world turns, things morph, and if you don’t move into this virtualization space, you're going to be left behind. You're going to be the guy making buggy whips. There are no buggy whips running around. There’s no use for them.

We’re all being asked to do so much more with the same resources or fewer resources. We're all being pushed to keep up with how the demand is going out there. Technology is just jumping, and this is the only way on the infrastructure side to keep up with that.
We’re all being asked to do so much more with the same resources or fewer resources. We're all being pushed to keep up with how the demand is going out there.

Gardner: Michael, any other thoughts in terms of 20/20 hindsight on your experience and why being aggressive and being bold has paid off?

Hom: Virtualization is definitely up and running, at least in state organizations. It’s probably something that we might do that or we might use as a toolset, but from looking at VMware this week, virtualization is the industry standard.

If you don’t take it on, then you really won’t be able to respond to business needs. What happens is that when the official IT organization becomes obsolete, there are going to be ad-hoc IT organizations and those would become the norm. If you want to be relevant, you have to use every tool set that you can to provide the business needs.

Gardner: Very good. I'm afraid we’ll have to leave it there. We've been learning from the California Natural Resources Agency in Sacramento how they’ve been embarking and benefiting from a SDDC strategy. I'd like to thank our guests, Tony Morshed, Chief Technology Officer for the California Natural Resources Data Center in the California Department of Water Resources. Thank you so much, Tony.

Morshed: No problem. It’s been a pleasure.

Gardner: And we've also been joined by Michael Hom, Data Center Chief in the IT infrastructure services branch for the California Department of Water Resources. Thanks so much, Michael.

Hom: Thank you.

Gardner: And also a big thank you to our audience for joining this special podcast series coming to you directly from the recent 2014 VMworld Conference in San Francisco. I'm Dana Gardner, Principal Analyst at Interarbor Solutions, your host throughout this series of VMware-sponsored BriefingsDirect IT strategy discussions. Thanks again for listening, and come back next time.

Listen to the podcast. Find it on iTunes. Download the transcript. Sponsor: VMware.

Transcript of a BriefingsDirect discussion on how a large state agency harnesses broad virtualization to do more with less in IT while remaining agile and efficient. Copyright Interarbor Solutions, LLC, 2005-2015. All rights reserved.

You may also be interested in: