Monday, August 31, 2009

Harnessing 'Virtualization Sprawl' Requires Managing Your Ecosystem of Technologies

Transcript of a sponsored BriefingsDirect Podcast on how companies need to deal with the complexity that comes from the increasing use of virtualization.

Listen to the podcast. Find it on iTunes/iPod and Podcast.com. Download the transcript. Learn more. Sponsor: Hewlett Packard.

Free Offer: Get a complimentary copy of the new book Cloud Computing For Dummies courtesy of Hewlett-Packard at www.hp.com/go/cloudpodcastoffer.

Dana Gardner: Hi, this is Dana Gardner, principal analyst at Interarbor Solutions, and you’re listening to BriefingsDirect.

Today, we present a sponsored podcast discussion on better managing server virtualization expansion across enterprises. We’ll look at ways that IT organizations can adopt virtualization at deeper levels, or across more systems, data and applications, at lower risk.

As more enterprises use virtualization for more workloads to engender productivity from higher server utilization, we often see what can be called virtualization sprawl, spreading a mixture of hypervisors, which leads to complexity and management concerns.

In order to ramp up to more, but advantageous, use of virtualization, pitfalls from heterogeneity need to be managed. Yet, no one of the hypervisor suppliers is likely to deeply support any of the others. So, how do companies gain a top-down perspective of virtualization to encompass and manage the entire ecosystem, rather than just corralling the individual technologies?

Here to help us understand the risks of hypervisor sprawl and how to mitigate the pitfalls to preserve the economic benefits of virtualization is Doug Strain, manager of Partner Virtualization Marketing at HP.

Doug Strain: Thanks, Dana.

Gardner: Help us out. What is the current state of virtualization adoption? Are we seeing significant pickup as a result of the economy? What’s driving all the interest in this?

Strain: Virtualization has been growing very steeply in the last few years anyway, but with the economy, the economic reasons for it are really changing. Initially, companies were using it to do consolidation. They continue to do that, but now the big deal with economy is the consolidation to lower cost -- not only capital cost, but also operating expenses.

Gardner: I imagine the underutilization of servers is like a many-headed dragon. You’ve got footprint, skills, and labor being used up. You’ve got energy consumption. You’ve got the applications and data that might be sitting there that have no real purpose anymore, or all of the above. Is this is a big issue?

Underutilized capacity

Strain: It definitely is. There’s a lot of underutilized capacity out there, and, particularly as companies are having more difficulty getting funding for more capital expenses, they’ve got to figure out how to maximize the utilizations they’ve already bought.

Gardner: And, of course the market around virtualization has been long in building, but we’ve had a number of players, and some dominant players. Do you see any trends about adoption in terms of the hypervisor providers?

Strain: Probably, we’re seeing a little bit of a consolidation in the market, as we get to a handful of large players. Certainly, VMware has been early on in the market, has continued to grow, and has continued to add new capabilities. It's really the vendor to beat.

Of course, Microsoft is investing very heavily in this, and we’ve seen with Hyper-V, fairly good demand from the customers on that. And, with some of the things that Microsoft has already announced in their R2 version, they’re going to continue to catch up.

We’ve also got some players like Citrix, who really leverage their dominance in what’s called Presentation Server, now XenApp, market and use that as a great foot in the door for virtualization.

Gardner: That’s a good point. Now, we introduced this as a server virtualization discussion, but virtualization is creeping into a variety of different aspects of IT. We’ve got desktop virtualization now, and what not. Tell us how this is percolating up and out from its core around just servers.

Strain: Desktop virtualization has been growing, and we expect it to grow further. Part of it is just a comfort within IT organizations that they do know how to virtualize. They feel comfortable with the technology, and now, putting a desktop workload instead of server workload, is sort of a natural way to extend that and to use as resources more wisely.

Probably the biggest difference in the drivers for desktop virtualization is the need for meeting compliance regulations, particularly in financial, healthcare, and in a lot of other industries, where customer or employee privacy is very important. It makes sure that the datas no longer sits on someone’s desk. It stays solely within the data center.

Gardner: So there are a lot of good reasons for virtualizing, and, as you point out, the economy is accelerating that from a pure dollars-and-cents perspective. But this is not just cut and dried. In some respects, you can find yourself getting in too deep and have difficulty navigating what you’ve fallen into.

Easy to virtualize

Strain: That’s definitely true, and because of the fact that all the major vendors now have free hypervisor capabilities, it becomes so easy to virtualize, number one, and so easy to add additional virtual machines, that it can be difficult to manage if technology organizations don’t do that in a planned way.

Gardner: As I pointed out, it’s difficult to go back to just one of the hypervisor vendors and get that full panoply of services across what you’ve got in place at your particular enterprise, which of course might be different from any other enterprise. What’s the approach now to dealing with this issue about not having a single throat to choke?

Strain: There are a couple of dimensions to that. As you said, most of the virtualization vendors do have management tools, but those tools are really optimized for their particular virtualization ecosystem. In some cases, there is some ability to reach out to heterogeneous virtualization, but it’s clear that that’s not a focus for most of the virtualization players. They want to really focus on their environment.

The other piece is that the hardware management is critical here. An example would be, if you’ve got a server that is having a problem, that could very well introduce downtime. You've got to have a way of navigating the virtual machine, so that those are moved off of the server.

That’s really an area where HP has really tried to invest in trying to pull all that together, being

. . . Having tools that work consistently both in physical and in virtual environments, and allow you to easily transition between them is really important to customers.

able to do the physical management with our Insight Control tools, and then tying that into the virtualization management with multiple vendors, using Insight Dynamics – VSE.

Gardner: We’ve discussed heterogeneity when it comes to multiple hypervisors, but we’re also managing heterogeneity, when it comes to mixtures of physical and virtual environments. The hypervisor provider necessarily isn’t going to be interested in the physical side.

Strain: That’s exactly right. And, if they were interested, they don’t necessarily have the in-depth hardware knowledge that we can provide from a server-vendor standpoint. So yeah, clearly there are a few organizations that are 100 percent virtualized, but that’s still a very small minority. So, we think that having tools that work consistently both in physical and in virtual environments, and allow you to easily transition between them is really important to customers.

Gardner: All right. How do we approach this, and is this something that is like other areas of IT we’ve seen, where you start at a tactical level and then over time it gets too complex, too unwieldy, you start taking more strategic overview and come up with methodologies to set some standards up. Is this business as usual in terms of a maturation process?

Strain: I think that’s what we’ve seen in the past. I certainly wouldn't recommend that to somebody today that’s trying to get into virtualization. There are a lot of ways that you can plan ahead on this, and be able to do this in a way that you don't have to pay a penalty later on.

Capacity assessment

It could be something as simple as doing a capacity assessment, a set of services that goes in and looks at what you’ve got today, how you can best use those resources, and how those can be transitioned. In most cases you’re going to want to have a set of tools like some of the ones I’ve talked about with Insight Control and Insight Dynamics VSE, so that you do have more control of the sprawl and, as you add new virtual machines, you do that in a more intelligent way.

Gardner: Tell us a little bit about how that works? I've heard you guys refer to this as "integrated by design." What does that mean?

Strain: We’ve really tried to take all the pieces and make sure that those work together out of the box. One of the things we’ve done recently to up the ante on that is this thing called BladeSystem Matrix. This is really converged infrastructure that allows customer to purchase a blade infrastructure complete with management tools with the services, and a choice of virtualization platforms. They all come together, all work together, are all tested together, and really make that integration seamless.

Gardner: And HP is pretty much neutral on hypervisors. You give the consumer, the customer, the enterprise the choice on their preferred vendor.

Strain: We do. We give them a choice of vendors. The other thing we try to do is give them a choice of platforms. We invest very heavily in certifying across those vendors, across the

What we’re finding is that we can’t say that one particular server or one particular storage is right for everybody. We’ve got to meet the broadest needs for the customers.

broadest range of server and storage platforms. What we’re finding is that we can’t say that one particular server or one particular storage is right for everybody. We’ve got to meet the broadest needs for the customers.

Gardner: Let's take a look at how this works in practice. Do you have any examples, customers that have moved in this direction at a significant level already, and perhaps had some story about what this has done for them?

Strain: I’ve just pulled up a recent case study that we did on a transportation company, called TTX Company. I thought this was a good example, because they’d really tried a couple of different paths. They’d originally done mainframes, and realized that the economics of going to x86 servers made lot more sense.

But, what they found was they had so many servers, they weren’t getting good utilization, and they were seeing the expenses go up, and, at the same time, seeing that they were starting to run out of space in their data center. So, from a pure economic standpoint, they looked at this and said, “Look, we can lower our hardware cost.”

TCO 50 percent lower

In fact, they saw a 10 percent reduced-hardware cost, plus they’re seeing substantial operating expense reductions, 44 percent lower power cost, and also 69 percent reduction in their rack footprint. So, they can now say they are removing it from the datacenter and, compared to their mainframes, they think they have about a 50 percent lower total cost of ownership (TCO).

Gardner: So, if you do this right, they're not just rounding-error improvements. These are pretty substantial.

Strain: These are substantial, and, particularly today, that’s a great way to justify virtualization. What they also found was that, from an IT standpoint, they were much more effective. They project that they can recover much more quickly -- in fact, 96 percent reduction in recovery time. That's going from 24 hours down to 1 hour recovery.

Likewise, they could deploy new servers much more quickly -- 20 minutes versus 4 hours is what they estimate. They’ve reduced the times they have to actually touch a server by a factor of five.

Gardner: So, we’ve seen quite a few new studies that have come out, and virtualization remains in the top tier of concerns and initiatives from enterprises, based on the market research. We’re also seeing interesting things like managing information explosion and reducing redundancy in terms of storaging data. These all come together at a fairly transformative level.

How big a part in what we might consider IT transformation does virtualization play?

Strain: It plays a very substantial role. It’s certainly not the only answer or not the only

The investment in the industry is around management, making it simpler to deploy, to move, to allow redundancy, all those kinds of things, as well as automation.

component of data center transformation, but it is a substantial one. And, it's one that companies of almost any size can take advantage of, particularly now, where some of the requirements for extensive shared storage have decreased. It's really something that almost anybody who's got even one or two servers can take advantage of, all the way to the largest enterprises.

Gardner: So, at a time when the incentives, the paybacks from virtualization activities are growing, we’re seeing sprawl and we’re seeing complexity. This needs to be balanced out. What do you think is the road map? If we had a crystal ball, from your perspective in knowledge of the market, how do we get both? How do we get the benefits without the pain?

Strain: Clearly, this is an area where the entire industry is investing heavily in not just the enabling of the virtualization. That’s been done. There’s still some evolution there, but the steps are getting increasingly smaller. The investment in the industry is around management, making it simpler to deploy, to move, to allow redundancy, all those kinds of things, as well as automation.

There are a lot of tasks that, particularly when you think about a virtual machine, can be run on a range of different hardware, even in different datacenters. The ability to automate based on a set of corporate rules really can make IT much more effective.

Gardner: Great. We’ve been talking about better managing server virtualization expansion across enterprises, and we’ve been joined in our discussion by Doug Strain. He is the manager of Partner Virtualization Marketing at HP. We appreciate it, Doug.

Strain: My pleasure.

Gardner: This is Dana Gardner, principal analyst at Interarbor Solutions. You've been listening to a sponsored BriefingsDirect podcast. Thanks for listening, and come back next time.

Free Offer: Get a complimentary copy of the new book Cloud Computing For Dummies courtesy of Hewlett-Packard at www.hp.com/go/cloudpodcastoffer.

Listen to the podcast. Find it on iTunes/iPod and Podcast.com. Download the transcript. Learn more. Sponsor: Hewlett Packard.

Transcript of a sponsored BriefingsDirect Podcast on how companies need to deal with the complexity that comes from the increasing use of virtualization. Copyright Interarbor Solutions, LLC, 2005-2009. All rights reserved.

Friday, August 28, 2009

Nimble Business Process Management Helps Enterprises Gain Rapid Productivity Returns

Transcript of a sponsored BriefingsDirect podcast on how Business Process Management can help enterprises solve productivity problems and rapidly adapt to changing economic conditions.

Listen to the podcast. Download the transcript. Find it on iTunes/iPod and Podcast.com. Learn more. Sponsor: BP Logix.

Dana Gardner: Hi, this is Dana Gardner, principal analyst at Interarbor Solutions, and you’re listening to BriefingsDirect.

Today, we present a sponsored podcast discussion on the importance of business process management (BPM), especially for use across a variety of existing systems, in complex IT landscapes, and for building flexible business processes in dynamic environments.

The current economic climate has certainly highlighted how drastically businesses need to quickly adapt. Many organizations have had to adjust internally to new requirements and new budgets. They have also watched as their markets and supplier networks have shifted and become harder to predict.

To better understand how business processes can be developed and managed nimbly to help deal with such change, we're joined by a panel of users, BPM providers, and analysts. Please join me in welcoming David A. Kelly, senior analyst at Upside Research. Welcome to the show, Dave.

David A. Kelly: Thanks Dana, glad to be here.

Gardner: We're also joined by Joby O'Brien, vice president of development at BP Logix. Hi, Joby.

Joby O'Brien: Hi, Dana, how are you doing?

Gardner: Good. We are also joined by Jason Woodruff, project manager at TLT-Babcock. Welcome Jason.

Jason Woodruff: Thank you, Dana.

Gardner: Let's start off with you, Dave. Tell us a little bit about how the business climate that we are in that has made agility and the ability to swiftly adapt not just a nice-to-have, but a must-have.

Kelly: You hit it on the head in the intro there, when you talked about dynamic business environments. That's what people are facing these days. In many cases, they have the same business processes that they have always had, but the landscape has shifted. So, some things may become more important and other things are less important.

What's important in any case is to be able to drive efficiency throughout an organization and across all these business processes. With the economic challenges that organizations are facing have had, they've had to juggle suppliers, products, customers, ways to market, and ways to sell.

As they're doing that, they're looking at their existing business processes, they are trying to increase efficiencies, and they are trying to really make things more streamlined. That's one of the challenges that organizations have had in terms of streamlining what's going on within their organization.

Gardner: Dave, just as a sort of level-check on IT, as more organizations have elevated data and applications and infrastructure even into services, IT has become a bit more nimble, but what we are really focusing on are the processes. How we can utilize these services, create workflows, apply logic and checks and balances across how things are conducted, and pull together people and process as much as it affects what IT does at its core?

Two levels

Kelly: You've got two levels. As you said, there are core IT operations and applications that are out there, but the real business value that's happening today is being able to tie those things together to be able to add on and address the business needs and the business processes.

In many cases, these processes cross applications and services. As you said, some organizations

We're seeing that it's difficult sometimes for an organization, especially right now, to look at something on a one-, two-, or three-year plan.

are even getting into cloud solutions and outside services that they need to integrate into their business processes. We've seen a real change in terms of how organizations are looking to manage these types of processes across applications, across data sources, across user populations.

That's where some of the real pressure has come from the changes in the economy in terms of being able to address those process needs more quickly and in a much more flexible and nimble approach than we have seen previously.

This is probably a good point to talk about the fact that BPM solutions have been around for quite sometime now, and a lot of organizations have really put them to good use. But, over the past three or four years, we've seen this progression of organizations that are using BPM from a task-oriented solution to one that they have migrated into this infrastructure solution.

This is great, if you can support that, but now with the changes and pressures that organizations are facing in the economy and their business cycles, we see organizations look for much more direct, shorter term payback and ways to optimize business processes.

Gardner: Let's go to Joby O'Brien at BP Logix. Joby, Dave just mentioned the fact that we have sort of an infrastructure approach to BPM, but where the rubber hits the road is how business processes get adapted, changed, implemented. This also cuts between where the business side sees value and where the IT side can provide value.

Perhaps you could tell us a little bit about where you see the BPM market now, and how things are a little different than they were a few years ago?

O'Brien: Actually, the points that Dave made were great, and I agree completely. We're seeing that it's difficult sometimes for an organization, especially right now, to look at something on a one-, two-, or three-year plan. A lot of the infrastructure products and a lot of the larger, more traditional ways that BPM vendors approach this reflect that type of plan. What we're seeing is that companies are looking for a quicker way to see a return on their investment. What that means really is getting an implementation done and into production faster.

One of the things we are also seeing is that part of that thrust is being driven heavily by the business users. Instead of being a more traditional IT-oriented approach, where it's again a longer-term implementation, this new approach is being driven by business needs.

When there are particular business needs that are critical to an organization or business, those are the ones they tend try to address first. They are looking for ways to provide a solution that can be deployed rapidly.

Same level of customization


One interesting thing is that they are also still looking for the same level of customization, the same level of flexibility, that they would have in a much larger or infrastructure-type approach, but they still want that rapid deployment of those applications or those implementations.

We're also seeing that what they are doing in a lot of cases is breaking them apart into different pieces based on priority. They take the processes that are most critical, and that are being driven by the business users and their needs, and address those with a one-at-a-time approach as they go through the organization.

It's very different than a more traditional approach, where you put all of the different requirements out there and spend six months going through discovery, design, and the different approaches. So, it's very different, but provides a rapid deployment of highly customized implementations.

Kelly: It's almost a bottom-up approach to BPM, instead of taking the top-down, large-scale infrastructure approach. Those definitely have their place and can be really powerful, but, at the same time, you can also take this bottom-up approach, where you are really focused on, as Joby said, individual processes that can be aggregated into larger business processes.

Gardner: Let's go to Jason Woodruff at TLT-Babcock. First, Jason, tell us a little bit about your company. You are in the industrial space. Then, as an IT project manager, tell us a little bit about what your business side has been looking for.

Woodruff: Sure, Dana. First of all, just to give a background of what TLT-Babcock does, we are a supplier of air handling and material handling equipment, primarily in the utility and

That requires flexibility and ultimately usability, not only from the implementation stage, but the end user stage, and to do so in the most cost-effective manner.

industrial markets. Our spectrum of products range from new product to after-market, which would include spare parts rebuilds. We rebuild our own equipment, customer equipment, and competitor equipment as well. So, we have our hands in a lot of markets and lot of places.

As a project manager, my job, before I got involved in our BPM solutions, was simply to manage those new product projects. Serving in that capacity, I realized a need for streamlining our process. Right now, we don't want to ride the wave, but we want to drive the wave. We want to be proactive and we want to be the best out there. In order to do that, we need to improve our processes and continuously monitor and change them as needed.

So, the direction was given, "Let's do this. How are we going to do it? What do we need to do? What is it going to take? Let's get moving." After quite a bit of investigation and looking at different products, we developed and used a matrix that, first and foremost, looked at functionality. We need to do what we need to do. That requires flexibility and ultimately usability, not only from the implementation stage, but the end user stage, and to do so in the most cost-effective manner. That's where we are today.

Gardner: Okay. Jason, you didn't just write down one day on a blackboard or a white board, "We need Nimble BPM." You probably started with whatever the requirements that your business side gave to you. What allowed you to get from a long-term perspective on BPM to being more proactive and agile?

Needed a change

Woodruff: As I said, the drive was that we needed to make a change. We knew we needed to make a change. TLT-Babcock wants to be the best. We looked within and said, "What can we change to achieve that? What are our weaknesses? Where can we improve?" We made a list of things, and one of the big ones that jumped out was document control.

So, we looked at that. We looked at why document control was an issue and what we could do to improve it. Then, we started looking at our processes and internal functions and realized that we needed a way to not just streamline them. One, we needed a way to define them better. Two, we needed to make sure that they are consistent and repetitive, which is basically automation.

The research drove our direction. We evaluated some of the products and ultimately selected BP Logix Workflow Director. The research really led us down that path.

Gardner: Let's go back to Dave Kelly. Dave, for this sort of requirement of faster, better, and cheaper, what is the requirement set from your perspective in the market for Nimble BPM?

Kelly: An important thing for Nimble BPM is to be able to embrace the business user. Jason just referenced being able to bring the end users into the process in a cost-effective manner and allow them to drive the business processes, because they are ultimately the beneficiaries and the people who are designing the system.

Another aspect is that you have to be able to get started relatively quickly. Jason mentioned the need for that terms of how they identified this business need to be competitive and to be able to

Another thing that's important is to be able to handle ongoing changes and to define potential solutions relatively quickly. Those are some of the key drivers.

improve the processes. You don't want to spend six months learning about a tool set and investing in it, if you can actually get functionality out of the box and get moving very quickly.

Another thing that's important is to be able to handle ongoing changes and to define potential solutions relatively quickly. Those are some of the key drivers.

O'Brien: There's one thing that Jason said that we think is particularly important. He used one phrase that's key to Nimble BPM. He used the term "monitor and change," and that is really critical. That means that I have deployed and am moving forward, but have the ability, with Workflow Director, to monitor how things are going -- and then the ability to make changes based on the business requirements. This is really key to a Nimble BPM approach.

The approach of trying to get everybody to have a consensus, a six-month discovery, to go through all the different modeling, to put it down in stone, and then implement it works well in a lot of cases. Organizations that are trying to adapt very quickly and move into a more automated phase for the business processes need the ability to start quickly.

Monitoring results

They need the ability to monitor results, see what's going on, and make those changes- without having to go through some type of infrastructural change, development process, or rebuild the or retool the application. They need to be able to provide those types of real time monitoring and resulting changes as part of the application. So, that phrase is so important -- the concept of monitor and change.

Gardner: Joby, to Dave's point about getting the tool in a position that the end user, the business driver and the analyst, can use, are we talking about compressing the hand off and the translation between the business side requirements and necessities, especially in a dynamic environment and then implement and refer back? How do we compress this back-and-forth business, so that it becomes a bit more automated, perhaps Web-based and streamlined?

O'Brien: That's a really good question. One of the things we see is that, especially for somebody who's just moving a manual process or a paper-oriented process to an electronic process or an automated one -- people who haven't actually done that yet and this is new to them -- it's difficult sometimes for them to be able to lay out all of the different requirements and have them be exact.

Once they actually see something running, they see it as Web-based, they see their paper-based forms turn into electronic forms, they see their printed documents stored electronically, and

The idea or the approach with the Nimble BPM is to allow folks like Jason -- and those within IT -- to be able to start quickly.

they have different ways of getting reports and searching data inevitably there are changes.

The idea or the approach with the Nimble BPM is to allow folks like Jason -- and those within IT -- to be able to start quickly. They can put one together based on what the business users are indicating they need. They can then give them the tools and the ability to monitor things and make those changes, as they learn more.

In that approach, you can significantly compress that initial discovery phase. In a lot of the cases, you can actually turn that discovery phase into an automation phase, where, as part of that, you're going through the monitoring and the change, but you have already started at that point.

Kelly: Dana, I'd just add that what you are saying here is what you've seen in the development of agile development methodologies over the past 10 years in the software arena, where organizations are really trying to develop applications more quickly and then iterate them.

I think that's what Joby's talking about here in terms of the Nimble BPM is being able to get out of the starting block much more quickly. The thing can then be adjusted dynamically over time, as the business really discovers more about that process.

User expectation


O'Brien: I completely agree. The other is the expectation of the users, even if it is nimble, for something faster, Just getting out of the block quicker is not sufficient. There is usually still an expectation about a relatively high degree of sophistication, even with doing something quickly. In most of these cases, we will still hear that the customer wants integration, for example, into their back-end systems.

They've got applications. They've got data that's stored in a lot of different systems. In a lot of cases, even when they're trying to go do something very quickly, what they are doing is still looking to have some type of an integration into existing systems, so that the BPM product now becomes that coordinator or a way of consolidating a lot of that information for the business users.

Gardner: l'd like to drill down a little bit on how this affects process. Jason, at your organization, when you started using BPM, did you notice that there was a shift in people and their process? That is to say, was there actual compression from what the business side needed and what the IT side could provide?

Woodruff: Yeah, that comes with the territory. We saw this as an opportunity not just to implement a new product like Workflow Director, but to really reevaluate our processes and, in

We'll sit down, find out what they need, create a form, model the workflow, and, within a couple of days, they're off and running. The feedback has been overwhelmingly positive.

many cases, redefine them, sometimes gradually, other times quite drastically.

Our project cycle, from when we get an order to when our equipment is up and operating, can be two, three, sometimes four years. During that time there are many different processes from many different departments happening in parallel and serially as well. You name it -- it's all over the place. So, we started with that six-month discovery process, where we are trying to really get our hands around what do we do, why do we do it that way and what we should be doing.

As a result, we've defined some pretty complex business models and have begun developing. It’s been interesting that during that development of these longer-term, far-reaching implementations, the sort of spur-of-the-moment things have come up, been addressed, and been released, almost without realizing it.

A user will come and say they have a problem with this particular process. We can help. We'll sit down, find out what they need, create a form, model the workflow, and, within a couple of days, they're off and running. The feedback has been overwhelmingly positive.

Gardner: It strikes me that when you demonstrate that you can do that, you open up this whole new opportunity for people to think about making iterative and constant improvement to their jobs. Before, they may not have even tried, because they figured IT would never be able to take it and run with it.

A lot more work for IT

Woodruff: It's interesting that you say that, because that's exactly what's happened. It's created a lot more work for us. One of the things we just implemented -- and this was one of those couple-of-day things -- involved a lot of issues where there was some employee frustration. Things weren't getting done as quickly as we thought they could be. People were carrying some ideas internally that they hadn't shared or shared through the existing channels, and results weren't being presented.

Sort of at the spur of the moment, we said, "We can address this. We can create an online suggestion box, where people can submit their problems and submit their ideas, and we can act on it." We got that turned around in a week, and it’s been a hit. Within the first couple of days, there were well over a dozen suggestions. They're being addressed. They're going to be resolved, and people will see the results. It just sort of builds on itself.

Gardner: Now, in some circles they call that Web 2.0, social networking, or Wikis. Collaboration, I suppose, is the age-old term. I want to go back to Joby at BP Logix. Do you see that the Nimble BPM approach, and this invigorated collaboration, is what gets us to that level of productivity that, as Jason pointed out, lets them push the wave rather than have to ride on someone else's?

O'Brien: Actually, we do. It's funny that Jason had mentioned that particular process. We see that also with many of the other customers we are working with. They are focused on the initial project or the business area that they are trying to address. They will take care of that, but then, as people see the different types of things that can be done, these small offshoots will occur.

A lot of these are very simple processes, but they still require some type of a structure. In some cases, some degree of compliance is also associated with them, and they need the ability to be

With everything somebody is doing, having some degree of management, some degree of control, visibility, auditing, tracking, is important

able to put those together very quickly. Some are simple things, the things that are one-off type of workflows or processes that have originated within an organization. It just happens to be the way they do business.

It's not something traditional, like an IT provisioning or some type of sales-order processing. There are those one-off and unique ways that they do business, which now can provide a degree of collaboration.

Gardner: So, we need to marry the best of ad hoc in innovation, but keep it within this confines of "managed," or it could spin out of control and become a detriment.

O'Brien: That's probably one of the key pieces to almost all of these. With everything somebody is doing, having some degree of management, some degree of control, visibility, auditing, tracking, is important. Inside an organization, there can be hundreds of different processes, little ad-hoc processes that people have created over the years on how they do business.

Some of those are going to stay that way, but with others there needs to be more of a management, automation, auditing, or tracking type of approach. Those are the types of processes, where people don't initially look at them and say, "These are the types of things that I want to automate, so let me bring a BPM tool in."

Getting control

They walk into that area because they realize that a Nimble BPM tool can address those very quickly. Then they start getting some degree of control almost instantaneously, and eventually work their way into full compliance within their industry -- tracking, auditing, automation, and all of the goodness associated with the traditional BPM tool.

Gardner: Jason, this all sounds great in theory, but when you put it into practice, are these small improvements, or what are the metrics? What is the payback? How can you rationalize and justify doing this in terms of a steadfast, predictable, even measurable business result?

Woodruff: I don't know if anybody can really answer that question in black and white, but there are several paybacks. We haven't spent a lot of time doing a calculation of our return on investment (ROI) financially. It's so obvious that the number doesn't really matter as far as we are concerned at this point.

We save a lot of time. To put a figure on it is tough to do, but we save a considerable amount of time. More importantly it allows us to reduce errors and reduce duplication of work, which

. . . It allows us to reduce errors and reduce duplication of work, which improves our lead-time and competitiveness. It's just a win-win. So, it doesn't really matter what the number is.

improves our lead-time and competitiveness. It's just a win-win. So, it doesn't really matter what the number is.

Gardner: Well, how about your relationships with the rest of the organization? When the folks at TLT-Babcock think of IT, do they perhaps perceive you a little differently than they may have in the past?

Woodruff: While I do have a background in IT, that wasn't my role at TLT-Babcock, and still isn't. As a project manager working on customer-driven projects, I am the end user. This current situation came about when I expressed not just my and several other people's comments that we could improve here.

Because I had that background from a previous life, so to speak, I became the natural choice to head this charge. Now, I don't spend as much time in project management. I spend very little time doing that and focus, primarily, on troubleshooting and improving processes.

I've got this role that Joby talked about -- management of these ad hoc things. Bring me your ideas and bring me your problems and we will be the umbrella over all of this and coordinate these efforts, so that we're implementing solutions that make sense for everybody, not just on a narrow focus.

Gardner: Perhaps, I oversimplified in referring to this as business versus IT, but a better way to phrase the question might be how has this changed your culture at your organization from where you sit?

In the early stages


Woodruff: It's interesting, because we're in the early stages here of implementation. We have a couple of processes out and a couple in testing. In the last couple of weeks, just for the first time, we gave a company-wide demonstration of Workflow Director, what it does, how we're going to use it, and, looking down the road, how the processes we have known and grown to love, so to speak, will be changing using this new tool.

That really was a spark that gave each of the users a new look at this and an idea of how this tool is going to affect the tasks that they do each day, their own processes. That's when these ideas started flowing in, "Can you use it to do this? Can you use it to do that?" When they see that, they say, "Oh, that's cool. That's slick. That's so easy." So, we're right at that turning point.

Gardner: Well, we'll have to come back in a while and see how that cultural shift has panned out. Meanwhile, let's go to Joby. For those organizations like Jason's that want to take a Nimble BPM tool and make themselves nimble as a result, how do they get started? Where do you begin to look to implement this sort of a benefit?

O'Brien: Let me make sure I understand the question. How do they typically get started or what organization brings us in?

Gardner: How do you get started in saying, "We like the idea of Nimble BPM that then enables as a catalyst nimble business processes. Where do we begin? How do we get started?"

O'Brien: Almost always, that request will be initiated or driven from some business need, a lot of times from a business unit, and occasionally from IT. So, it's going to be driven from a lot of

That really was a spark that gave each of the users a new look at this and an idea of how this tool is going to affect the tasks that they do each day, their own processes.

different places, but it's almost always going to be geared around the idea of the ability to respond quickly to some type of automation and control around a particular process.

In most cases, at least in our experience, there is usually a primary factor that causes the organization to bring in the product and start the implementation, and that's what they are focused on addressing. From there it grows into other areas, very much like Jason just described. When people start gaining visibility into the types of things that can be done and what that actually means, we generally see the tool growing into other areas.

Gardner: Now, David Kelly, that gets back to your earlier statements, if you are going to start from a tactical pain point and then realize benefits that can then be presented perhaps more horizontally and strategically across the organization, you can't do that sort of crawl-walk-run approach, if you've got to do a two-year multi-million dollar infrastructure approach, better to have something you can do at that more iterative level.

Kelly: Exactly. I think Jason highlighted that in terms of what he just said, in terms of getting these workflows and processes out there showing them to the rest of the company then watching as, all of a sudden, the idea started exploding in terms of how those could be applied. It's the same kind of thing.

From what I have seen, a lot of organizations -- Joby has mentioned this -- start with any process in the organization that needs automation. There are probably multiple processes that need automation, monitoring, or some kind of control.

Just look around

You don't have to think big-picture BPM solution. Just look around. It could be a request management. It could be tracking something. It could be sharing documents or controlling access to the documents. It could be something that adds on to an enterprise resource planning (ERP) system that you need to have additional control over.

There are multiple processes, even in highly automated organizations, that still need automation. You can start in an area like that with a task and with a specific kind of scenario, automate that, use a Nimble BPM product tool like this, start down that road, and then expand beyond there. Jason provides a really good example of that.

Woodruff: If I can jump in again here to expand on that point, something comes to mind here. The question was asked, how does this process start, how do you get started on this path? The two years prior to even looking at BP Logix, we had brought in two, maybe three, different subject matter experts to develop our current in-house system. This was to do just what you said David, do a little something here, a little something there, not necessarily as a global approach to streamlining everything, not workflow software but just something to get results.

Well, we weren't getting anything done. We would get one little thing that wasn't very useful to somebody and something else that wasn't useful to somebody else, and we were just sort of spinning our wheels. Within a few months of getting BP Logix products in our hand, we are off and running. It’s pulling us through in some ways.

So it was just the lack of results that said, "We've got to find something better." So we went out and did that research I talked about earlier, and here we are a few months down the road, and I can say that we are now driving that wave.

Gardner: Okay. Well, I'm afraid we are about out of time, but we have been discussing how in dynamic business environments a nimble approach to BPM can start at the tactical level and even lead to cultural change and swift paybacks. Helping us understand the ability to draw down processes into something that can be measured and used in a managed environment, we have been joined by Joby O'Brien, development manager at BP Logix. Thanks Joby.

O'Brien: Thank you.

Gardner: David A. Kelly, senior analyst at Upside Research. Thanks again, Dave.

Kelly: You're welcome, Dana. Great to be here.

Gardner: We also appreciate Jason Woodruff joining us. He is the project manager at TLT-Babcock. Thanks for your insights and sharing, Jason.

Woodruff: Thank you. It's my pleasure.

Gardner: This is Dana Gardner, principal analyst at Interarbor Solutions. You've been listening to a sponsored BriefingsDirect podcast. Thanks for listening and come back next time.

Listen to the podcast. Download the transcript. Find it on iTunes/iPod and Podcast.com. Learn more. Sponsor: BP Logix.

Transcript of a sponsored BriefingsDirect podcast on how Business Process Management can help enterprises solve productivity problems and rapidly adapt to changing economic conditions. Copyright Interarbor Solutions, LLC, 2005-2009. All rights reserved.

Thursday, August 27, 2009

New Era Enterprise Architects Need Sweeping Skills to Straddle the IT-Business Alignment Chasm

Transcript of a sponsored BriefingsDirect podcast on the role, qualifications, and career paths of enterprise architects. Recorded at The Open Group's 23rd Enterprise Architecture Practitioners Conference and 3rd Security Practitioners Conference in Toronto.

Listen to the podcast. Find it on iTunes/iPod and Podcast.com. Download the transcript. Sponsor: The Open Group.

Dana Gardner: Hi, this is Dana Gardner, principal analyst at Interarbor Solutions, and you’re listening to BriefingsDirect.

Today, we present a sponsored podcast discussion coming to you from The Open Group's 23rdEnterprise Architecture Practitioners Conference in Toronto. [See a related discussion on the effect of cloud computing on the architect role.]

Our topic surrounds the issue of the enterprise architect (EA) -- the role, the responsibilities, the certification, and skills -- both now and into the future. The burgeoning impact of cloud computing, the down economy, and the interest in projecting more value from IT to the larger business is putting new requirements on the enterprise IT department.

So who takes on the mantle of grand overseer as IT expand its purview into more business processes and productivity issues? Who is responsible? Who can instrument these changes, and, in a sense, be a new kind of leader in the transition and transformation of IT and the enterprise?

To help us sort through all of that, we're joined by our distinguished panel. Please join me in welcoming James de Raeve, vice president of certification at The Open Group.

James de Raeve: Hi.

Gardner: We're also joined by Len Fehskens, vice president, Skills and Capabilities at The Open Group. And, David Foote, CEO and co-founder, as well as chief research officer, at Foote Partners. Welcome.

Foote: Thank you.

Gardner: And Jason Uppal, chief architect at QRS.

Jason Uppal: Thank you.

Gardner: Well, let's look first at this whole issue of the down economy in the changing environment. Let me take that first to you, David. What is afoot, if you will, in the field? Why so much change all of a sudden?

Always in flux

Foote: We're always in flux. There's no doubt about it. There's no doubt about the fact that, when money is scarce, people get scared.

You have a lot of very frightened IT departments out there and a lot of frightened business lines with customers bailing out right and left. Everybody is just focused on the moment, thinking reflexively on how do we possibly save money. How do we renegotiate our vendor contracts in IT? How do we not lose customers? This is probably the thing I hear about the most.

IT does not want to be in a position of being responsible for the loss of market share in any way, because the business loves to blame IT, as you know, for a lot of things -- most recently, challenges to market share and revenues.

But, it's the greatest time possible to be talking about things like enterprise architecture (EA) and transformation, because transformation tends to happen in times like this. It tends not to happen in times of prosperity.

As I've been telling everybody, this is the greatest opportunity you'll have personally in your career, if you're a manager in the management ranks, and especially as an executive, to start raising issues that you were afraid to ask for. These are those plans that were shelved at times when you were making so much money that nobody was listening to your conversation. Right now is a tremendous opportunity. I want to be very positive about that, because you'll probably hear about some negatives today too.

Gardner: Let's go to James. Why are these forces around us forcing the change on the definition of the enterprise architect?

De Raeve: There's been a realization, hopefully a growing realization, that the term enterprisearchitect means something different to everybody who uses it. In this time of increased pressure and constraints on budget and focus on results, there's ever-increasing need to have more coherence and more commonality and the idea of what EA is as a discipline, what it should be as a profession, and what skills and competencies enterprise architects need to display in their job to succeed.

Gardner: Moving from a mismatch of definitions and application of EA, to a more standardized approach or perhaps more fragmentation?

De Raeve: I think there is increasing convergence. There is increasing realization that there is a need for a common understanding. I wouldn't say a standardized approach, because you don't have standardized problems and people aren't standardized, but there is a growing realization of the need for common core skills and competencies.

What the members wanted

We develop certification programs, but the reason we do it and the reason we have one in the architecture space is because that's what our members wanted us to do. They want us to do things for good, commercial, self-centered reasons. As organizations, they need this kind of concentration and increased commonality of understanding of skills and competencies.

Gardner: Well, if we're not moving towards a standardized definition, perhaps we're moving to a more strategic role for the architects. Is that fair?

Fehskens: That's always been the case. In many respects, strategy is sort of the lastfrontier. One of the things that I've seen over my career in architecture is that the focus of architects has moved up the stack, so to speak. Initially the focus was on rationalizing infrastructure, looking for ways to reduce cost by removing redundancy and unneeded diversity. It's moved up through the middleware layer to the application layer to business process, and now people are saying, "Well, the place where we need to look for those kinds of benefits is now at the strategy level." That's inevitable.

The thing to understand, though, is that's it's not moving forward in a linear front across the entire industry. The rate of progress is locally defined, so to speak. So, different organizations will be at different points in that evolutionary path.

There are still organizations where the primary role of an enterprise architect is, in fact, to rationalize the infrastructure. On the other hand, we're starting to see lots more places where they're playing a major role in strategy development.

Gardner: As we move up the abstraction, based perhaps on the maturity of the technology and its importance and its role in the larger enterprise, do we see a stratification of sorts among the architects? If so, how do we rise up this pyramid to more of an über-architect, if that makes sense?

Fehskens: There is some stratification. Again, the people working at the highest levels are not going to be making decisions at the lowest levels, they have to pass those decisions down the chain. They may get passed down and passed down. So, just as we talk about a layered architecture, there is a layer of architecture of enterprise-wide responsibility at those various levels in the overall stack.

This gets into a lot of interesting questions about governance, as a result of this. The ideas of architecture purveyed organizational structures from the bottom to the top. Issues of governance are going to become increasingly critical. You talk about the change in the skill profile. A couple of years ago, governance was something that an architect could get by just knowing about.

Now, an architect has to have full-blown competence in the governance area -- how to turn it into decision-making and implementations that conform to the architecture, both across the enterprise and then vertically through this structure of architectures that go down from the strategy level.

Gardner: Jason, one of the least comfortable positions is to be responsible for something, but without authority. How is the role of the architect from your position as a practitioner reaching up this stratification towards a higher level of strategic overview, but gaining authority at a commensurate rate?

Protecting their turf

Uppal: Several things have happened. Especially in the economic downturn, there are a lot ofpeople who are very sensitive and are afraid about their positions and the power that they have accumulated. Or, it's just the normal nature of protecting their own turf.

As role of the architect starts to ascend in the organization, an acceptance has place to some degree, but it also made a lot of other professionals very nervous about what we do. In this day and age, do you have to be very good at what you always did in the rationalization technology, doing this and doing that, and you also have to be very much almost a priest-like sensitive person so that you don't trample on somebody's feelings.

Another layer that I saw come into architect skills in last 6-12 months is how you make sure that you don't trample somebody else along the way, because, without them, you're not going to go very far. Otherwise, they're going to throw a lot of stones along the way.

So, that's another a huge challenge that we have from skills of the architect as you're going up -- considering everything else, but having this soul who would be sensitive to the other professions that are going along.

Gardner: Is it fair to say that the skill set of an architect, at perhaps a solution level or a technology level, is quite different from the skill set at that higher strategic level you mentioned, a priest-like bearing? How do you transition when the skill sets are different?

Uppal: Well, you need those skills at lower level. Those are just part of the game. They are no longer sufficient for you to do your job. Now, you have to have all of those skills, plus on top of it, you have to have more, and that's where it's more of a challenge for the architect, as we're going up. We're being accepted when we go up, but if we don't succeed there, being insensitive to all those other issues around, we will be sent back very quickly.

Gardner: David, what are you finding in your practice in terms of how people are grasping and grappling with the transition from a high level of technical skills to this more collaborative people type of skill set?

Foote: As I was talking about yesterday, I see so many parallels between the maturation of the CIO job with what's happening in EA.

Basically, true EA is a collaboration between the company's executives and everyone who works for them -- and they pay your salaries. They tell you when you are an enterprise architect. You don't tell them. They will tell you. They will put their arm around you and say, "You are one of us."

You're one of us

At the same time, you want the IT organization having their arms around you, saying, "You're one of us." The moment they tell you you're an architect is when you are an architect. At the moment, what Jason has said is really true.

In the total group of enterprise architects I've met, to a T, every one of them was a great communicator. They were able to really make people feel comfortable around some very abstruse, very abstract, and, for people who are not technical, very technical concepts. They just could communicate. They could set people at ease. They were nonthreatening, and by the way, most of them, I think, were really close to genius or über already.

You have to be über level to be an enterprise architect at this stage in the game, because there really isn't a good role description. The model would be what's happened with project managers. At some point, IT was trying to just teach them so much about project management, how good it was for the organization, much like architecture.

But, at one point the CFO learned that project management can really help me to integrate companies that we're acquiring and merging with. The moment the business discovered it, it was no longer an IT sort of discipline. It was a business corporate competency.

I would love to see that happen to architecture, to be just a natural corporate competency, so that IT could just give it away.

That for me really encapsulated the communications goal for an architect -- to make points about these complex issues so clear that people understand them and feel comfortable with them.

The greatest thing in the world is when you just give something away that you introduced and the business adopts it as if you never even gave it to them or you never really were at conferences like this. Where are the business people at this conference? Well, maybe five years from now they will be here -- the MBAs are whom I'm talking about.

Fehskens: Dana, if I might elaborate on something David said. I had a real "aha" moment. Before I came to The Open Group, I was the worldwide profession lead for the architecture profession at HP Services. One of the architects who I worked with on a fairly regular basis told me that the most satisfying moment in her career was when one of her clients told her, "You make me feel smart."

That for me really encapsulated the communications goal for an architect -- to make points about these complex issues so clear that people understand them and feel comfortable with them.

Gardner: I've heard IBM, in several instances, refer to the architect as having to be a team person and to have deep technical understanding and then horizontal understanding of the business. I want to put another axis on there for those people skills, and to be sensitive and effective in communication. These are very challenging roles, but if you can fill them, you might have yourself one fine career.

James, how do you position yourself to get into this? What's required, and what's the stepping-stone pattern in order to achieve this very fine challenging and well-paid position?

Community crying out

De Raeve: I think what you're asking for is the universally agreed professional framework for the enterprise architect, and I'll give it you the moment we have it.

The community is crying out for it. They may not know that they're asking for it, but they're asking for it. One of my things is that I have to go and sell our certification programs to people. So I visit a number of different organizations and explain what we're doing and what it means.

I've come away with the firm conclusion that we're way too soon in that process. They don't yet have methods of developing, growing, retaining, and managing their people and organizing them as professionals. They've got job definitions and all kinds of stuff from HR, but nothing that actually enables them to develop their architecture practice.

I go along with the idea of, "Well, here are all these criteria that a good competent architect should have, all these things about communication skills and architecture skills and technical knowledge, this whole panoply of stuff, and all of the experience." They say, "That's great -- if I knew whether we had anyone like that, or if I knew how to develop people like that, but we haven't got all of the rest of it."

My analogy is that we've got these certification things there, the cherry on the icing on a cake, but we don't have the icing and we don't have the cake. We need the professional frameworks that help organizations attract, develop, grow, and build these people into professionals. I think it's a gap.

Gardner: Len, you had something?

Fehskens: Yeah. I think one of the real challenges for an individual who aspires to be an architect is to get past the first hurdle, which is, you're usually not allowed to be an architect until you already are one.

Often, one of the ways you can get your foot into the architecture space is by taking on the responsibilities of program manager and acting like a program manager.

In my experience, all the people who started in this profession started acting as architects before somebody was willing to call them one, and that requires networking with architects who are willing to spend some time mentoring you and stepping into the architect role in complex projects.

In the architecture group at Digital -- Digital got acquired by Compaq, which got acquired by HP -- we used to joke that if you had a program without a program manager, the architect filled that role. If you had a program without an architect, the program manager filled that role.

There's a lot of symmetry between the program manger role and the architect role. Often, one of the ways you can get your foot into the architecture space is by taking on the responsibilities of program manager and acting like a program manager. Then, pushing that into the technical domain and starting to act like an architect.

When you start acting like an architect, as Dave pointed out, you're not really one until they tell you you are. But, you have to look like one before they will tell you you are one. The best way to do that is start behaving like one, and best way to do that is to learn by experience. You just put your foot in the water and go for it. As Nike says, "Just do it."

Gardner: So Jason, if this is an experience-based rather than a certification or rigorous predefined process towards architecture position, what is it that you've done in this experience side that allowed you to actually get in and convince people to give you the authority? How do you manage that transition?

Managing the transition

Uppal: That's an interesting question, and Len left it wide open for me to respond. Before Len called me an architect, about four-and-a-half years ago, I was an engineer for the longest time, and I worked as an engineer. That's your job. Nobody told you you were an architect or project manager. That was your degree and that was your title and that's what you did.

But, somewhere along the line, somebody came around and said, "Here are the performance criteria. If you pass all of these things, and we agree that you pass all these things, we'll call you an architect." That's what happened, Len called me an architect, and I became an architect that day.

Going back to "developing the skills" conversation -- how you got here -- if we step outside of the IT industry, you'll see a lot of parallels of other professionals being developed in the industry, very similarly to how we develop architects. Architect is not this nebulous thing that just grows. They are developed.

I remember when I first started working as an engineer. I worked for a French tire company.

All of that stuff that they taught you -- respect for the person who is doing the work -- still applies today as it did before.

We won't name any names, but one of the biggest challenge that they had is that it was a dirty job. Nobody wanted it. So they'd go to universities looking for engineers, bring them into the company, and teach them how to do the job. They would stay there six months and they would leave. That was not necessarily a good attrition. They had close to 100 percent attrition of the newly hired engineers.

Then, they looked at the skills of the people that they were trying to develop and they said, "We need to have people who understand our culture, our product, and our people. Then, we just need to give them some technical skills on how to do analysis."

That was an easy thing to do. So, we created an apprenticeship program. Since then, that organization has developed hundreds and thousands of industrial engineers who are continuous improvement engineers who know how to do things. I came out of that process and became an industrial engineer. From that I became an architect, because I had an affinity for applying information technology.

All of that stuff that they taught you -- respect for the person who is doing the work -- still applies today as it did before. That's one of the areas where, if we want to develop architects in IT, we have to step outside of IT into some of the other areas and learn from it. If you can somehow figure out how to show respect to the person who is doing the work today, we have a much easier time in developing the architects.

Gardner: David Foote, we could leave this to an organic process -- willy-nilly and ill defined -- or, to Jason's point, we could follow the lead of other career tracks. In other career tracks, it's not just the people that fill the positions who are involved. We have human resources (HR) departments, recruiters, and headhunters. In fact, you might have an entire industry setup in order to find, cultivate, and place people in these jobs. Why haven't we seen that with the enterprise architect?

Lack of understanding

Foote: Again, people really don't know who enterprise architects are. As much as you try, try, and try, you haven't reached the critical mass where the average HR department person, at least that we talk to -- and we talk to thousands of them -- really understand what they are.

What they think architects are is a title that all people in IT want to have, so they will get a better job offer. They know that architect is a hot, hot item. Just Google it, or go to anyMonster site or Dice or any of those. They make a lot of money. So what's happened is, without really grabbing hold and defining the architect, they've let the IT organization simply hand out these titles to people as a way to attract them to the organization.

The worst thing that you ever want to have happen to you in HR is the CIO to say, "Okay, we now have a solution architect in this area, whether we had one or not, we have one now. So, go and figure it out." That lack of control in HR is commonplace today. I tell HR organizations that if that's the question they have, send the best people.

You should have a representative to the HR organization that was selected by the CIO or the IT management there to represent them to HR. That person should be the person who advocates also for HR, so that they never are handed job descriptions that do not exist in the company. Then, a compensation person tries to figure out what to pay that person.

That's when they come to Foote partners, saying, "We don't know what to do?" What do we pay this person?" Call them whatever you want, but I can tell you what that solution architect should be making in your town.

You're probably going to be continuing to hire in this area. It might be a good time to just establish this as a job family, and then make sure that this doesn't happen again.

But, this is a workaround solution. Eventually, you're going to have to actually ordain this job, if you think you're going to have several of these in your company, I said, probably you will have. Let me talk to your IT department. If I talk to them I'll say, "You're probably going to be continuing to hire in this area. It might be a good time to just establish this as a job family, and then make sure that this doesn't happen again."

Mainly the lack of control is around job descriptions. Compensation is more egregious in architecture right now than it is in developers, database people, security people, and even voice engineers. They know what a voice engineer is more comfortably than an architect. So, it's just this natural progression.

But the last thing I want to say is, people still don't know what CIOs are. CIOs make anywhere from $25 million a year to $80,000, in our salary surveys. What a crazy job title. Yet, we've been able to exist very well with CIOs for any number of years.

Gardner: I was going to say, James de Raeve, this sounds a lot like what I heard in the CIO category ten years ago, where it was amorphous, and the skill and compensation scales were all over the map. But, over time, what became sort of a hot potato ended up being a very important role that most organizations seem to understand. Should we expect a similar track?

Early stage of maturity

De Raeve: Oh, absolutely. We're at an early stage in the maturity of this concept in the profession or in the industry. One of the roles of organizations, such as this, this community of people, is to try and help us evolve that, to get an understanding of what we mean by it and an understanding of how organizations should address this problem and develop their people. I think it's inevitable. We've got a long way to go. Maturity is needed, and we're in the very early days.

Gardner: Well, does it make sense then to look at the CIO role and say, "Here is what an architect is vis-à-vis it or in contrast to it. Is there a relationship that would help in this maturity process?

De Raeve: I'm not so sure that CIO is the right model. Maybe CTO would be a better match. But as the profession matures, we're also seeing enterprise architects become less technically focused and, as we talked about earlier, more strategically focused and more concerned about the business and less about the technology.

So, there is something to be learned by looking at how those professions developed, but I don't think the specific details of how they sorted themselves out apply directly to enterprise architects, because I think it's enough of a different role.

We used to joke that the best architects have their feet on the ground and their head in clouds,

The other thing is that architects are, by their nature, extremely adaptive, and they redefine themselves to fit into where there are gaps in the organization where there are needs.

and they span this gap from the business side to the implementation side, regardless of what the implementation technology is, not necessarily just IT. It's that extremely broad coverage that makes it really difficult to pin this discipline down and say it's just this.

I've often told people that I've tried unsuccessfully many, many times to tell my family what it is I do for a living. After a couple of sentences, their eyes just glaze over and they say, "Well, you drive a nice car. So, you must be successful." We've got that problem in general, as David pointed out. HR can't get their arms around it, because it's such a vaguely defined thing.

The other thing is that architects are, by their nature, extremely adaptive, and they redefine themselves to fit into where there are gaps in the organization where there are needs. They reshape themselves to address those needs. So, we're sort of like chameleons or shape-shifters, depending on what the organizational context is.

If you've got a whole bunch of people doing that, it's very hard to say, "You people are all basically performing the same role, because it will look different in some respect. See one person do it. It's even worse. So the only thing you could do is say, "Oh, shape-shifter, some kind of a magician."

Gardner: What strikes me that, if the role of the architect is so different from organization to organization that the org chart within those organizations is also very different, and we might have the architect reporting to different types of individuals from enterprise to enterprise. So Jason, among the architects that you know, is there a great variability in who they report to, or am I reading this wrong?

Based on behavior

Uppal: Who architects report to depends on how they behave. There are a lot of architects who behave like technocrats who report to the CTO. There are other architects who operate at a different level and they start reporting to the CIO, the CFO and even to the COO level. I know one very successful architect, he reports to the CEO, along with the CIO.

It's more how that group behaves, and also their EA practices maturity within the organization dictates how they behave and whom they report to. It has a lot to do with the maturity of the practice. In some of these organizations, the maturity of the practice depends on the maturity of the individuals. A couple of them are leading it, because as soon as you take them out of this thing, the whole thing is going to fall apart, because there is no talent in the organization to repeat it.

Foote: Let me add one thing to that. One of the things that we're not looking at is, there are a handful of industries -- it's becoming a much larger group now -- where the CIO and the COO are the same job. You see this in banking, financial services, and insurance. You're seeing it in healthcare. You're seeing it in education, in particular. Now, you're seeing it in retail and all these other places.

Those organizations, where the CIO and the COO are basically the same person, are the ones where you really see these hybrid enterprise architects that really are business/IT. When you meet them, you can't really tell.

A couple of them are leading it, because as soon as you take them out of this thing, the whole thing is going to fall apart.

A lot of it has to do with whether you are working in a company that has this hybrid, where the operations are under the control of a CIO, whether they have that title or not. Usually, they are vice chair, or they just call them an executive vice president or a senior vice president, as we've seen it in the United States. Usually, CIO is not the title unless they're speaking at a conference, but CIOs are separate. It's really important to understand, again, what kind of organization model you have and who is at the top?

Gardner: So, if we have a hard time standardizing the job of architect, perhaps we need to start at some standardization around the organization and the org chart. Is there an accepted methodological approach to setting up the IT department in the context of the business requirements, goals, and so forth, or are we still just sort of thrashing around in a storm, hoping to grab onto some life raft?

Anybody want to take that question? How do we mature the organization, not just necessarily the architect?

Fehskens: First, I'm not sure that standardization equates to maturity, but, again, it's this question about adaptability. My experience is that most organizational structures, at least with respect to who is in what job, have a lot more to do with politics and social chemistry than explicit engineering-driven design.

Gardner: But, aren't these really too important subjects to leave to the vagaries of personalities and popularity contests?

Ability to get along

Fehskens: You'd think so, but the reality is that if you have a perfectly rationally structured organization, and the people that you put into these roles are perfect for those particular roles, but they hate one another, it's not going to work. A feature of a successful architect is the ability to get along with everybody, including people that we would call uncharitable names, and just find some way to work successfully with them.

My attitude about architecture is pretty much that most of the stuff you have to deal with, you have no control over. So, you just have to accept it and figure out how to deal with it and cope with it. You pick your battles wisely and don't waste time trying to change things that you can't change. My experience has been that an awful lot of organizational structures are pretty much cast in concrete, and changing them to be optimal is very, very difficult. So, you just have to figure out how to cope.

Foote: The most frequent question we get right now from companies that have fairly advanced EA groups, is, "Where do I promote these people to?" In other words, they usually don't want to be in management, because they are too hands-on. Their next shot is really to be a director-level manager.

We've been coming up lately with a lot of interesting cases for where they go. They have a great organization, but they never planned for these architect/analyst types, and these are companies where the architects are really doing long-range planning. They're doing a five-year plan, and, usually, we a lot of Silicon Valley, Calif. technology companies is where we find these people.

Gosh, as the challenges of the environment are just going up and up and up, the organizations rely on their architects to be sufficiently flexible to be able to change shape, to adapt, and to adjust.

They're out there doing the strategic planning. The CIO is head of strategic planning in these companies. Maybe not in your company, but they don't know what to do. We just say, "Well, you create a distinguished engineer title or a distinguished architect title, and put them on the road. They should be evangelizing. They should be helping you build market share, not just the strategic plan. Put them out as marketers for the company, and they will probably do very well."

Gardner: How about putting this in the context of some of the other impacting trends in the industry -- ITIL, for example? Changing the character of the IT department from a cost center to a productivity center, a shared-service provider, a partnership in the organization, rather than some ivory tower or dark arts center. Doesn't that provide a springboard for the role of architect, and wouldn't that perhaps lead to maturity more than we've seen in the past? James.

De Raeve: Gosh, as the challenges of the environment are just going up and up and up, the organizations rely on their architects to be sufficiently flexible to be able to change shape, to adapt, and to adjust. So, yeah, I that's the driver, absolutely.

Gardner: External forces like ITIL and shared service, Len, are these going to add to more complexity and more chaos, or is it going to be more of a focusing impact?

Just do it

Fehskens: I tend to think it's the latter. Those kinds of things are a special case of commoditization, which is that after something is well enough understood that there really are, if not just one, at least a very small number of sensible ways to do it, you don't have to spend a whole lot of time thinking about it anymore, you just do it the right way.

We don't spend a whole lot of time each morning trying to figure out how to get dressed. You put your underwear on first, hopefully. Doing it any other way doesn't work. We've gradually learned those things about various aspects of the IT organization and of the organization as a whole.

So there's a whole lot of stuff that gets standardized, because it's appropriate to standardize it, because there's really no value in gratuitous variability anymore. It just makes sense to do it, get it over with, and do it the most efficient way possible. That stuff all generally becomes candidates for outsourcing.

The really interesting question becomes, what do you keep? Where is the stuff where that variability, that customization really makes sense in delivering strategic value to your organization?

One of the things that scares me sometimes about standardization is that premature standardization can be a real catastrophe.

Knowing what stuff you can safely commoditize and ultimately outsource, and what stuff you need to keep close to the vest is a really important decision that companies have to sort out. I think it will vary from industry to industry, and people just have to make smart decisions about that set.

One of the things that scares me sometimes about standardization is that premature standardization can be a real catastrophe, where you make things the same that really can't afford to be the same yet, because that's an opportunity for competitive differentiation. Every time you take away one of those opportunities, you close down your opportunities and the space that you have to move in and you limit your options. So, you have to be very smart about that stuff.

Gardner: We have a question from our audience, and it revolves around the outsourcing word that you brought up, Len. Isn't this all similar to the old role of management consultant? It begs further question of, is this something that, perhaps in a transitionary period like we're in, is best done from the outside?

Jason, what do you think? Is the role of architect something you should outsource, at least for a period of time?

The role of outsourcing

Uppal: That's an excellent question. There are a number of organization that I'm aware of that have actually flirted with the whole idea, because they are fairly good at ITIL and they are fairly good at COBIT, PMI, and all that stuff. At the same time, when they tackle a very fundamental issue for the organization, how to reengineer their entire business process, they don't have anybody in the organization who can step up to the plate and do it.

They have a hell of a time running a million dollar project, let alone running 10, 20, 50 million dollar thing. At that point, they started thinking that perhaps they should outsource this thing and bring somebody else from outside.

Then, they have another dilemma and say, "We decided fundamentally architecture is our internal competency and we have to have somebody internally." Then, they stick in this guy who has no idea about what to do with this thing, and the next thing is the whole thing falls apart. Then, they say, "Well, we did the architecture thing, and it doesn't work.

One of the things that we found is that a number of architectural activities that they thought they were uniquely theirs, are commodity.

Some of the organizations are going to do that first part, bring somebody from outside for a short period and get them started to understand the value of it and also understand what is it going to take for them to institutionalize that practice. Then, they'll take the next step, building their own capacity and capability, only to the point that they need to build.

One of the things that we found is that a number of architectural activities that they thought they were uniquely theirs, are commodity. They didn't have to have them. If you're implementing SAPor Oracle, do you really need to own a SAP solution architect in-house? How many times are you going to implement SAP in house? That's a commodity that exists out in the marketplace.

Those are the kind of things that organizations have dealt with. Bringing somebody from outside for a short time is critical, but also understand that it's a short time. Don't turn that consultant into your staff over the next two years. Then, you're just paying a lot of money for this person who should be an employee. That consultant becomes very useless in about two years, because he knows nothing other than your organization.

Gardner: David Foote, what's your position on this insource, outsource, or hybrid approach?

Foote: There are definitely some activities in architecture that you can't outsource. I wouldn't say that you can't outsource it, but most companies that we talk to say, "We like our architects. They've done very well, because we trust them. The business trusts them. We trust them. They are good channels of communication. They've opened up a lot of thought in our company. We'd really like three times more of these people. How do we accelerate the growth internally?"

Keeping core competency in house

They want to know how they can develop architects internally, because they know that they're not going to get that same quality. Now, these are people who are architecting out of that very delicate core competency, strategic level that you don't want to share with outsiders -- for a lot of reasons.

By the way, one of the things that we talked about when populating the panel is that I said I had an interesting experience at a conference, where they had a headhunter on that did chief security officers. But, I've never met a recruiter who specialized in architects. I don't know that those recruiters exist. They probably don't, because there isn't a lot of demand on the outside for hiring architects.

One of the big differences between management consultant and enterprise architects is that what you put on the table, you have to execute.

I do think the architects that I see that are brought in from outside are often consultants, formerly of Accenture, IBM, CSC, or one of the large houses. They are brought in basically to calm down the chatter, to educate, and train. They're there to cleanup a fire, to calm things down, get people on the same page, and then go. Sometimes, that's the best way to bring in an architect.

Gardner: To the point of the question here, that does sound a lot like management consultant. James or Len, what's your position on that?

Fehskens: In a couple of conversations that I've had with people about where we seem to be evolving the role of enterprise architect, they have said basically, "Yeah, these people are going to become in-house management consultants and they're going to be better for that. They're going to know your business intimately, because they're going to have participated in strategic evolution over time."

There is a lot of merit in that analogy and a lot of similarity. I think the only difference is that what we're trying to do with EA is bring more of engineering rigor and engineering discipline to this domain and less of the touchy, feely, "do it because I think it's the right thing to do" kind of stuff -- not to disparage management consultants and the like.

Uppal: One of the big differences between management consultant and enterprise architects is that what you put on the table, you have to execute. The management consultant says, "You should do this, this, and this," and walks away. At the end of the day, if you, as an architect, put something on the table and you can't execute this thing, you have basically zero value. People are no longer buying management consultants at face value. They want you to execute.

Look to the boutiques

Foote: But they are buying people with consulting talent -- management consultants, because they have consultative talent. When I said bring somebody from Accenture or IBM, I didn't mean from those companies, but rather formerly of those companies, consultants who now are on their own in boutiques.

If you want to look at how to grow a lot of the stuff -- not just architecture, but a lot of areas that are having trouble with definition -- it's the boutiques. They are excellent. Some of these people who used to work with these companies were constrained by the frameworks and programs they had to work with and they went out and created it as it should be.

If you're lucky enough to find one of these and they're not research constrained -- because everybody else wants to have them come in and help them -- you've done a good thing. Always look for the smaller firms, if you're going to bring in any consultants.

Gardner: James, for those folks who have been listening and think they've got the right stuff, where do they go to help convince the rest of the world they have the right stuff? Where do you get started on this beyond some of the traditional and organic approaches we've heard?

De Raeve: This was the very problem that we were given when developing our certification.

So, we provide a lot of material that enables you to actually come to grips with what best practice things are, a set of core skills, competencies, and experiences that are needed by successful architects.

programs. How do we determine whether someone with a business card or a title that's got architect in it actually is an architect? What do we mean by that? How do we manage and control that?

In response to that, we developed our IT Architect Certification Program (ITAC) for the skills and experience, the ITAC Program, and we also have the TOGAF program, which is more about knowledge. What those programs do and the real value of those programs is twofold.

We've got some documentation, which defines what those skills and experience levels are. You can look at that, if you're practicing architecture or you are in the architecture space. You could look at that stuff and say, "These are really good things that I ought to be drawing from as I work on my definitions of roles, or as I look at recruiting people or developing or promoting people." The certification is a separate piece of value.

So, we provide a lot of material that enables you to actually come to grips with what best practice things are, a set of core skills, competencies, and experiences that are needed by successful architects.

Seeing results

Then, there is the certification piece, which allows individuals to be recognized for having met those criteria at different levels. We're trying our best to and introduce the idea of certification for architects into recruitment or procurement, and we're having some results. That's an ongoing piece of work, as we're fairly new in this certification. This professional level is pretty new.

So, we've got the two things: tools to enable organizations to start understanding what best practice is in the space, and then the certification program that allows people to communicate to their customers, their employers, and their next employer that they actually possess these skills and competencies.

Gardner: David Foote, these certification programs aren't the same as a vendor or supplier type of highly focused technical certifications. This is something quite different.

Foote: Yeah, it is. The certification industry has been on a decline lately. The reason why is that certification, for the most part, was an industry created by vendors who wanted to sell and resell their products. In that sense, the certification group is always in the marketing department of any company. Name one vendor, and I don't know any certification group that is not in the sales and marketing departments.

Then there came this whole group of vendor independent certifiers of talent, like in project management and architecture. These are extremely important. These are probably the survivors. Microsoft's certified architect program showed up very high in a recent survey of ours, and we put it on our hot list. I felt bad about that, because The Open Group also has excellent architecture certifications.

The reason a vendor can show up and create a lot of buzz around their products is because they have an enormous amount of money to sell their programs to their vendors. Microsoft evangelizes their products through all of their certification programs. This isn't to say that it's not good to have a certification, but the foundation is to evangelize the Microsoft point of view, and they're very successful at that.

The independents, if they're in competition with a vendor, won't be able to have the resources to get to market, to get the word out. On the other hand, they can create exceptional education and training programs. In architecture, though, if you create a program that caters too much to IT at the exclusion of business, and you are selling EA certification, you're not going to develop the profession.

Three people came up to me at this conference yesterday and today. They were enterprise architects who said, "Should I get an MBA?" Great question. How many of you have MBAs in the room? You're well positioned for the future of EA. You need to be able, if anything, to speak the language of business and make them feel comfortable about you.

But, in general, I'm very bullish on vendor-independent certifications, because you guys have to work so much harder. I have so much respect for The Open Group, and it's where I send anybody who talks to me about educating, training, or wanting to learn more about the profession.

I don't think there is anybody else really to go to, unless they're a Microsoft shop, and they've got a ton of Microsoft stuff. Then, I would say they might want to consider them too. I'm sure it's an excellent certification, but The Open Group has a great opportunity, and as long as they can expand, these MBAs.

Gardner: Well, thanks. I'm afraid we're about out of time. I want very much to thank our panel. We've been joined by James de Raeve, vice president of certification for The Open Group. Len Fehskens, vice president for Skills and Capabilities at The Open Group. David Foote, CEO, co-founder and chief research officer at Foote Partners. And, Jason Uppal, chief architect at QRS. Thank you to everyone.

This is Dana Gardner, principal analyst at Interarbor Solutions. We're coming to you from The Open Group's 23rd Enterprise Architecture Practitioners Conference in Toronto, the week of July 20, 2009. Thanks for listening, and come back next time.

Listen to the podcast. Find it on iTunes/iPod and Podcast.com. Download the transcript. Sponsor: The Open Group.

Transcript of a BriefingsDirect sponsored podcast on the role, qualifications, and career paths of enterprise architects. Recorded live at The Open Group's 23rd Enterprise Architecture Practitioners Conference and 3rd Security Practitioners Comference in Toronto. Copyright Interarbor Solutions, LLC, 2005-2009. All rights reserved.