Wednesday, February 09, 2011

Examining the Current State of the Enterprise Architecture Profession With The Open Group's Steve Nunn

Transcript of a sponsored podcast discussion on enterprise architecture and current moves toward gaining greater status as a profession from The Open Group 2011 U.S. Conference.

Listen to the podcast. Find it on iTunes/iPod and Podcast.com. Download the transcript. Sponsor: The Open Group.

Dana Gardner: Hi, this is Dana Gardner, Principal Analyst at Interarbor Solutions, and you're listening to BriefingsDirect.

Today, we present a sponsored podcast discussion in conjunction with The Open Group Conference held in San Diego, the week of February 7, 2011. We're here with an executive from The Open Group to examine the current state of enterprise architecture (EA). We'll hear about how EA is becoming more business-oriented and how organizing groups for the EA profession are consolidating and adjusting. [Disclosure: The Open Group is a sponsor of BriefingsDirect podcasts.]

We'll get an update on The Association of Open Group Enterprise Architects (AOGEA) and learn more about its recent merger with the Association of Enterprise Architects. What's more, we'll get an assessment of the current maturity levels and overall professionalism drive of EA, and we're going to learn more about what to expect from the EA field and these organizing groups over the next few years.

Here to help us delve into the current state of EA, please join me now in welcoming Steve Nunn, Chief Operating Officer of The Open Group and CEO of The Association of Open Group Enterprise Architects.

Welcome back, Steve.

Steve Nunn: Hi, Dana. Good to be back.

Gardner: We're hearing an awful lot these days about EA being dead, outmoded, or somehow out of sync. I know there's a lot more emphasis on the business issues, rather than just the technical or IT issues, but what's going on with that? Are we at a point where this topic, this professional category, is in some danger?

Nunn: Absolutely not. EA is very much the thing of the moment, but it's also something that’s going to be with us for the foreseeable future too. Both inside The Open Group and the AOGEA, we're seeing significant growth and interest in the area of EA. In the association, it’s individuals becoming certified and wanting to join a professional body for their own purposes and to help the push to professionalize EA.

Within The Open Group it’s entities and organizations. Whether they be commercial, governments, academic, they are regularly joining The Open Group Architecture Forum. So, it's far from dead and in terms of the importance of business overall, EA being relevant to business.

Tomorrow's plenary session here at the conference is a good example. It's about using EA for business transformation. It's about using EA to tie IT into the business. There is no point in doing IT for IT's sake. It's there to support the business, and people are finding that one way of doing that is EA.

Gardner: I would think too Steve that some of the major trends around mobile, security, and cyber risk would augment the need for a more holistic governing role, and the architect seems to fit that bill quite nicely. So is there wind in your sails around some of these trends?

Central to the organization

Nunn: Absolutely. We're seeing increasingly that you can't just look at EA in some kind of silo. It's more about how it fits. It's so central to an organization and the way that organizations are built that it has all of the factors that you mentioned. Security is a good one, as well as cloud. They're all impacted by EA. EA has a role to play in all of those.

Inside the Open Group, what's happening is a lot of cross-functional working groups between the Architecture Forum, the Security Forum, and the Cloud Work Group, which is just recognition of that fact. But, the central tool of it is EA.

Gardner: In addition to recognizing that the function of the EA is important, you can't just have people walking the door and say, well, I'm an enterprise architect. It's hard to define the role, but it seems necessary. Tell me about the importance of certification, so that we really know what an enterprise architect is.

Nunn: That’s right. Everyone seems to want to be an enterprise architect or an IT architect right now. It's that label to have on your business card. What we're trying to do is separate the true architects from one of these, and certification is a key part of that.

If you're an employer and you're looking to take somebody on to help in the EA role, then it’s having some means to assess whether somebody really has any experience of EA, whether they know any frameworks, and what projects they've led that involve EA. All those things are obviously important to know.

One of the great things we see is the general acceptance of certification as a means to telling the wood from the trees.



There are various certification programs, particularly in The Open Group, that help with that. The TOGAF Certification Program is focused on the TOGAF framework. At the other end of the spectrum is the ITAC Program, which is a skills and experience based program that assesses by peer review an individual’s experience in EA.

There are those, there are others out there, and there are more coming. One of the great things we see is the general acceptance of certification as a means to telling the wood from the trees.

Gardner: So, we certainly have a need. We have some major trends that are requiring this role and we have the ability to begin certifying. Looking at this whole professionalism of EA, we also have these organizations. It was three years ago this very event that The AOGEA was officially launched. Maybe you could tell us what’s happened over the past three years and set the stage for what’s driving the momentum in the organization itself?

Nunn: Three years ago, we launched the association with 700 members. We were delighted to have that many at the start. As we sit here today, we have over 18,000 members. Over that period, we added members through more folks becoming certified through not only The Open Group programs, but with other programs. For example, we acknowledged the FIAC Certification Program as a valid path to full membership of the association.

We also embraced the Global Enterprise Architecture Organization (GEAO), and those folks, relevant to your earlier question, really have a particular business focus. We've also embraced the Microsoft Certified Architect individuals. Microsoft stopped its own program about a year ago now, and one of the things they encouraged their individuals who were certified to do was to join the association. In fact, Microsoft would help them pay to be members of the association, which was good.

So, it reflects the growth and membership reflects the interest in the area of EA and the interest in individuals' wanting to advance their own careers through being part of a profession.

Valuable resource

Enterprise architects are a highly valuable resource inside an organization, and so we are both promoting that message to the outside world. For our members as individuals what we're focusing on is delivering to them latest thinking in EA moving towards best practices, white papers, and trying to give them, at this stage, a largely virtual community in which to deal with each other.

Where we have turned it in to real community is through local chapters. We now have about 20 local chapters around the world. The members have formed those. They meet at varying intervals, but the idea is to get face time with each other and talk about issues that concern enterprise architects and the advancement of profession. It’s all good stuff. It’s growing by the week, by the month, in terms of the number of folks who want to do that. We're very happy with what has gone in three years.

Gardner: We've got a little bit of alphabet soup out there. There are several organizations, several communities, that have evolved around them, but now you are working to bring that somewhat together.

As I alluded to earlier, the AOGEA has just announced its merger with the Association of Enterprise Architects (AEA). What’s the difference now? How does that shape up? Is this simply a melding of the two or is there something more to it?

Nunn: Well, it is certainly a melding of the two. The two organizations actually became one in late fall last year, and obviously we have the usual post merger integration things to take care of.

As we develop, we're getting closer to our goal of being able to really promote the profession of EA in a coherent way.



But, I think it’s not just a melding. The whole is greater than the sum of the parts. We have two different communities. We have the AOGEA folks who have come primarily through certification route, and we also have the AEA folks who haven’t been so, so focused on certification, but they bring to the table something very important. They have chapters in different areas than the AOGEA folks by and large.

Also, they have a very high respected quarterly publication called The Journal of Enterprise Architecture, along the lines of an academic journal, but with a leaning towards practitioners as well. That’s published on a quarterly basis. The great thing is that that’s now a membership benefit to the merged association membership of over 18,000, rather than the subscribed base before the merger.

As we develop, we're getting closer to our goal of being able to really promote the profession of EA in a coherent way. There are other groups beyond that, and there are the early signs of co-operation and working together to try to achieve one voice for the profession going forward.

Gardner: And this also followed about a year ago, the GOAO merger with the AOGEA. So, it seems as if we're getting the definitive global organization with variability in terms of how it can deal with communities, but also that common central organizing principle. Tell me about this new über organization, what are you going to call it and what is the reach? How big is it going to be?

Nunn: Well, the first part of that is the easy part. We have consulted the membership multiple times now actually, and we are going to name the merged organization, The Association of Enterprise Architects. So that will keep things nice and simple and that will be the name going forward. It does encompass so far GEAO, AOGEA and AEA. It's fair to say that, as a membership organization, it is the leading organization for enterprise architects.

Role to play

There are other organizations in the ecosystem who are, for example, advocacy groups, training organizations, or certification groups, and they all have a role to play in the profession. But, where we're going with AEA in the future is to make that the definitive professional association for enterprise architects. It's a non-profit 501(c)(6) incorporated organization, which is there to act as the professional body for its members.

Gardner: You have been with The Open Group for well over 15 years now. You've seen a lot of the evolution and maturity. Let’s get back to the notion of the enterprise architect as an entity. As you said, we have now had a process where we recognize the need. We've got major trends and dynamics in the marketplace. We have organizations that are out there helping to corral people and manage the whole notion of EA better.

What is it about the maturity? Where are we in a spectrum, on a scale of 1 to 10? What does that mean for where there is left go? This isn’t cooked yet. You can't take it out of the oven quite yet.

Nunn: No, absolutely no. There's a long way to go, and I think to measure it on a scale of 1 to 10, I'd like to say higher, but it's probably about 2 right now. Just because a lot of things that need to be done to create profession are partly done by one group or another, but not done in a unified way or with anything like one voice for the profession.

It's interesting. We did some research on how long we might expect to take to achieve the status of a profession. Certainly, in the US at least, the shortest period of time taken so far was 26 years by librarians, but typically it was closer to 100 years and, in fact, the longest was 170-odd years. So, we're doing pretty well. We're going pretty quickly compared to those organizations.

There's a long way to go, but we've made good progress in a short numbers of years, really.



We're trying to do it on a global basis, which to my knowledge is the first time that's been done for any profession. If anything, that will obviously make things a little more complicated, but I think there is a lot of will in the EA world to make this happen, a lot of support from all sorts of groups. Press and analysts are keen to see it happen from the talks that we've had and the articles we've read. So, where there is a will there is a way. There's a long way to go, but we've made good progress in a short numbers of years, really.

Gardner: So, there's a great deal of opportunity coming up. We've talked about how this is relevant to the individual. This is something good for their career. They recognize a path where they can be beneficial, appreciated, and valued. But, what's in it for the enterprise, for the organizations that are trying to run their businesses dealing with a lot of change already? What does a group like the AEA do for them?

Nunn: It's down to giving them the confidence that the folks that they are hiring or the folks that they are developing to do EA work within their enterprise are qualified to do that, knowledgeable to do that, or on a path to becoming true professionals in EA.

Certainly if you were hiring into your organization an accountant or a lawyer, you'd be looking to hire one that was a member of the relevant professional body with the appropriate certifications. That's really what we're promoting for EA. That’s the role that the association can play.

Confidence building

When we achieve success with the association is when folks are hiring enterprise architects, they will only look at folks who are members of the association, because to do anything else would be like hiring an unqualified lawyer or accountant. It's about risk minimization and confidence building in your staff.

Gardner: Now, you wear two hats. You're the Chief Operating Officer at The Open Group and you're the CEO of the AEA. How do these two groups relate? You're in the best position to tell us what's the relationship or the context that the listeners should appreciate in terms of how these shakeouts?

Nunn: That’s a good point. It's something that I do get asked periodically. The fact is that the association, whilst a separately incorporated body, was started by The Open Group. With these things, somebody has to start them and The Open Group's Membership was all you needed for this to happen. So, very much the association has its roots in The Open Group and today still it works very closely with The Open Group in terms of how it operates and certain infrastructure things for the association are provided by The Open Group.

The support is still there, but increasingly the association is becoming a separate body. I mentioned the journal that’s published in the association's name that has its own websites, its own membership.

It's one of the leading organizations in the EA space and a group that the association would be foolish not to pay attention to.



So, little by little, there will be more separation between the two, but the aims of the two or the interests of the two are both served by EA becoming recognized as profession. It just couldn't have happened without The Open Group, and we intend to pay a lot of attention to what goes on inside The Open Group in EA. It's one of the leading organizations in the EA space and a group that the association would be foolish not to pay attention to, in terms of the direction of certifications and what the members, who are enterprise architects, are saying, experiencing, and what they're needing for the future.

Gardner: So, I suppose we should expect an ongoing partnership between them for quite some time.

Nunn: Absolutely. A very close partnership and along with partnerships with other groups. The association is not looking to take anyone's turf or tread on anyone’s toes, but to partner with the other groups that are in the ecosystem. Because if we work together, we'll get to this profession status a lot quicker, but certainly a key partner will be The Open Group.

Gardner: Well, very good. We have been looking at the current state of EA as profession, learning about the organizing groups around that effort and the certification process that they support. We've been talking with Steve Nunn, the Chief Operating Officer at The Open Group and also the CEO of the newly named Association of Enterprise Architects. Thank you so much, Steve.

Nunn: Thank you, Dana.

Gardner: You've been listening to a sponsored BriefingsDirect podcast coming to you in conjunction with the Open Group Conference here in San Diego, the week of the February 7, 2011. This is Dana Gardner, Principal Analyst at Interarbor Solutions. Thanks for joining, and come back next time.

Listen to the podcast. Find it on iTunes/iPod and Podcast.com. Download the transcript. Sponsor: The Open Group.

Transcript of a sponsored podcast discussion on enterprise architecture and current moves toward gaining greater status as a profession from The Open Group 2011 U.S. Conference. Copyright Interarbor Solutions, LLC, 2005-2011. All rights reserved.

You may also be interested in:

Wednesday, January 12, 2011

Move to Cloud Increasingly Requires Adoption of Modern Middleware to Support PaaS and Dynamic Workloads

Transcript of a sponsored BriefingsDirect podcast on how to modernize infrastructure to enable IT to become better "business service factories."

Listen to the podcast. Find it on iTunes/iPod and Podcast.com. Download the transcript. Sponsor: WSO2.

Learn more about WSO2 and cloud management
Download "Effective Cloud Management with WSO2 Strategies"
More information on WSO2 Stratos
Attend a WSO2 SOA Workshop to Energize your Business with SOA and Cloud

Dana Gardner: Hi, this is Dana Gardner, Principal Analyst at Interarbor Solutions, and you're listening to BriefingsDirect.

Today, we present a sponsored podcast discussion on the role and importance of private cloud infrastructure models as a stepping stone to much needed new operational models for IT.

A lot of the interest in cloud computing generally has been as much about a wish to escape the complex and wasteful ways of the old as an embrace of something well understood and new. [Disclosure: WSO2 is a sponsor of BriefingsDirect podcasts.]

So, how do large enterprises remake themselves into business service factories? How do they modernize IT and Internet-enabled ecosystem processes in the same ways that industrial engineering, lean manufacturing, efficiency measurement, just-in-time inventory, and various maturity models revolutionized bricks and mortar businesses a generation ago?

This larger question of how to attain IT transformation is what cloud computing purports to answer. But, the question itself may be more important than any yet defined answer. If public cloud computing is an end goal that provides a catalyst to such needed general transformation, all ends well and good.

Meanwhile, what of the practical steps that can help an organization now? How can enterprises learn to adopt new services sourcing models as well as to attain the means for better consumption of services, regardless of their origins?

Today, we’ll examine how enterprises can appreciate the transformative role of private cloud, and begin to focus on dynamic workloads and agile middleware as essential enablers along the way to even larger process-level business benefit -- and then ultimately to a more fully cloud-based IT models.

To discuss how workload assembly in the private cloud domain provides a big step in the right direction for IT’s future, we're joined by Paul Fremantle, the UK-based Chief Technology Officer and co-founder of WSO2. Welcome, Paul.

Paul Fremantle: Hi, Dana. How are you doing?

Gardner: I'm well, thank you. We are also here today with Paul O’Connor, Chief Technology Officer at ANATAS International in Sydney, Australia. Welcome to you as well, Paul.

Thanks, Dana.

Gardner: Paul O’Connor, tell me a little bit about why a transformative new approach to IT is necessary. It seems as if incremental improvement is just not good enough.

Past failures

O'Connor: It’s unfortunate, but it’s fair to say that all of the past initiatives that we tried in
large, complex enterprises have been a failure. In some cases, we’ve actually made things worse.

Large enterprises, at the same time, still have to focus on efficiency, agility, and delivery to their end users, so as to achieve market competitiveness. We still have that maniacal focus on delivery and efficiency, and now some new thinking has come in.

Specifically, we have cloud or the everything-as-a-service operating model coupled with a series of other trends in the industry that are being bolted together for a final assault on meaningful efficiency. You hit the nail on the head when you mentioned industrial engineering, because industrial engineering is the organizing principle for weaving all of these facets together.

When we focus on industrial engineering, we already have an established pattern. The techniques are now lean manufacturing, process improvement and measurement of efficiency, just-in-time inventory, maturity models. Ultimately, large enterprises are now approaching the problem effectively including cloud, including moving to new operating models. They're really focusing on building out that factory. I'm sure we’ll be able to tease out some of those specifics at a slightly lower level of detail as the podcast goes on.

IT itself is transformative and you have to be pushing the boundaries in order to compete in the modern world.



Gardner: Well, great. Maybe you could also tell us a little bit more about ANATAS International; what sort of organization is that and what do you do there?

O'Connor: I'm CTO. We serve the Asia-Pacific region and have focused for a number of years on next-gen architecture -- technical architecture, enterprise architecture and service oriented architecture (SOA). In the last couple of years, we’ve been focusing as well on cloud, and on how these things come together to give us a shot at being more efficient in large complex enterprises.

Gardner: Paul Fremantle, why do you think that the idea of cloud computing has really caught on, whether it’s private cloud, public cloud, platform as a service (PaaS), or infrastructure as a service (IaaS)?

We're adding more "as services" all the time, but this really seems to have just caught in people’s attention in the last two or three years, and seems to be gaining. It doesn’t seem to be waning. Is it this need for a transformative approach that has made cloud somewhat of a silver bullet? Why is this so important to people?

Fremantle: It’s a fairly straightforward story. We've discovered that you cannot just build an IT
system or an IT infrastructure, put your feet up, sit back, and say, "Well, that will do the business," because the business has learned that IT itself is transformative and you have to be pushing the boundaries in order to compete in the modern world.

Effectively, it’s no longer good enough to just put in a new system in every 5 or 10 years and sit back and run it. People are constantly pushing to create new value to build new processes, to find better ways of using what they have, linking it together, composing it, and doing new things.

So the speed of delivery and the agility of organizations have become absolutely key to their competitiveness and fundamentally to their stock price. A huge move in agility came first with web, with portals, and with SOA. People discovered that, rather than writing things from scratch, they could reuse, they could reconfigure, and they could attach things together in new ways to build function. As they did that, the speed of development and the speed of creating these new processes has skyrocketed.

Unfortunately, the speed and agility of the infrastructure and of the ability to take these things and host them has not kept up. What cloud has done is that it has suddenly energized the infrastructure, energized the platform, and has given people a way of not just building things quickly but hosting them, deploying them, and managing them in an agile way. Fundamentally, what’s driving the cloud revolution is speed of delivery.

Gardner: I’ll go back to Paul O’Connor with his comments about architecture. As we do what Paul Fremantle has suggested, we seem to also hit up against scale. Automation needs to kick in, and that can perhaps only be best attained through an architecture built for scale. How do the modern platforms and systems that Paul Fremantle is discussing provide a catalyst, or at least a cohort, to this need for better architecture, Paul O’Connor?

Better architecture

O'Connor: When we say better architecture, I think what we are talking about is the facets of
architecture that are about process, that are about that how you actually design and build and deliver. At the end of the day, architecture is about change, and it must be agile. I can architect a fantastic Sydney Opera House, but if I can't organize the construction materials to show up in a structured way, then I can’t construct it. Effectively, we’ve embraced that concept now in large enterprises.

Specifically in IT, we find coming into play around this concept a lot of the same capabilities that we’ve already developed, some of which Paul alluded to, plus things like policy-based, model-driven configuration and governance, management and monitoring and asset metadata, asset lifecycle management types of things relative to services and the underlying assets that are needed to actually provision and manage them.

We're seeing those brought to bear against the difficult problems of how might I create a very agile architecture that requires an order of magnitude less people to deliver and manage.

It helps with problems like this: How can I keep configured a thousand end-points in my enterprise, some of which might be everything from existing servers and web farms all the way up to instances of lean middleware like WSO2 that I might spin up in the cloud to process large workloads and all of the data associated with it?

Gardner: I suppose also, Paul Fremantle, that a secondary or additional motivator at this time is the need for pervasive security, for baking security and governance in across the board, not as a bolt-on, not as an afterthought, not as some sort a requirement of that is separate and distinct from the entire IT lifecycle.

There's an opportunity to turn that from a negative into a positive by fundamentally building secure systems from day one, rather than just relying on them being secure from where they are located, which is kind of the current model.



So, is there also a bit of a catalyst when it comes to making security pervasive that's also driving folks to better architecture and more agile middleware that will perhaps ultimately move toward a cloud-based model?

Fremantle: Absolutely. The biggest concern in everyone's mind around cloud is security. I think there's an opportunity to turn that from a negative into a positive by fundamentally building secure systems from day one, rather than just relying on them being secure from where they are located, which is kind of the current model.

I'm a firm believer that the real success in cloud is going to come from designing systems that are inherently built to run in the cloud, whether that's about scale, elasticity, security, or things like multi-tenancy and self-service.

Those concepts of building things that run in the cloud and making the software inherently cloud aware, comes back to what Paul O'Connor was talking about with regard to having the right architecture for the future and for the cloud.

Gardner: So, when we look at security as a positive, rather than a negative, as we transform and transition with cloud models, is there more than one layer or level of security? How do we approach this? How do we get our hands around it, so that it can be something that's implemented, rather than almost just at the division or abstract level?

Federated security

F
remantle: The first and most important thing is to use middleware and models that are designed around federated security. This is just a simple thing. If you look back at middleware, for example message queuing products from 10 years ago, there was no inherent security in them.

If you look at the SOA stack and the SOAP models or even REST models, there are inherent security models such as WS-Trust, WS-SecureConversation, or in the REST model things like SAML2, OAuth and OpenID. These models allow you to build highly secure systems.

But, however much I think it's possible to build secure cloud systems, the reality is that today 90 percent of my customers are not willing or interested in hosting things in a public cloud. It’s driving a huge demand for private cloud. That’s going to change, as people gain confidence and as they start to protect and rebuild their systems with federated security in mind from day one, but that's going to take some time.

Gardner: Paul O’Connor, do you share Paul Fremantle's concept that good architecture and building for cloud models has an inherent security benefit to it? Are you at ANATAS also architecting for both security and a services factory model?

O'Connor: Absolutely. You're not allowed to do anything in large enterprises architecturally without getting past security. When I say get past security, I'm talking about the people who have magnifying glasses on your architectural content documents. It's important enough to say again what Paul brought out about location not being the way to secure your customer data anymore.

The reality is that today 90 percent of my customers are not willing or interested in hosting things in a public cloud. It’s driving a huge demand for private cloud.



The motivation for a new security model is not just in terms of movement all the way to the other end of the agility rainbow, where in a public cloud you’re mashing up some of your data with everybody else's, potentially, and concerned about it going astray.

It’s really about that internal factory configuration and design that says, even internally in large enterprises, I can't rely on having zones of network security that I pin my security architecture to. I have to do it at the message level. I have to use some of the standards and the technologies that we've seen evolved over the past five, six, seven years that Paul Fremantle was referencing to really come to bear to keep me secure.

Once I do that, then it's not that far of a leap to conceive of an environment where those same security structures, technologies, and processes can be used in a more hybrid architecture, where maybe it's not just secure internal private cloud, but maybe it's virtual private cloud running outside of the enterprise.

That brings in other facets that we really have to sort out. They have to do with how we source that capacity, even if it's virtual private cloud or even if it's tenanted. We have to work on our zone security model that talks about what's allowed to be where. We have to profile our data and understand how our data relates to workloads.

As Paul mentioned, we have to focus on federated identity and trust, so identity as a service. We have to assemble the way that processing environments, be they internal or external, get their identities, so that they can enforce security. PKI, and, this is a big one, we have to get our certificates and private keys into the right spot.

Policy-driven governance

Once we build all those foundations for this, we then have to focus on policy-driven governance of how workloads are assembled with respect to all of those different security facets and all of the other facets, including quality of service, capacity, cost, and everything else. But, ultimately yes, we can solve this and we will solve this over the next few years. All this makes for good, effective security architecture in general. It's just a matter of helping people, through forums like this, to think about it in a slightly different way.

Gardner: As we're moving toward new kinds of architectures that can be inclusive of the past, but prepare us better for the future with this full set of requirements in terms of scalability, security, openness to sourcing elasticity, and so forth, what do we need to look for in terms of the underlying infrastructure itself?

Are there some key requirements that we would look for in terms of how the performance, technical characteristics, standard support, all come together in such a way that we can move forward including compatibility with what's in place -- and still start meeting up with what we want around performance, the sourcing flexibility and security? Let me take that first to Paul Fremantle. What needs to be in place?

Fremantle: I believe that the world has slightly gone backward, and that isn't actually that surprising. When people move forward into such a big jump as to move from a fixed infrastructure to a cloud infrastructure, sometimes it's kind of easy to move back in another area. I think what's happened to some extent is that, as people have moved forward into cloud infrastructure, they have tended to build very straightforward monolithic applications.

The way that they have done that is to focus on, "I'm going to take something standalone and simple that I can cloud-enable and that's going to be my first cloud project." What's happened is that people have avoided the complexity of saying,"What I really need to be doing is building composite applications with federated identity, with business process management (BPM), ESB flows, and so forth."

Learn more about WSO2 and cloud management
Download "Effective Cloud Management with WSO2 Strategies"
More information on WSO2 Stratos
Attend a WSO2 SOA Workshop to Energize your Business with SOA and Cloud

And, that's not that surprising, when they're taking on something new. But, very rapidly, people are going to realize that a cloud app on its own is just as isolated as an enterprise app that can't talk to anything.

The result is that people are going to need to move up the stack. At the moment, everyone is very focused on virtual machines (VMs) and IaaS. That doesn't help you with all the things that Paul O'Connor has been talking about with architecture, scalability, and building systems that are going to really be transformative and change the way you do things.

From my perspective, the way that you do that is that you stop focusing on VMs and you try and move up a layer, and start thinking about PaaS instead of IaaS.

You try to build things that use inherent cloud capabilities offered by a platform that give you scalability, federated security, identity, billing, all the things that you are going to need in that cloud environment that you don't want to have to write and build yourself. You want a platform to provide that. That's really where the world is going to have to move in order to take the full advantage of cloud -- PaaS.

Gardner: Paul O'Connor, from your perspective, what are some key characteristics that that platform should have? What are the necessary ingredients in order to make this automated, controllable, governed, and to scale across these new sourcing models that we're approaching?

The name of the game

O'Connor: I totally agree with everything Paul Fremantle just said. PaaS is the name of the game. If you go to 10 large enterprises, you're going to find them by and large focusing on IaaS. That's fine. It's a much lower barrier of entry relative to where most shops are currently in terms of virtualization.

But, when you get up into delivering new value, you're really creating that factory. Just to draw an analogy, you don't go to an auto factory, where the workers are meant to be programming robots. They build cars. Same thing with business service delivery in IT -- it's really important to plug your reference model and your reference architectures for cloud into that factory approach.

You want your PaaS to be a one-stop-shop for business service production and that means from the very beginning to the very end. You have to tenant and support your customers all along the way. So it really takes the vertical stack, which is the way we currently think about cloud in terms of IaaS, and fans it out horizontally, so that we have a place to plug different customers in the enterprise into that.

And what we find is, just as in any good factory or any good process design, we really focus on what it is those customers need and when. For example, just to take one of many things that's typically broken in large enterprises, testing and test environments. Sometimes it takes weeks in large organization to get test environments. We see customers who literally forgo key parts of testing and really sort of do a big bang test approach at the end, because it is so difficult to get environment and to manage the configuration of those environments.

One of the ways we can fix that is by organizing that part of the PaaS story and wrap around some of the attendant next-generation configuration management capabilities that go along with that. That would include things like service test virtualization, agile operations, asset metadata management, some of the application lifecycle management (ALM) stuff, and focus on systemically killing the biggest impedances in the order of most pain in the enterprise. You can do that without worrying about, or going anywhere near, public cloud to go do data processing.

I think we will see larger appetites by the business for more applications and a need to put them into a place where they are more easily managed.



So that's the here and now, and I'd say that that's also supportive of a longer term, grand unified field theory of cloud, which is about consuming IT entirely as a service. To do that, we have to get our house in order in the same way and focus on organizing and re-organizing in terms of transformation in the enterprise to support first the internal customers, followed by using the same presets and tenets to focus on getting outside of the organization in a very structured way.

But eventually moving workloads out of the organization and focusing on direct interaction with the business, I think we will see larger appetites by the business for more applications and a need to put them into a place where they are more easily managed, and eventually, it may take 20 years, but I think you'll see organizations move to turn off their internal IT departments and focus on business, focus on being an insurance company, a bank, or a logistics company. But, we start in the here and now with PaaS.

Gardner: Okay. Paul O'Connor, if I can just add one more thing to that. I read in some of your literature -- and I quote from you -- “Work load assembly in the cloud is the name of the game.” It seems that you're talking about private cloud first, then, ultimately, any number of other hybrid cloud scenarios. Is that what you mean across this development, test, deploy, workload assembly? What do you mean by that?

What is it doing?


O'Connor: Workload assembly. What I mean by that is that we need a profile of what it is we do in terms of work. If I plug a job into the wall that is my next-gen IT architecture, what is it actually doing and how will I know? The types of things vary. It varies widely between phases of my development cycle.

Obviously, if I do load and performance testing, I've got a large workload. If I do production, I’ve got a large workload. If I move to big data, and I am starting to do massively scalar analytics because the business realizes that you go after such an application, thanks to where IT is taking the enterprise, then that's a whole other ball of wax again.

What I have to do is understand those workloads. I have to understand them in terms of the data that they operate on, especially in terms of its confidentiality. I have to understand what requirements I need to assemble in terms of the workload processing.

If I have identify show up, or private key, I have to do integration, or I have to wire into different systems and data sources, all of that has to be understood and assembled with that workload. I have to characterize workload in a very specific way, because ultimately I want to use something like WSO2 Stratos to assemble what that workload needs to run. Once I can assemble it, then it becomes even easier for me to work my way through the dev, test, stage, release, operate cycle.

Gardner: Paul Fremantle, tell me what WSO2 is doing to help people like Paul O'Connor reach this workload assembly capability?

That starts with some very simple things, like identity as a service, so that there is a consistent multi-tenant concept of identity, authorization, and entitlement available wherever you are in the private cloud, or the public cloud, or hybrid.



Fremantle: What we have done is build our Carbon middleware on OSGi. About two years ago, we started thinking how we're going to make that really effective in a cloud environment. We came up with this concept of cloud-native software. We were lucky, because, having modularized Carbon, we had also kernelized it. We put everything around a single kernel. So, we were able to make that kernel operate in a cloud environment.

That’s the engineering viewpoint, but from the architecture viewpoint, what we're providing to architects like Paul O’Connor is a complete platform that gives you what you need to build out all of the great things that Paul O’Connor has been talking about.

That starts with some very simple things, like identity as a service, so that there is a consistent multi-tenant concept of identity, authorization, and entitlement available wherever you are in the private cloud, or the public cloud, or hybrid.

The next thing, which we think absolutely vital, is governance monitoring, metering, and billing -- all available as a service -- so that you can see what's happening in this cloud. You can monitor and meter it, you can allocate cost to the right people, whether that’s a public bill or an internal report within a private cloud.

Then, we're saying that as you build out this cloud, you need the right infrastructure to be able to build these assemblies and to be able to scale. You need to have a cloud native app server that can be deployed in the cloud and elastically scale up and down. You need to have an ESB as a service that can be used to link together different cloud applications, whether they're public cloud, private cloud, or a combination of the two.

Pulling together

And, you need to have things like business process in the cloud, portal in the cloud, and so on, to pull these things together. Of course, on the way, you're going to need things like queues or databases. So, what we're doing with Stratos is pulling together the combination of those components that you need to have a good architecture, and making them available as a service, whether it's in a private cloud or a public cloud.

That is absolutely vital. It's about providing people with the right building blocks. If you look at what the IaaS providers are doing, they're providing people with VMs as the building blocks.

Twenty years ago, if someone asked me to build an app, I would have started with the machine and the OS and I would start writing code. But, in the last 20 years we've moved up the stack. If someone asked me to build an app now, I would start with an app server, a message queuing infrastructure, an ESB, a business process server, and a portal. All these components help me be much more effective and much quicker. In a cloud, those are the cloud components that you need to have lying around ready to assemble, and that to me is the answer.

Gardner: Paul Fremantle, you're describing what you think is the best way to support a workload assembly capability, but how is that different from what we're seeing from some of the service delivery platform vendors, and what we could call "cloud in a box?" What's the difference between what they're talking about and what you're talking about?

The thing that those PaaS providers are missing, and most of the PaaS that I see out there is missing, is a real enterprise architecture view of the world.



Fremantle: I'm seeing various things in the marketplace. Obviously, there are people like Eucalyptus, Ubuntu, and of course VMware, who are providing private IaaS, and that’s very important. We work on top of those layers. I'm also seeing a lot of people producing PaaS. December was an exciting month. We've had two acquisitions in that space.

The thing that those PaaS providers are missing, and most of the PaaS that I see out there is missing, is a real enterprise architecture view of the world. It's fine to provide a web app as a service and a database as a service. Those are the basic building blocks that people need. But, if you don't have an open, clear definition of identity, governance, business activity monitoring, BPM, and ESB, you're stuck in a 10-year-old architecture.

So, for me, where you're going to have to move is to a complete platform that understands enterprise architecture (EA). It isn’t just about saying, "I've got a web app and a database that are somehow provided in a cloud native fashion."

Gardner: Paul O'Connor, I'm an advocate of showing rather than telling, when it comes to these sorts of complex issues. Do we have any examples of perhaps companies that ANATAS has worked with, where they have employed some of these approaches, whether from a position of the technology, the actual implementation of certain products and services, the methodologies, or all of the above? What do you get? What happens when you do this properly? What sort of business and/or technical benefits can we expect based on the record so far?

O'Connor: I'll tell you about a large enterprise that we have been working with for a good long while. They are building an internal PaaS, an internal platform which is operated as a service. This is key. They're looking at that as a way to achieve some tangible benefits right out of the gate, while supporting a longer-term vision, which is about beating back into submission as much of the sprawl that has grown up over the course of time in large enterprises.

The immediate benefits in that case are about efficiency and business service architecture and constraints. By that, I mean that if you have one standard service delivery process that’s highly efficient that starts with modeling and works its way all the way through to operation in a business sense of business services, what you wind up with is an approach on the business side itself to use that as a lever to go out and directly be able to add in efficiencies, attack new markets, and really focus on some things on the business side that were latent, because there was a feeling that it couldn't be delivered efficiently by IT or may not work.

Seeing it work

We're really seeing that lever work. It's right there. We're also seeing a focus on a broader picture. I want to make one point following up on what Paul Fremantle was saying earlier. We really need to have, and this is what this client has done, a reference architecture that is sort of the antithesis of cloud in a box.

It's structured so that you don’t get tied into one particular vendor's view of cloud or anything else. You’ve really taken an Architecture 101 approach. You build a reference model, you build a reference architecture, you go execute against that, and you don’t have either an inheritance from the IaaS guys up into the higher parts of the stack or the sprawl from the existing platform players down into the infrastructure space.

Ultimately, and this is how this client views it, cloud is more than a way of thinking. It’s open and it’s about getting your house in order, but it’s also about not being locked in and trying to, in the case where we feel like we should, turn the table on our existing vendors.

And that’s what WSO2 is doing in terms of a feature-driven lean middleware and also the way that they are approaching delivery in terms of a professional open-source model, and is very much in keeping with the way that my clients view the cloud.

Gardner: Paul Fremantle, we only have time for one additional example. Do you have some customers that you've been working with that are perhaps what you would consider a bellwether for where the rest of the enterprises are likely to go?

It’s something I'm seeing a lot of software companies looking at as well, which is to start converting their applications into SaaS.



Fremantle: I want to put a different spin on this, which is that as well as the companies that are doing what Paul O'Connor was talking about and using PaaS to create the software factory concept within their organization, there is another angle on this, which is interesting. It's the ability of people, not just software vendors, but also system integrators and even service providers, to start using PaaS to create their own cloud software as a service (SaaS).

This was brought to mind to me by one European-based system integrator and business process outsourcer. Unfortunately, I can’t name them, but they're a partner of ours. What they've started to do is think, "When I'm building an application or a process for customer, is that something that is really applicable just to this one customer or is it something that is a reusable asset, that can be offered as a service to multiple customers?"

Of course, that may not be offered over the public cloud. It may be hosted in a private cloud and different companies give a VPN access to their own tenant within that. It’s something I'm seeing a lot of software companies looking at as well, which is to start converting their applications into SaaS.

And as you do that, you quickly find that the things you need, the capabilities that you need, in order to offer SaaS are the same capabilities that you need in a platform. They're the things I was talking about before, things like identity, governance, metadata, monitoring and metering billing.

To me, the interesting thing here is the intersection between how large enterprises are treating their software development and how software companies are treating their software development, and system integrators and business process outsourcers are treating their software development. They're all converging on the most efficient model that we have come up with yet.

Gardner: Very interesting. It sounds as if the IT ecosystem is marching in tandem towards the same vision, and that will perhaps enable these enterprises to move all the more quickly, rather than the enterprises doing it essentially on their own.

Fremantle: Absolutely.

Gardner: Well, very good. I'm afraid we're about out of time. We've been discussing how workload assembly and the concept of a business service factory are important attributes to private clouds, and how private clouds when established using these best practices and principles, can provide a huge stepping stone in the right direction for the future of IT, a transformed future of IT.

I want to thank our panelists. We've been joined by Paul Fremantle, the UK-based Chief Technology Officer and co-founder of WSO2. Thanks so much, Paul.

Fremantle: Thank you very much.

Gardner: And, we’ve also been joined by Paul O’Connor, the Chief Technology Officer at ANATAS International in Sydney, Australia. Thanks for joining as well, Paul.

O'Connor: Thanks, Dana.

Gardner: This is Dana Gardner, Principal Analyst at Interarbor Solutions. You've been listening to a sponsored BriefingsDirect podcast. Thanks for listening, and come back next time.

Listen to the podcast. Find it on iTunes/iPod and Podcast.com. Download the transcript. Sponsor: WSO2.

Transcript of a sponsored BriefingsDirect podcast on how to modernize infrastructure to enable IT to become better "business service factories." Copyright Interarbor Solutions, LLC, 2005-2011. All rights reserved.

Learn more about WSO2 and cloud management
Download "Effective Cloud Management with WSO2 Strategies"
More information on WSO2 Stratos
Attend a WSO2 SOA Workshop to Energize your Business with SOA and Cloud

You may also be interested in:

Thursday, January 06, 2011

Case Study: How McKesson Develops Software Faster and Better with Innovative Use of New HP ALM 11 Suite

Transcript of a sponsored BriefingsDirect podcast, part of a series on application lifecycle management and HP ALM 11 from the recent HP Software Universe 2010 conference in Barcelona.

Listen to the podcast. Find it on iTunes/iPod and Podcast.com. Download the transcript. Sponsor: HP.

Dana Gardner: Hello, and welcome to a special BriefingsDirect podcast series, coming to you in conjunction with the HP Software Universe 2010 Conference last month in Barcelona.

We're here to explore some major enterprise software and solutions, trends and innovations, making news across HP’s ecosystem of customers, partners, and developers. [See more on HP's new ALM 11 offerings.]

I'm Dana Gardner, Principal Analyst at Interarbor Solutions, and I’ll be your host throughout this series of Software Universe Live discussions. [Disclosure: HP is a sponsor of BriefingsDirect podcasts.]

Our customer case study today focuses on McKesson and how their business has benefited from advanced application lifecycle management (ALM). To learn more about McKesson's innovative use of ALM and its early experience with HP's new ALM 11 release, I'm here with Todd Eaton, Director of ALM Tools and Services at McKesson. Welcome, Todd.

Todd Eaton: Thanks, Dana.

Gardner: I know you've been involved with ALM for quite some time, but what is it about ALM now in your business that makes it so important and beneficial?

Eaton: In our business at McKesson, we have various groups that develop software, not only for internal use, but also external use by our customers and software that we sell. We have various groups within McKesson that use the centralized tools, and the ALM tools are pretty much their lifeblood. As they go through the process to develop the software, they rely heavily on our centralized tools to help them make better software faster.

Gardner: Is ALM something you use within the groups -- and then also to bind those groups; that is to say, there is a tactical ... and then even strategic benefit as well?

Eaton: Yes. The ALM suite that HP came out with is definitely giving us a bigger view. We've got QA managers that are in the development groups for multiple products, and as they test their software and go through that whole process, they're able to see holistically across their product lines with this.

We've set up projects with the same templates. With that, they have some cohesion and they can see how their different applications are going in an apples-to-apples comparison, instead of like the old days, when they had to manually adjust the data to try to figure out what their world was all about.

Gardner: At this point, are there any concrete benefits, either in terms of business benefits, or in the IT application development side of the business that you can point to that these ALM innovations have supported?

Better status

Eaton: There are a couple of them. When HP came up with ALM 11, they took Quality Center and Performance Center and brought them together. That's the very first thing, because it was difficult for us and for the QA managers to see all of the testing activities. With ALM, they're able to see all of it and better gauge where they are in the process. So, they can give their management or their teams a better status of where we are in the testing process and where we are in the delivery process.

The other really cool thing that we found was the Sprinter function. We haven't used it as much within McKesson, because we have very specific testing procedures and processes. Sprinter is used more as you're doing ad hoc testing. It will record that so you can go back and repeat those.

How we see that being used is by extending that to our customers. When our customers are installing our products and are doing their exploratory testing, which is what they normally do, we can give them a mechanism to record what they are doing. Then, we can go back and repeat that. Those are a couple of pretty powerful things in the new release that we plan to leverage.

Gardner: How would you describe the problem that we need to solve here? Is this a problem of communication, of measurement, perhaps workflow management, or all the above? How would you characterize what's wrong with how application development has been done? I don't mean to point to you as falling short on this at all. This is a general issue, but what is the problem that you think ALM is really addressing?

Eaton: That's a good point. When we're meeting at various conferences and such, there's a common theme that we hear. One is workflow. That's a big piece. ALM goes a long way to be able to conquer the various workflows. Within an organization, there will be various workflows being done, but you're still able to bring up those measurements, like another point that you are bringing up, and have a fairly decent comparison.

They can find those defects earlier, verify that those are defects, and there is less of that communication disconnect between the groups.



With the various workflows in the past, there used to be a real disparate way of looking at how software is being developed. But with ALM 11, they're starting to bring that together more.

The other piece of it is the communication, and having the testers communicate directly to those development groups. There is a bit of "defect ping-pong," if you will, where QA will find a defect and development will say that it's not a defect. It will go back and forth, until they get an agreement on it.

ALM is starting to close that gap. We're able to push out the use of ALM to the development groups, and so they can see that. They use a lot of the functions within ALM 11 in their development process. So, they can find those defects earlier, verify that those are defects, and there is less of that communication disconnect between the groups.

Gardner: It sounds like it’s beginning to quicken the pace of how you go about these things, but in addition to that, are you exploiting agile development practices, and is this something that's helping you if you are?

Eaton: We have several groups within our organization that use agile development practices. What we're finding is that the way they're doing work can integrate with ALM 11. The testing groups still want to have an area where they can put their test cases, do their test labs, run through their automation, and see that holistic approach, but they need it within the other agile tools that are out there.

It's integrating well with it so far, and we're finding that it lends itself to that story of how those things are being done, even in the agile development process.

Gardner: You're a large organization, a large healthcare provider and insurer. Maybe you could tell us a little bit about McKesson, where you're based, and the size and extent of your application development organization.

Company profile

Eaton: McKesson is a Fortune 15 company. It is the largest health-care services company in the U.S. We have quite a few R&D organizations and it spans across our two major divisions, McKesson Distribution and McKesson Technology solutions.

In our quality center, we have about 200 projects with a couple of thousand registered users. We're averaging probably about 500 concurrent users every minute of the day, following-the-sun, as we develop. We have development teams, not only in the U.S, but nearshore and offshore as well.

We're a fairly large organization, very mature in our development processes. In some groups, we have new development, legacy, maintenance, and the such. So, we span the gamut on all the different types of development that you could find.

Gardner: Well, that's interesting, because I wanted to explore the size of the organization. It sounded a moment ago as if you were able to support different styles, different cultures, different maturity levels, as you have mentioned, among and between these different parts of your development cycle, all using the same increasingly centralized ALM approach. Is that fair?

Eaton: Yeah, that's fair. That's what we strive for. In my group, we provide the centralized R&D tools. ALM 11 is just one of the various tools that we use, and we always look for tools that will fit multiple development processes.

They have to adapt to all that, and we needed to have tools that do that, and ALM 11 fits that bill.



We also make sure that it covers the various technology stacks. You could have Microsoft, Java, Flex, Google Web Toolkit, that type of thing, and they have to fit that. You also talked about maturity and the various maturity models, be it CMMI, ITIL, or when you start getting into our world, we have to take into consideration FDA.

When we look at tools, we look at those three and at deployment. Is this going to be internally used, is this going to be hosted and used through an external customer, or are we going to package this up and send it out for sale?

We need tools that span across those four different types, four different levels, that they can adapt into each one of them. If I'm a Microsoft shop that’s doing Agile for an internal developed software, and I am CMMI, that's one. But, I may have a group right next door that's waterfall developing on Java and is more an ITIL based, and it gets deployed to a hosted environment.

They have to adapt to all that, and we needed to have tools that do that, and ALM 11 fits that bill.

Gardner: So, it's the benefits of decentralized and the benefits of centralized in terms of the system-of-record approach, having at least a metaview of what's going on, even though there is still flexibility at the edge.

Eaton: Correct. ALM 11 had a good foundation. The test cases, the test set, the automated testing, whether functional or performance, the source of truth for that is in the ALM 11 product suite. And, it's fairly well-known and recognized throughout the company. So, that is a good point. You have to have a source of truth for certain aspects of your development cycle.

Gardner: Of course, your industry has significant level of regulation and compliance issues. Is ALM 11 something that's been a benefit in that regard?

Partner tools

Eaton: It has been a benefit. There are partner tools that go along with ALM 11 that help us meet those various regulations. Something that we're always mindful of, as we develop software, is not only watching out for the benefit of our customers and for our shareholders, but also we understand the regulations. New ones are coming out practically every day, it seems. We try to keep that in mind, and the ALM 11 tool is able to adapt to that fairly easily.

Gardner: You've been an early adopter. You've implemented certain portions of ALM 11, and you have a great deal of experience with ALM as a function. Looking back on your experience, what would you offer as advice to someone who might just be getting their feet wet in regard to either ALM or specifically ALM 11?

Eaton: When I talk to other groups about ALM 11 and what they should be watching out for, I tell them to have an idea of how your world is. Whether you're a real small shop, or a large organization like us, there are characteristics that you have to understand. How I identify those different stacks of things that they need to watch out for; they need to keep in mind their organization’s pieces that they have to adapt to. As long as they understand that, they should be able to adapt the tool to their processes and to their stacks.

Most of the time, when I see people struggling, it's because they couldn’t easily identify, "This is what we are, and this is what we are dealing with." They usually make midstream corrections that are pretty painful.

Gardner: And your title is interesting to me, Todd: Director of ALM Tools and Services. This is an organizational question, I suppose. Do you think it is a good policy, now that you have had experience in this, to actually devoting an individual or maybe a team to just overseeing the ALM tools, which in fact oversees the ALM process?

They look to us to be able to offload that and have a team to do that.



Eaton: That's an interesting point, and something that we've done at McKesson that appears to work out real well. When I deal with various R&D vice presidents and directors, and testing managers and directors as well, the thing that they always come back to is that they have a job to do. And one of the things they don't want to have to deal with is trying to manage a tool.

They've got things that they want to accomplish and that they're driven by: performance reviews, revenue, and that type of thing. So, they look to us to be able to offload that, and to have a team to do that.

McKesson, as I said, is fairly large, thousands of developers and testers throughout the company. So, it makes sense to have a fairly robust team like us managing those tools. But, even in a smaller shop, having a group that does that -- that manages the tools -- can offload that responsibility from the groups that need to concentrate on creating code and products.

Gardner: Well, great. Thank you for sharing your experiences. We've been hearing about ALM best practices and the use of HP's new ALM 11 by an early adopter and his experience, Todd Eaton, Director of ALM Tools and Services at McKesson. Thank you, Todd.

Eaton: You're welcome, Dana. It was nice talking to you.

Dana Gardner: I want to thank also our listeners for joining the special BriefingsDirect podcast, coming to you in conjunction with the HP Software Universe 2010 Conference.

Look for other podcasts from this event on the hp.com website, as well as via the BriefingsDirect network.

I'm Dana Gardner, Principal Analyst at Interarbor Solutions, your host for this series of Software Universe Live discussions. Thanks again for listening, and come back next time.

Listen to the podcast. Find it on iTunes/iPod and Podcast.com. Download the transcript. Sponsor: HP.

Transcript of a sponsored BriefingsDirect podcast, part of a series on application lifecycle management and HP ALM 11 from the HP Software Universe 2010 conference in Barcelona, Spain. Copyright Interarbor Solutions, LLC, 2005-2010. All rights reserved.

You may also be interested in: