While nearly 90 percent of business and IT leaders agree that big data can be useful in making intelligent business decisions, only one-third of companies have implemented big-data initiatives. That’s the finding from a recent International Data Group (IDG) survey, sponsored by Kapow Software.

Furthermore, more than 50 percent of survey respondents said that they had only lukewarm success with getting big data to deliver value in terms of competitive advantage, differentiation, top-line growth, strategic insights, employee productivity and effectiveness, among other business metrics.

Respondents reported that big-data projects take too long, cost too much, and aren’t delivering a sufficient return on investment (ROI). Part of this is because these projects require expensive consultants or hard-to-find data scientists. Yet, while this lag in adoption continues, the mass of data from a variety of sources is growing.

Among the barriers to drawing value out of big data, according to survey respondents, are:

• High cost and complexity.Many business leaders believe such projects require a prohibitively expensive infrastructure. Sixty percent said projects take 18 months or more to complete.
• Employee workarounds.Respondents said employees often take matters into their own hands, but without effective solutions, are resorting to manual aggregation. This is putting pressure on IT to automate these efforts.
• Poor data accessibility. Nearly half of IT leaders said they find it difficult to find, access, and integrate the right information, which is often unstructuredand spread among a wide variety of sources.
• Lacking skills and tools. Big data is proving to be inaccessible by employees without special training, again putting pressure on IT to pave the way.

Despite the current low reliance on big data, adoption is expected to increase over the next 12 months, as business and IT leaders turn to user-centric tools — such as those provided by Kapow Software. With such tools, IT leaders anticipate improved productivity and a better relationship with the business leaders.

Business leaders surveyed are looking for a variety of benefits from an increased use of big data. They say the following are either “critical” or “very important:”

• More informed business decision – 80 percent
• Increased competitive advantage – 71 percent
• Improved customer satisfaction – 68 percent
• Increased end-user productivity – 62 percent
• Improved security or compliance – 60 percent
• New products and services – 55 percent
• Monitoring and responding to social media in real time – 33 percent.

For more information on the survey results, go to http://www.slideshare.net/Kapowmarketing/kapow-idg-bigdataidg051513 or http://www.kapowsoftware.com/. [Disclosure: Kapow Software is a sponsor of BriefingsDirect podcasts.]

You may also be interested in:

• Kapow Mobile Katalyst debuts as new means to rapidly convert web applications to mobile apps sans APIs
• Kapow launches data integration platform for rapid data delivery to multiple devices
• Kapow delivers Web Data Server 7.2 to make BI easier to extract from across web-based activities
• Web data services extend business intelligence depth and breadth across social, mobile, web domains
• Web data services provide ease of data access and distribution from variety of sources, destinations
• Web data services — here’s why text-based content access and management plays crucial role in real-time BI management
• Real-time web data services in action at Deutsche Boerse

This latest BriefingsDirect podcast, from the 2013 Ariba LIVE Conference in Washington, D.C., explores Ariba’s product and services roadmap and future strategy insights unveiled by Ariba, an SAP company, at the recent user event.

Our guest is Chris Haydon, Vice President of Solutions Management for Procurement, Finance, and Network at Ariba, here to explain the latest conference news, and to offer insights into how Ariba will be broadening its services procurement management value, mobile push and AribaPay roll-out.

The interview is conducted Dana Gardner, Principal Analyst at Interarbor Solutions. [Disclosure: Ariba, an SAP company, is a sponsor of BriefingsDirect podcasts.]

Here are some excerpts:

Gardner: Where we are now with Ariba in terms of some of the big news at LIVE?

Haydon: We have some really exciting innovation coming in the near-term to Ariba in a couple of areas. First, let’s talk about Network RFQ or the Spot Buy. We think this is part of the undiscovered country, where, according to The Hackett Group, 40-plus percent of spend is not sourced.

Haydon

By linking this non-sourced spend to the Ariba Network, we think we’re going to be able to address a large pain-point for our buyers and our sellers. Network RFQ or Spot Buy is a near-term solution that we announced at LIVE, and we’re bringing that forward over the next six months.

The next exciting innovation is at the other end of the process. That’s a solution we call AribaPay. AribaPay is what we think is a game-changing solution that delivers rich remittance and invoice information that’s only available from the Ariba Network through solution secure, global payment infrastructure.

Down market

Gardner: It seems to me, Chris, that you’re going to the mid-market. You’re creating some services with Spot Buy that help people in their ad-hoc, low-volume purchasing.

You’re providing more services types of purchasing capabilities, maybe for those mid-market organizations or different kinds of companies like services-oriented companies. And, you’re also connecting via Dell Boomi to QuickBooks, which is an important asset for how people run small businesses. Are we expanding the addressable market here?

Haydon: We are, and that’s an excellent point. We look at it two ways. We’re looking to address all commerce. Things like the Spot Buy, AribaPay, services, procurement, and estimate-based services are really addressing the breadth of spend, and that applies at the upper end and the lower end.

There are important pieces that you touched on, especially with our Dell Boomi partnership and the announcement here for QuickBooks. We want to make it accessible to grow the ecosystem and to make the collaboration across the network as frictionless as possible.

With Dell Boomi announcing QuickBooks, it enables suppliers specifically with that back-end system to be able to comply with all the collaboration of business processes on the Ariba Network, and we’re really only just getting started.

There is a massive ecosystem out there with QuickBooks, but when we have a look around, there are more than 120 prominent backend systems. So it’s not just the SAPs, the Oracles, the JD Edwards, and Lawsons. It’s the QuickBooks and the Intuits. It’s the Great Plains of the world.

Think about at it as back-end agnostic. We want our customers on both the buy-side and the sell-side of their partners to make their own choices. It’s really their own choice of deployment.

If they want to take an integrated business-to-business (B2B) channel, they can. If they want to come to a portal, they can. If they want to have an extract that goes into their own customized system, they can do that as well, or all of the above at the same time, and really just taking that process forward.

Gardner: How does AribaPay work? Is this a credit card, a debit card? Is this a transactional banking interface?

Brand new

Haydon: Number one, it’s brand-new. First, let’s talk about the problems that we had, and how we think we are going to address it. More than 40 percent of payments in corporate America are still check based. Check-based payments present their own problems, not just for the buyers, but also from the sellers. They don’t know when they’re going to get paid. And when they are getting paid, how do they reconcile what they’re actually getting paid for?

AribaPay is a new service. It’s not a P-Card. It’s leveraging a new type of electronic payment through an ACH-styled channel. It enables buyers to take 100 percent of their payments through the Ariba Network. It lets the suppliers opt in to be able to match and move from our paper-based payment channel check, to an electronic channel that is married. This is the interesting value prop for the network. That is married with their rich information.

So that’s the value. We think it’s very differentiated. We’re going to be leveraging a large financial institution provider who has great breadth and penetration, not just here in the United States, but globally as well, and that’s via Discover Financial Services.

We announced this at LIVE this month, and I know they’re as excited as we are. Discover has the wherewithal to bring the credibility and the scale to the payments channel, while Ariba has the credibility in the scale of the supply base and the commercial B2B traffic. We think that that one plus one equals three and is a game changer in electronic payment.

Gardner: Moving on to the future or vision that you’re painting, what should we expect in the roadmap of the next two or three years for the Ariba Network?

Haydon: We’re really excited about the Ariba Network and we have four or five themes. One piece of big news is that we’re getting into and supporting supply chain and logistics processes, and adding that level of collaboration. Today, we have 10 or 11 types of collaborations that you can do on the Ariba Network, like an order, an invoice, and so on.

Over the next several releases, we’re going to be more than doubling that amount of collaboration that you can do between trading partners on the network. That’s exciting, and there are things like forecasting and goods receipt notices.

I won’t go into the specifics of every single transaction, but think about of doubling the amount of collaboration that you can do and the visibility in that. The ability to apply your own business rules and logic to those collaborations is massive.

The second thing we’re doing on the network is adding a new spend category, which we call services invoicing. This is estimate-based spend and this is another up market, down market, broad approach, in which there are a whole heap of services.

This is more of an estimate-based style spend where you don’t necessarily know the full cost of an item until you finish it. Whether you’re drilling an oil well or constructing a building, there are variations there. So we’re adding that capability into the network.

User interface

Another area is what we call Network 2.0, and this is extending and changing not just the user interface, but extending and adding more intrinsic core capabilities to the network. Ariba has a number of network assets and we think it’s important to have a single network platform globally. It’s the commerce internet, the network.

So our Network 2.0 program is a phase delivery of extending the core capabilities of the Ariba network over the next couple of years in terms of order status, results, requests in terms of goods receipt notices, advanced shipping notices, more invoice capability, and just growing that out globally.

Last but not least is just more and more supply collaboration, focusing on the ability for suppliers to more easily respond, comply, and manage their profiles on the Ariba Network.

Gardner: The Ariba applications themselves, what should we expect there?

Haydon: We have a whole raft of capability coming across that whole application suite. We can break that into two or three areas. In our sourcing, contract management, supplier information management, and supply performance management suite, we’re doing functionality enhancements on one of the exciting pieces.

In the spend visibility area, we’re going to be leveraging the SAP In-Memory technology HANA. What we are doing there is early for us, but there are some very exciting, encouraging results in terms of the speed and the performance we’ve heard about from SAP. Running our own technology on that and seeing the results is exciting for us and will be exciting for our customers.

As we move more into our procurement suite, we’re introducing a new look and feel, a consumer like look and feel, to our catalog and our search engine. The more Amazon-style search touches more users than anyone else. As you can imagine, that’s how they need to requisition tools. So making that a friendly UI and taking that UI or user experience through to the other products is fantastic.

One of the other most exciting areas for us is services procurement, a very large investment for us. Services procurement is our application to be able to support temporary or contingent labor, statement of work or consulting labor, print, marketing and also light industrial. This really is one of the underpinning differences for Ariba, and this is where we’re bringing it together.

We’re not just building applications any more. We’re building network-centric applications or network-aware applications. It means that when we’re launching our new services procurement solution, not only are we are going to have a brand-new, refreshed, modern user interface, which is very important.

Differential insights

We’re going to be able to leverage the power of the Ariba Network to provide differential insights, into standard day-to-day services procurement on-boarding. That will be looking at average labor rates in the area for the type of service that you’re buying and using the network intelligence to give you advice, to give you instruction, to help you manage exceptions on the network.

Gardner: What’s really interesting to me is all of your vision so tightly aligns with the mega trends of today, from cloud to mobile to big data. Tell me little bit about the potential.

Haydon: Absolutely. When we think about the networked economy, the networked apps, the network-centric apps, the network itself, one should be able to connect any demand generating or receiving system. We touched on that with Dell Boomi, but it’s seamless integration across the piece. We want to be comprehensive, which is adding more collaboration.

Critical mass

The interesting thing about this collaboration, is it starts driving at some levels a critical mass of data. The trend is that the network is intelligent. It’s actually able to piece together not just the transaction itself, but who you are. We’re quite excited, because this is the massive differentiator of the network. You talked about apps. We have not just the transactional data, but we have the master data, and we can also take other sources of information.

That could be weather, location, stock reports, SEC filings, Dun and Bradstreet writings, whatever you like, to intersect.

So this data plus knowledge gives you information. With SAP, it’s a very exciting technology. SAP InfoNet, Supplier InfoNet, is able to leverage network data. Today, it has over 160 feeds. It’s smart, meaning it’s smart intelligence. It can automatically take those feeds and contextualize.

And that’s the real thing we’re trying to do — knowing who the user is, knowing the business process they are trying to execute, and also knowing what they are trying to achieve. And it’s bringing that information to the point of demand to help them make actionable, intelligent, and sometimes predictive decisions.

Where we would like to go is, heaven forbid there is another tsunami, but let’s just work through that use case. You get a news alert there is tsunami in Japan again, terrible event. What if you knew that, and what if 80 percent of your core, raw material inputs came from there? Just that alert of that to notify you to saying you’ve got to know that you might well have a supply problem. What are you going to do?

And by the way, here are three or four other suppliers who can supply this material to you, and they’re available on the network. What is that worth? Immeasurable.

Listen to the podcast. Find it on iTunes. Read a full transcript or download a copy. Sponsor: Ariba.

You may also be interested in:

• Ariba and Discover to transform B2B payments with cloud-based AribaPay
• Ariba, Dell Boomi to unveil collaboration enhancements for networked economy at Ariba LIVE conference
• The Networked Economy Newly Forges Innovation Forces for Collaboration in Business and Commerce, Says Author Zach Tumin
• Collboration-Enhanced Procurement and AP Automation Maximize Productivity and Profit Gains in Networked Economy, Says Ariba’s Drew Hofler
• Ariba Network Helps Cox Enterprises Manage Procurement Across Six Different ERP Systems
• Ariba CMO Tim Minahan on how networked economy benefits spring from improved business commerce and cloud processes
• Ariba Dynamic Discounting Gives Companies New Visibility into Cash Flow to Improve the Buying Process

So if cloud is a way of doing an end-run around IT — yet IT is integral to proper applications deployment and care — how exactly do these disparate propositions co-exist?

Not too well, it turns out, especially as the pace that apps development and deployment — and the skyrocketing need to bring more mobile apps into production — complicates the already tough task of overall applications management.

HP Software today announced four products that aim to tackle this thorny reality — that traditional apps deployment was already broken, and that the new requirements make automation and comprehensive management an inescapable necessity. [Disclosure: HP is a sponsor of BriefingDirect podcasts.]

HP is also banking on the role it can play as a neutral party to better orchestrate the apps lifecycle because — unlike most other large enterprise software vendors — it doesn’t have a legacy applications, operating system, hypervisor, database and/or middleware heritage (and cash cows) to favor and protect. That means supporting heterogeneity in total is the imperative, not the exception, for HP.

The next generation of HP’s data-center automation, orchestration, and cloud management software scales in terms of volume, supports all the installed enterprise kit, and allows for unprecedented simplicity, so that IT can get control before its too late, said Manoj Raisinghani, Senior Director of Worldwide Product Marketing for Cloud Automation Software and SaaS at HP Software.

It’s not enough to solve parts of the enterprise IT complexity problem, said Raisinghani. The management of the server deployment and management has an impact on the database and middleware management, which then need to be orchestrated as a whole, which then needs to apply to the cloud services deployment options. So, server, data, middleware, cloud and orchestration all need to be part of the management solution for the scale, simplicity and automation to be impactful and practical, he said.

And that’s why HP has bundled these four major products under a common release, with a common version number: 10.

Key to cloud

“Server automation is key to the cloud path,” said Raisinghani. He said the announcements were a “10″ on a scale of 1 to 10 for HP Software.

Managing complex distributed systems and heterogeneous environments is so time-consuming and complex — hindering business agility and innovation — that IT has relied on systems integrators, and is now being tempted to hand over more process orchestration to the cloud providers. But the trends around mobility, big data and software-as-a-service (SaaS) services mean that IT need to be more in control, not less. And IT needs the means to deploy the answer themselves, and rely on the software orchestration they control to move the workloads and date to where the model works best, said Raisinghani.

Therefore, whether it’s routine data center maintenance to the delivery of extended enterprise business processes, automation and cloud management software reduces automating repetitive, manual and time-consuming operations, and makes the entire approach more secure and more easily tracked for intrusions, according to HP.

Even deploying the HP Server Automation (SA) 10 product itself is being streamlined via a virtual appliance, said Raisinghani. IT users can do it themselves, he said. Thanks to the virtual appliance model, the suite is “customer installable,” said Raisinghani.

HP Database and Middleware Automation (DMA) 10 further automates manual database management tasks. HP Cloud Service Automation 3.2 provides service life cycle automation and IT assets management capabilities to scale to cloud services safely. HP Operations Orchestration (OO) 10 automates up to 15,000 simultaneous operations to track all of the above products, processes, and services.

HP SA 10, the life cycle management platform, enables IT to manage more than 100,000 physical and virtual servers from a single pane of glass, as well as improves operational economics by reducing the administrator-to-server ratio by up to 60 percent, said Raisinghani.

This HP Software approach has been long in the making — from the acquisition of Mercury and Opsware, to the business service management emphasis to the early recognition that hybrid cloud was the long-term IT model.

And while the total management approach — supporting all the major OSes, hypervisors, RDBs, apps, and clouds — makes HP a services management Switzerland, there are some advantages too for HP. By focusing on the automation and orchestration, they are building a default capability to the HP public cloud for those organization seeing an integrated advantage over the more maul efforts require for other public clouds such as Amazon Web Services, said Raisinghani.

“You can go agile, to where the applications can be best deployed,” said Raisinghani. “But this is seamless to the user. It just gets deployed. IT can automate how the services are prepackaged and cloud-burst.”

Up and running

And HP is determined to make the HP public cloud the best way to get those services up and running, although the customer will have choice on which cloud or clouds to target, said Raisinghani. “The user gets choice — but the default is the HP Cloud,” he said. “HP on HP is going to work better. We’ll be making them an offer that’s very attractive.”

So think about it. Would you as a vendor rather be in a race to the bottom on hypervisor price? On public cloud price? On database price? On storage price? Or would you rather be building market at being best at enabling the automation, speed and security of the workloads and processes that IT needs to navigate the new IT landscape?

Management, orchestration and automation may well be the killer apps of the cloud era. Management, orchestration and automation from apps and data cradle to grave is the sticky value that locks-in based on productivity, not technology. HP has clearly got its eyes on this prize, and the latest releases this week are a major salvo in the cloud enablement as a function of IT — not outside of IT. Because, like it or not, enterprise IT is the ultimate cloud broker to win over.

In other cloud applications automation news, ServiceNow on Monday announced its ServiceNow App Creator, designed to enabling “citizen developers” to rapidly create enterprise and mobile applications on the ServiceNow Service Automation Platform.

Originally targeting the ITSM function, ServiceNow is broadening the use of its tools and platform for apps outside the IT management domain, but with IT as the driver as to what platforms the developers will use. The App Creator technology itself is now included in the platform.

“This arms IT to provide developers with a rich RAD platform and puts those apps on a single platform in a single place,” said Arne Josefsberg, CTO at ServiceNow.

Leveraging a forms-based workflow on making and deploying apps and process flows, App Creator ensures “best practice” development of custom applications without requiring coding or technology expertise, said Josefsberg.

Applications that the enterprise builds on the platform are then separately licensed on a per user basis. The ServiceNow App Creator is available today to all current ServiceNow customers.

You may also be interested in:

• Service Virtualization brings speed benefit and lower costs to TTNET applications testing
• ERP for IT Helps Dutch Insurance Giant Achmea to Reinvent IT Processes to Improve Business Performance Across the Board
• McKesson Redirects IT to Become a Services Provider That Delivers Fuller Business Solutions
• Investing Well in IT With Emphasis on KPIs Separates Business Leaders from Business Laggards, Survey Results Show
• Expert Chat with HP on How Better Understanding Security Makes it an Enabler, Rather than Inhibitor, of Cloud Adoption
• Expert Chat with HP on How IT Can Enable Cloud While Maintaining Control and Governance

The next BriefingsDirect IT leadership discussion focuses on how leading Australian IT services provider Thomas Duryea Consulting made a successful journey to cloud computing as a business.

We’ll learn why a cloud-of-clouds approach is providing new types of IT services to Thomas Duryea’s many Asia-Pacific region customers.

The first part of our series addressed the rationale and business opportunity for TD’s cloud-services portfolio, which is built on VMware software.

The latest discussion continues a three-part series on how Thomas Duryea, or TD, designed, built and commercialized an adaptive cloud infrastructure. This second installment focuses on how a variety of risks associated with cloud adoption and cloud use have been identified and managed by actual users of cloud services.

Learn more about how adopters of cloud computing have effectively reduced the risks of implementing cloud models from Adam Beavis, General Manager of Cloud Services at Thomas Duryea in Melbourne, Australia. The interview is conducted by Dana Gardner, Principal Analyst at Interarbor Solutions. [Disclosure: VMware is a sponsor of BriefingsDirect podcasts.]

Here are some excerpts:

Gardner: Adam, we’ve been talking about cloud computing for years now, and I think it’s pretty well established that we can do cloud computing quite well technically. The question that many organizations keep coming back with is whether they should do cloud computing. If there are certain risks, how do they know what risks are important? How do they get through that? What are you in learning so far at TD about risk and how your customers face that?

Beavis: People are becoming more comfortable with the cloud concept as we see cloud becoming more mainstream, but we’re seeing two sides to the risks. One is the technical risks, how the applications actually run in the cloud.

Moving off-site

What we’re also seeing — more at a business level — are concerns like privacy, security, and maintaining service levels. We’re seeing that pop up more and more, where the technical validation of the solution gets signed off from the technical team, but then the concerns begin to move up to board level.

We’re seeing intense interest in the availability of the data. How do they control that, now that it’s been handed off to a service provider? We’re starting to see some of those risks coming more and more from the business side.

Gardner: I’ve categorized some of these risks over the past few years, and I’ve put them into four basic buckets. One is the legal side, where there are licenses and service-level agreements (SLAs), issues of ownership, and permissions.

The second would be longevity. That is to say, will the service provider be there for the long term? Will they be a fly-by-the-seat-of-the-pants organization? Are they are going to get bought and maybe merged into something else? Those concerns.

The third bucket I put them in is complexity, and that has to do with the actual software, the technology, and the infrastructure. Is it mature? If it’s open source, is there a risk for forking? Is there a risk about who owns that software and is that stable?

And then last, the long-term concern, which always comes back, is portability. You mentioned that about the data and the applications. We’re thinking now, as we move toward more software-defined data centers, that portability would become less of an issue, but it’s still top of mind for many of the people I speak with.

So let’s go through these, Adam. Let’s start with that legal concern. Do you have any organizations that you can reflect on and say, here is how they did it, here is how they have figured out how to manage these license and control of the IP risks?

Beavis: The legal one is interesting. As a case study, there’s a not-for-profit organization for which we were doing some initial assessment work, where we validated the technical risk and evaluated how we were going to access the data once the information was in a cloud. We went through that process, and that went fine, but obviously it then went up to the legal team.

One of the big things that the legal team was concerned about was what the service level agreeement was going to be, and how they could capture that in a contract. Obviously, we have standard SLAs, and being a smaller provider, we’re flexible with some of those service levels to meet their needs.

But the one that they really started to get concerned about was data availability … if something were to go wrong with the organization. It probably jumps into longevity a little bit there. What if something went wrong and the organization vanished overnight? What would happen with their data?

Escrow clause

That’s where we see legal teams getting involved and starting to put in things like the escrow clause, similar to what we had with software as a service (SaaS) for a long time. We’re starting to see organizations’ legal firms focus on doing these, and not just for SaaS — but infrastructure as a service (IaaS) as well. It provides a way for user organizations to access their data if provider organizations like TD were to go down.

Beavis

So that’s one that we’re seeing at the legal level. Around the terms and conditions, once again being a small service provider, we have a little more flexibility in what we can provide to the organizations on those.

Once our legal team sits down and agrees on what they’re looking for and what we can do for them, we’re able to make changes. With larger organizations, where SLAs are often set in stone, there’s no flexibility about making modifications to those contracts to suit the customer.

Gardner: Tell us about your organization, how big you are, and who your customers are, and then we’ll get back into some of these risks issues and how they have been managed.

Beavis: Traditionally, we came from a system-integrator background, based on the east coast of Australia — Melbourne and Sydney. The organization has been around for 12 years and had a huge amount of success in that infrastructure services arena, initially with VMware.

Other companies heavily expanded into the enterprise information systems area. We still have a large focus on infrastructure, and more recently, cloud. We’ve had a lot of success with the cloud, mainly because we can combine that with a managed services.

We go to market with cloud. It’s not just a platform where people come and dump data or an application. A lot of the customers that come into our cloud have some sort of managed service on top of that, and that’s where we’re starting to have a lot of success.

As we spoke about in part one, our customers drove us to start building a cloud platform. They can see the benefits of cloud, but they also wanted to ensure that for the cloud they were moving to, they had an organization that could support them beyond the infrastructure.

That might be looking after their operating systems, looking after some of their applications such as Citrix, etc. that we specialize in, looking after their Microsoft Exchange servers, once they move it to the cloud and then attaching those applications. That’s where we are. That’s the cloud at the moment.

Gardner: Is there something about the platform and industry-standard decisions that you’ve made that helps your customers feel more comfortable? Do they see less risk because, even though your organization is one organization, the infrastructure, is broader, and there’s some stability about that that comes to the table?

Beavis: Definitely. Partnering with VMware was one of our core decisions, because their platform everywhere is end-to-end standard VMware. It really gives us an advantage when addressing that risk if organizations ask what happens if our company doesn’t run or they’re not happy with the service.

The great thing is that within our environment — and it’s one part of VMware’s vision — you can then pick up those applications, and move them to another VMware cloud provider. Thank heaven, we haven’t had that happen, and we intend it not to happen. But, for organizations to understand that, if something were to go wrong, they can move that to another service provider without having to re-architect those applications or make any major changes. This is one area where we’re well getting around that longevity risk discussion.

Gardner: Is there a confluence between portability and what organizations are doing with disaster recovery (DR)? Maybe they’re mirroring data and/or infrastructure and applications for purposes of business continuity and then are able to say, “This reduces our risk, because not only do we have better DR and business continuity benefits, but we’re also setting the stage for us to be able to move this where we want, when we want.”

They can create a hybrid model, where they can pick and choose on-premises, versus a variety of other cloud providers, and even decide on those geographic or compliance issues as to where they actually physically place the data. That’s a big question, but the issue is business continuity, as part of this movement toward a lower risk, how does that pan out?

Beavis: That’s actually one of the biggest movements that we’re seeing at the moment. Organizations, when they refresh their infrastructure, don’t see the the value refreshing DR on-premise. Let the first step cloud be “let’s move the DR out to the cloud, and replicate from on-premises out into our cloud.”

Then, as you said, we have the advantage to start to do things like IaaS testing, understanding how those applications are going to work in the cloud, tweak them, get the performance right, and do that with little risk to the business. Obviously, the production machine will continue to run on-premises, while we’re testing snapshots.

It’s a good way to put a live snapshot of that environment, and how it’s going to perform in the cloud, how your users are going to access it, bandwidth, and all that type of stuff that you need to do before starting to run up. DR is still the number one use case that we’re seeing people move to the cloud.

Gardner: As we go through each of these risks, and I hear you relating how your customers and TD, your own organization, have reacted to them, it seems to me that, as we move toward this software-defined data center, where we can move from the physical hardware and the physical facilities, and move things around in functional blocks, this really solves a lot of these risk issues.

You can manage your legal, your SLAs, and your licenses better when you know that you can pick and choose the location. That longevity issue is solved, when you know you can move the entire block, even if it’s under escrow, or whatever. Complexity and fear about forking or immaturity of the infrastructure itself can be mitigated, when you know that you can pick and choose, and that it’s highly portable.

It’s a round-about way of getting to the point of this whole notion of software-defined data center. Is that really at heart a risk reduction, a future direction, that will mitigate a lot of these issues that are holding people back from adopting cloud more aggressively?

Beavis: From a service provider’s perspective it certainly does. The single-pane management window that you can do now, where you can control everything from your network — the compute and the storage — certainly reduces risk, rather than needing several tools to do that.

Backup integration

And the other area where the venders are starting to work together is the integration of things like backup, and as we spoke about earlier, DR. Tools are now sitting natively within that VMware stack around the software-defined data center, written to the vSphere API, as we’re trying to retrofit products to achieve file-level backups within a virtual data center, within vCloud. Pretty much every day, you wake up there’s a new tool that’s now supported within that.

From a service provider’s perspective it’s really reducing the risk and time to market for the new offerings, but from a customer’s perspective it’s really getting in that experience that they used to. On-premise over a TD cloud, from their perspective, makes it a lot easier for them to start to adopt and consume the cloud.

Gardner: I suppose this is a good segue into this notion of how to make your data, applications, and the configuration metadata portable across different organizations, based on some kind of a standard or definition. How does that work? What are the ways in which organizations are asking for and getting risk reduction around this concept of portability?

Beavis: Once again, it’s about having a common way that the data can move across. The basics come into that hybrid-cloud model initially, like how people are getting things out. One of the things that we see more and more is that it’s not as simple as people moving legacy applications and things up to the cloud.

To reduce that risk, we’re doing a cloud-readiness assessment, where we come in and assess what the organization has, what their environment looks like, and what’s happening within the environment, running things like the vCenter Operations tools from VMware to right-size those environments to be ready for the cloud.

Gardner: Now the flip-side of that would be that some of your customers who have been dabbling in cloud infrastructure, perhaps open-source frameworks of some kind, or maybe they have been integrating their own components of open-source available software, licensed software. What have you found when it comes to their sense of risk, and how does that compare to what we just described in terms of having stability and longevity?

More comfortable

Beavis: Especially in Australia, we probably have 85 percent to 90 percent of organizations with some sort of VMware in their data center. They no doubt seem to be more comfortable gravitating to some providers that are running familiar platforms, with teams familiar with VMware. They’re more comfortable that we, as a service provider, are running a platform that they’re used to.

We’ll probably talk about the hybrid cloud a bit later on, but that ability for them to still maintain control in a familiar environment, while running some applications across in the TD cloud, is something that is becoming quite welcoming within organizations. So there’s no doubt that choosing a common platform that they’re used to working on is giving them confidence to start to move to the cloud.

Listen to the podcast. Find it on iTunes. Read a full transcript or download a copy. Sponsor: VMware.

You may also be interested in:

• Thomas Duryea’s Journey to the Cloud: Part One
• VMware-Powered Cloud Adoption Delivers Bevy of Data and Performance Benefits for Revlon, Says CIO David Giambruno
• Services Provider BancVue Leverages VMware Server Virtualization to Generate Private-Cloud Benefits and Increased Business Agility
• Roundtable: Revlon and SAP executives describe accretive benefits from aggressive cloud adoption
• From VMworld, cosmetics giant Revlon harnesses the power of private cloud to produce impressive savings and cost avoidance
• VMware CTO Steve Herrod on How the Software-Defined Datacenter Benefits Enterprises

The cloud-based service. announced at the Ariba LIVE conference, will combine the applications and insights embedded in the Ariba Network and deliver them through a trusted and secure global-payments infrastructure to streamline and enhance settlement and reconciliation of business commerce. The service is expected to be generally available in 2014. [Disclosure: Ariba is a sponsor of BriefingsDirect podcasts.]

“It’s the classic joke: The check is in the mail. But few companies find it funny,” said Kevin Costello, president, Ariba. “Buyers are drowning in paper, and sellers have no idea when — or how much — they will be paid. AribaPay will effectively eliminate these issues.”

AribaPay will provide a way for buyers to create purchase orders, receive invoices, and send payments, while sellers receive more-detailed remittance information in a fast, secure, electronic environment.

Improving commerce

“Ariba and Discover are seizing the opportunity to digitize a share of the estimated $30 trillion in B2B payments that are still mostly made with paper checks,” said Roger Hochschild, president and chief operating officer for Discover. “Discover is broadening its network capabilities and infrastructure and choosing diverse business partners like Ariba to move beyond facilitating payments to enabling and improving business commerce.”

For buyers and sellers connected to the Ariba Network, AribaPay will deliver data that shows what payments represent at the invoice and line-item level, fueling faster, more accurate reconciliation on both sides.

Other benefits include:

• Lower processing cost
• Richer remittance advice
• Reduced fraud risk
• Elimination of paper checks and invoices
• Fewer payments lost to escheatment
• Ability to track and trace transactions
• Faster reconciliation and dispute resolution

To learn more about AribaPay and the benefits it is expected to deliver, visit: www.aribapay.com

You may also be interested in:

• The Networked Economy Newly Forges Innovation Forces for Collaboration in Business and Commerce, Syas Author Zach Tumin
• Collboration-Enhanced Procurement and AP Automation Maximize Productivity and Profit Gains in Networked Economy, Says Ariba’s Drew Hofler
• Ariba Network Helps Cox Enterprises Manage Procurement Across Six Different ERP Systems
• Ariba CMO Tim Minahan on how networked economy benefits spring from improved business commerce and cloud processes
• Ariba and Discover to Transform B2B Payments with AribaPay
•  Discover and Ariba partner for B2B Payments

Building on the formerly named Quest vFoglight Pro virtualization management solution, Dell re-branded vFoglight to Foglight for Virtualization to make it the core platform to the Foglight family. Foglight is not sitting still either. Improvements this year move beyond monitoring support for VMware View VDI, to later support for VMware vCloud Director, OpenStack, and Citrix Xen VDI. [Disclosure: Dell Software and WMware are sponsors of BriefingsDirect podcasts.]

The higher value from such ecosystem and heterogeneous management support is the ability for virtualization server and system administrators to comprehensively optimize various flavors of data-center server virtualization, as well as the major VDI types, with added capabilities to track and analyze performance from the application level all the way to the server and storage hardware level. This week’s announcements have also shown a spotlight on the recently updated Foglight for Storage Management 2.5.

“With Foglight for Virtualization, Enterprise Edition, Dell is showing its commitment to offering a  solution that encompasses all aspects of virtual infrastructure performance monitoring and management, built on a platform that can scale as the infrastructure grows,” said Steve Rosenberg, general manager for Performance Monitoring, Dell. “This new release expands Foglight’s ability not only to monitor the additional infrastructure area of VDI, but also to correlate metrics from VDI with performance for applications, the virtual layer, the network, and underlying servers and storage.”

Dell Software also last week released a series of BYOD-targeted products and services, which are related to the better VDI management capabilities. That’s because many enterprises and mid-market firms that are tasked with moving quickly to BYOD are using VDI to do it.

With the increasing adoption of VMware View in virtualized data centers (including for MSPs), VDI support is fast becoming a mainstay for today’s IT departments and managed service providers. VDI and server virtual machines (VMs) often utilize the same hardware components. Yet, both of these virtualized infrastructures serve different users and have separate requirements and resource demands, explained John Maxwell, vice president of product management for performance monitoring for virtualization, networking,storage and hardware at Dell Software.

Single-source solution

As a result, VDI and server VMs require dedicated performance monitoring systems. However, these systems must also be connected, because so many underlying resources are often shared. Agent-based Foglight for Virtualization, Enterprise Edition offers virtualization administrators a more single-source solution that not only identifies and fixes performance issues within VMware View, but continues to run all features available in vOPS Server Enterprise with no effect on overall vCenter performance.

Foglight for Storage Management 2.5 has been released as an optional “cartridge” to Foglight for Virtualization. Foglight for Storage Management now offers physical storage performance reporting in addition to virtual reporting, providing customers with complete “VM to physical LUN” visibility.

Additional enhancements in this release include LUN latency reporting, NPIV support, and the ability for customers to purchase the product either as a stand-alone cartridge, or as an optional cartridge to Foglight for Virtualization.

Additionally, Foglight is a unified performance monitoring platform that allows individual product solutions, delivered as sets of pluggable “cartridges,” to run stand-alone or to interoperate. Each individual product delivers best-of-breed functionality to the admin for that area, while simultaneously integrating with other cartridges to deliver true end-to-end monitoring from end-user experience to the underlying storage and server hardware layers, and everything in between, said Maxwell.

Foglight for Virtualization Enterprise Edition 6.8 is available now for a 45-day trial from www.quest.com. Pricing starts at $799 per socket. Foglight for Storage Management 2.5 is also available now for a 45-day trial from www.quest.com.  Pricing starts at $499 per socket.

Because Foglight is built on a common architecture to support the cartridges, it seems likely that it will move from an on-premises only offering to a SaaS-based version too, especially to support cloud- and MSP-based VDI offerings, and also to manage hybrid VDI implementations.

You may also be interested in:

• Data complexity forces need for agnostic tool chain approach for information management, says Dell Software executive
• For Dell’s Quest Software, BYOD puts users first — and with IT’s blessing
• New Levels of Automation and Precision Needed to Optimize Backup and Recovery in Virtualized Environments
• Data explosion and big data demand new strategies for data management, backup and recovery, say experts
• Ocean Observatories Initiative: Cloud and Big Data come together to give scientists unprecedented access to essential climate insights
• Case Study: Strategic Approach to Disaster Recovery and Data Lifecycle Management Pays Off for Australia’s SAI Global

Welcome to the latest edition of the HP Discover Performance Podcast Series. Our next discussion examines how TTNET, the largest internet service provider in Turkey, with six million subscribers, significantly improved applications deployment while cutting costs and time to delivery.

We’ll hear how TTNET deployed advanced Service Virtualization (SV) solutions to automate end-to-end test cases, gaining a path to integrated Unified Functional Testing (UFT).

To learn how, we’re joined by Hasan Yükselten, Test and Release Manager at TTNET, which is a subsidiary of Türk Telekom, based in Istanbul. The interview is conducted by Dana Gardner, Principal Analyst at Interarbor Solutions. [Disclosure: HP is a sponsor of this and other BriefingsDirect podcasts.]

Here are some excerpts:

Gardner: What was the situation there before you became more automated, before you started to use more software tools?

Yükselten: We’re the leading ISP in Turkey. We deploy more than 200 applications per year, and we have to provide better and faster services to our customers every week, every month. Before HP SV, we had to use the other test infrastructures in our test cases.

Yükselten

We mostly had problems on issues such as the accessibility, authorization, downtime, and private data for reaching the other third-party’s infrastructures. So, we needed virtualization on our test systems, and we needed automation for getting fast deployment to make the release time shorter. And of course, we needed to reduce our cost. So, we decided to solve the problems by implementing SV.

Gardner: How did you move from where you were to where you wanted to be?

Yükselten: Before SV, we couldn’t do automation, since the other parties are in discrete locations and it was difficult to reach the other systems. We could automate functional test cases, but for end-to-end test cases, it was impossible to do automation.

First, we implemented SV for virtualizing the other systems, and we put SV between our infrastructure and the third-party infrastructure. We learned the requests and responses and then could use SV instead of the other party infrastructure.

Automation tools

After this, we could also use automation tools. We managed to use automation tools via integrating Unified Functional Testing (UFT) and SV tools, and now we can run automation test cases and end-to-end test cases on SV.

We started to use SV in our test systems first. When we saw the success, we decided to implement SV for the development systems also.

Gardner: Give me a sense of the type of applications we’re talking about.

Yükselten: We are mostly working on customer relationship management (CRM) applications. We deploy more than 200 applications per year and we have more than six million customers. We have to offer new campaigns and make some transformations for new customers, etc.

We have to save all the informations, and while saving the information, we also interact the other systems, for example the National Identity System, through telecom systems, public switched telephone network (PSTN) systems.

We have to ask informations and we need make some requests to the other systems. So, we need to use all the other systems in our CRM systems. And we also have internet protocol television (IPTV) products, value added services products, and the company products. But basically, we’re using CRM systems for our development and for our systems.

Gardner: So clearly, these are mission-critical applications essential to your business, your growth, and your ability to compete in your market.

Yükselten: If there is a mistake, a big error in our system, the next day, we cannot sell anything. We cannot do anything all over Turkey.

Gardner: Let’s talk a bit about the adoption of SV. What you actually have in place so far?

Yükselten: Actually, it was very easy to adopt these products into our system, because including proof of concept (PoC), we could use this tool in six weeks. We spent first two weeks for the PoC and after four weeks, we managed to use the tool.

Easy to implement

For the first six weeks, we could use SV for 45 percent of end-to-end test cases. In 10 weeks, 95 percent of our test cases could be run on SV. It was very easy to implement. After that, we also implemented two other SVs in our other systems. So, we’re now using three SV systems. One is for development, one is just for the campaigns, and one is for the E2E tests.

HP Software helped us so much, especially R&D. HP Turkey helped us, because we were also using application lifecycle management (ALM) tools before SV. We were using QTP LoadRunners, Quality Center, etc., so we had a good relation with HP Software.

Since SV is a new tool, we needed a lot of customization for our needs, and HP Software was always with us. They were very quick to answer our questions and to return for our development needs. We managed to use the tool in six weeks, because of HP’s Rapid Solutions.

Gardner: My understanding is that you have something on the order of 150 services. You use 50 regularly, but you’re able to then spin up and use others on a more ad-hoc basis. Why is it important for you to have that kind of flexibility and agility?

Yükselten: We virtualized more than 150 services, but we use 48 of them actively. We use these portions of the service because we virtualized our third-party infrastructures for our needs. For example, we virtualized all the other CRM systems, but we don’t need all of them. In gateway remote, you can simulate all the other web services totally. So, we virtualized all the web services, but we use just what we need in our test cases.

In three months we got the investment back actually, maybe shorter than three months. It could have been two and half months. For example, for the campaign test cases, we gained 100 percent of efficiency. Before HP, we could run just seven campaigns in a month, but after HP, we managed to run 14 campaigns in a month.

We gained 100 percent efficiency and three man-months in this way, because three test engineers were working on campaigns like this. For another example, last month we got the metrics and we saw that we had a total blockage for seven days, so that was 21 working days for March. We saved 33 percent of our manpower with SV and there are 20 test engineers working on it. We gained 140 man-months last month.

For our basic test scenarios, we could run all test cases in 112 hours. After SV, we managed to run it in 54 hours. So we gained 100 percent efficiency in that area and also managed to do automation for the campaign test cases. We managed to automate 52 percent of our campaign test cases, and this meant a very big efficiency for us. Totally, we saved more than $50,000 per month.

Broader applications

Gardner: Do you expect now to be able to take this to a larger set of applications across Türk Telekom?

Yükselten: Yes. Türk Telekom licenses these tools and started to use these tools in their test service to get this efficiency for those systems. We have a branch company called AVEA, and they also want to use this tool. After our getting this efficiency, many companies want to use this virtualization. Eight companies visited us in Turkey to get our experiences on this tool. Many companies want this and want to use this tool in their test systems.

Gardner: Do you have any advice for other organizations like those you’ve been describing, now that you have done this? Any recommendations on what you would advise others that might help them improve on how they do it?

Yükselten: Companies must know their needs first. For example, in our company, we have three blockage systems for third parties and the other systems don’t change everyday. So it was easy to implement SV in our systems and virtualize the other systems. We don’t need to do virtualization day by day, because the other systems don’t change every day.

Once a month, we consult and change our systems, update our web services on SV, and this is enough for us. But if the other party’s systems changes day by day or frequently, it may be difficult to do virtualization every day.

This is an important point. Companies should think automation besides virtualization. This is also a very efficient aspect, so this must be also considered while making virtualization.

We started to use UFT with integrating SV. As I told you, we managed to automate 52 percent of our campaign test cases so far. So we would like to go on and try to automate more test cases, our end-to-end test cases, the basic scenarios, and other systems.

Our first goal is doing more automation with SV and UFT and the other is using SV in development sites. We plan to find early defects in development sites and getting more quality products into the test.

Rapid deployment

Of course, in this way, we get rapid deployment and we make shorter release times because the product will have more quality. Using performance test and SV also helps us on performance. We use HP LoadRunner for our performance test cases. We have three goals now, and the last one is using SV with integrating LoadRunner.

Gardner: Well, it’s really impressive. It sounds as if you put in place the technologies that will allow you to move very rapidly, to even a larger payback. So congratulations on that. Gain more insights and information on the best of IT Performance Management at www.hp.com/go/discoverperformance. And you can always access this and other episodes in our HP Discover performance podcast series on iTunes under BriefingsDirect.

Listen to the podcast. Find it on iTunes. Read a full transcript or download a copy. Sponsor: HP.

You may also be interested in:

• ERP for IT Helps Dutch Insurance Giant Achmea to Reinvent IT Processes to Improve Business Performance Across the Board
• McKesson Redirects IT to Become a Services Provider That Delivers Fuller Business Solutions
• Investing Well in IT With Emphasis on KPIs Separates Business Leaders from Business Laggards, Survey Results Show
• Expert Chat with HP on How Better Understanding Security Makes it an Enabler, Rather than Inhibitor, of Cloud Adoption
• Expert Chat with HP on How IT Can Enable Cloud While Maintaining Control and Governance
• Expert Chat on How HP Ecosystem Provides Holistic Support for VMware Virtualized IT Environments

Fast to their rescue, the suppliers of development tools and testing systems are tripping over each other to appeal to them in this new game. And as in the past with other deployment advances, we’re seeing a major philosophical split between the “nativists” (running directly on the device hardware) and the “virtualizers” (with their scripting and interpretive layers and containers).

First, the nativists. Embarcadero Technologies, with its RAD Studio and former Borland CodeGear assets, is not surprisingly catering to its skills base — the hard core developers at home in Delphi and C++Builder, as well as C and Objective-C. Embarcadero therefore today delivered RAD Studio XE4, with an attractive offer to those seeking native — what Embarcadero calls “multi-device, true native” — apps development, but across most mobile devices from a singular code base and a single core skills set. RAD Studio XE4 has a single application framework for iOS, Windows, and Mac OSX, with support for Android coming soon.

RAD Studio XE4 allows developers to gain more control over the development lifecycle and deliver apps with tighter security, a better user experience, lightning quick performance, and a small footprint. Those that want to target iOS devices, as well as OSX and Windows PCs, can write once and run anywhere, so to speak, says Embarcadero. The key is FireMonkey, a cross-platform GUI framework developed by Embarcadero to provide Delphi and C++Builders with a single framework. This is the same lineage of the graphical language tools that sprung from native (fat) PC development.

But native development for mobile (nee PCs) isn’t the only game in town, nor the only way to seek the “run anywhere” nirvana. The other approaches to the mobile and cross-platform development complexity problem are more aligned with open source, HTML5, and scripting, all with roots in the web.

And so HP last month, threw it’s weight from the IT management perspective behind “a hybrid approach” for mobile. HP Anywhere, as HP calls it, aids in the distributing and consuming of IT management information to mobile devices. But this may well be a model for far broader enterprise-to-mobile process alignment.

Especially where BYOD is the goal, the hybrid approach works best, says Genefa Murphy, Director of Mobile Product Management and User Experience at HP Software. [Disclosure: Both Embarcadero and HP are sponsors of BriefingsDirect podcasts.]

Under this “virtualizers” vision, the HP Anywhere server connects IT management systems to the HP Anywhere Client on Android or iOS devices, forming the basic client app or container on the end-point devices. Then so-called Mini-Apps are downloadable to that container to provide the access and interface to specific IT management tasks or modules.

Two best ends

These two examples of mobile enablement to me represent the two best ends of the enterprise mobile needs spectrum. And chances are, enterprises are going to need both, especially for existing applications and processes. For example, the Embarcadero approach can swiftly take existing full-client applications and deliver them to the needed mobile tier devices with strong performance and security, and no need to rewrite for each client and OS, said John Thomas (JT), Director of Product Management at Embarcadero.

For more on my views of how cloud, mobile and enterprise IT intersect, see my two-part interview on the Gathering Clouds blog.

The question yet to be answered is what combination of native, scripting, or hybrid container-type models will fit best for entirely new “mobile first” applications. This is a work in progress, and will also vary greatly from company to company, based on a maze of variables for each. Looks for a lot more blogs on that greenfield apps trend in the future.

For now, however, a lot of the pain for IT in going mobile is in getting existing PC applications via code reuse — as well as business processes on back-end systems — out to where they can be used . . . on the modern mobile landscape and in the hands of newly empowered mobile users. Incidentally, the new Embarcadero tools and framework allows .NET apps to be driven out to iOS devices in a pretty snappy fashion. That’s assuming, of course, Windows CE won’t be your preferred client environment after all. You know who you are.

Currently, RAD Studio XE4 delivers multi-device development for ARM and Intel devices, including Apple iPhone, iPod Touch, iPad, Mac OSX, Windows PCs, Slates, and Surface Pro tablets, said JT. And RAD Studio XE4 allows developers to take advantage of the full range of capabilities available on each of those devices to deliver the best user experience, he added. The full Android support should come mid-year.

The Embarcadero tools allow developers or designers to also quickly create no-code, visual mockups with live or simulated data and deploy to actual target devices (like PCs, phones, or tablets), or simulate on Windows or Mac, so that the requirements and app role can be best defined and tuned.

RAD Studio XE4 is available immediately. To download a free trial, visit http://www.embarcadero.com/products/rad-studio/downloads. Pricing starts at $1,799. Delphi and C++Builder pricing starts at $149 for Starter edition and $999 and up for full commercial development licenses. Upgrade discounts are available for users of recent earlier versions. An introductory 10 percent discount is available on most RAD Studio XE4 family products through May 22.

As for HP Anywhere, it manages the cross-platform device client issue using HMTL5 and Javascipt, and we’ll be seeing a lot of that too from many “virtualizers.” HP also boats RAD via an emulator that allows quick switching between device views. HP is taking its HP Anywhere story to both the test and QA people as well as developers as they seek ways to bring more business functions to the mobile enterprise worker corps.

You may also be interested in:

• Cloud, mobile bringin new value to Agile development methods, even in bite-sized chunks
• Internet of mobile and cloud era demands new kind of diverse and dynamic performance response, says Akamai GM Mike Afergan
• New HP application transformation offerings help enterprises tackle growing use of mobile computing and social media
• Multi-device tool architecture from Embarcadero primes pump for accelerated enterprise mobile development for 2013
• Android gaining as enterprises ramp up mobile app development across platforms and business models

A data dichotomy has changed the face of information management, bringing with it huge new data challenges for businesses to solve.

The dichotomy means that organizations, both large and small, not only need to manage all of their internal data to provide intelligence about their businesses, they need to manage the growing reams of increasingly external big data that enables them to discover new customers and drive new revenue.

The latest BriefingsDirect software how-to discussion then focuses on bringing far higher levels of automation and precision to the task of solving such varied data complexity. By embracing an agnostic, end-to-end tool chain approach to overall data and information management, businesses are both solving complexity and managing data better as a lifecycle.

To gain more insights on where the information management market has been and where it’s going, we are joined by Matt Wolken, Executive Director and General Manager for Information Management at Dell Software. The discussion is moderated by Dana Gardner, Principal Analyst at Interarbor Solutions. [Disclosure: Dell Software is a sponsor of BriefingsDirect podcasts.]

Here are some excerpts:

Gardner: What are the biggest challenges that businesses need to solve now when it comes to data and information management?

Wolken: About 10 or 15 years ago, the problem was that data was sitting in individual databases around the company, either in a database on the backside of an application, the customer relationship management (CRM) application, the enterprise resource planning (ERP) application, or in data marts around the company. The challenge was how to bring all this together to create a single cohesive view of the company?

Wolken

That was yesterday’s problem, and the answer was technology. The technology was a single, large data warehouse. All of the data was moved to it, and you then queried that larger data warehouse where all of the data was for a complete answer about your company.

What we’re seeing now is that there are many complexities that have been added to that situation over time. We have different vendor silos with different technologies in them. We have different data types, as the technology industry overall has learned to capture new and different types of data — textual data, semi-structured data, and unstructured data — all in addition to the already existing relational data. Now, you have this proliferation of other data types and therefore other databases.

The other thing that we notice is that a lot of data isn’t on premise any more. It’s not even owned by the company. It’s at your software-as-a-service (SaaS) provider for CRM, your SaaS provider for ERP, or your travel or human resources (HR) provider. So data again becomes siloed, not only by vendor and data type, but also by location. This is the complexity of today, as we notice it.

Cohesive view

All of this data is spread about, and the challenge becomes how do you understand and otherwise consume that data or create a cohesive view of your company? Then there is still the additional social data in the form of Twitter or Facebook information that you wouldn’t have had in prior years. And it’s that environment, and the complexity that comes with it, that we really would like to help customers solve.

Gardner: When it comes to this so-called data dichotomy, is it oversimplified to say it’s internal and external, or is there perhaps a better way to categorize these larger sets that organizations need to deal with?

Wolken: There’s been a critical change in the way companies go about using data. There are some people who want to use data for an outcome-based result. This is generally what I would call the line-of-business concern, where the challenge with data is how do I derive more revenue out of the data source that I am looking at.

What’s the business benefit for me examining this data? Is there a new segment I can codify and therefore market to? Is there a campaign that’s currently running that is not getting a good response rate, and if so, do I want to switch to another campaign or otherwise improve it midstream to drive more real value in terms of revenue to the company?

That’s the more modern aspect of it. All of the prior activities inside business intelligence (BI) — let’s flip those words around and say intelligence about the business — was really internally focused. How do I get sanctioned data off of approved systems to understand the official company point of view in terms of operations?

That second goal is not a bad goal. That’s still a goal that’s needed, and IT is still required to create that sanctioned data, that master data, and the approved, official sources of data. But there is this other piece of data, this other outcome that’s being warranted by the line of business, which is, how do I go out and use data to derive a better outcome for my business? That’s more operationally revenue-oriented, whereas the internal operations are around cost orientation and operations.

So where you get executive dashboards for internal consumption off of BI or intelligence for the business, the business units themselves are about visualization, exploration, and understanding and driving new insights.

It’s a change in both focus and direction. It sometimes ends up in a conflict between the groups, but it doesn’t really have to be that way. At least, we don’t think it does. That’s something that we try to help people through: How do you get the sanctioned data you need, but also bring in this third-party data and unstructured data and add nuance to what you are seeing about your company.

Gardner: Do traditional technology offerings allow this dichotomy to be joined, or do we need a different way to create these insights across both internal and external information?

Wolken: There are certainly ways to get to anything. But if you’re still amending program after program or technology after technology, you end up with something less than the best path, and there might be new and better ways of doing things.

Agnostic tool chain

There are lots of ways to take a data warehouse forward in today’s environment, manipulate other forms of data so it can enter a data warehouse or relational data warehouse, and/or go the other way and put everything into an unstructured environment, but there’s also another way to approach things, and that’s with an agnostic tool chain.

Tools have existed in the traditional sense for a long time. Generally, a tool is utilized to hide complexity and all of the issues underneath the tool itself. The tool has intelligence to comprehend all of the challenges below it, but it really abstracts that from the user.

We think that instead of buying three or four database types, a structured database, something that can handle text, a solution that handles semi-structured or structured, or even a high performance analytical engine for that matter, what if the tool chain abstracts much of that complexity? This means the tools that you use every day can comprehend any database type, data structure type, or any vendor changes or nuances between platforms.

That’s the strategy we’re pursuing at Dell. We’re defining a set of tools — not the underlying technologies or proliferation of technologies — but the tools themselves, so that the day-to-day operations are hidden from the complexity of those underlying sources of vendor, data type, and location.

That’s how we really came at it — from a tool-chain perspective, as opposed to deploying additional technologies. We’re looking to enable customers to leverage those technologies for a smoother, more efficient, and more effective operation.

Let’s just take data integration as a point. I can sometimes go after certain siloed data integration products. I can go after a data product that goes after cloud resources. I can get a data product that only goes after relational. I can get another data product to extract or load into Hive or Hadoop. But what if I had one that could do all of that? Rather than buying separate ones for the separate use cases, what if you just had one?

Gardner: What are the stakes here? What do you get if you do this right?

Institutional knowledge

Wolken: There are a couple of ways we think about it, one of which is institutional knowledge. Previously, if you brought in a new tool into your environment to examine a new database type, you would probably hire a person from the outside, because you needed to find that skill set already in the market in order to make you productive on day one.

Instead of applying somebody who knows the organization, the data, the functions of the business, you would probably hire the new person from the outside. That’s generally retooling your organization.

Or, if you switch vendors, that causes a shift as well. One primary vendor stack is probably a knowledge and domain of one of your employees, and if you switch to another vendor stack or require another vendor stack in your environment, you’re probably going to have to retool yet again and find new resources. So that’s one aspect of human knowledge and intelligence about the business.

There is a value to sharing. It’s a lot harder to share across vendor environments and data environments if the tools can’t bridge them. In that case, you have to have third-party ways to bridge those gaps between the tools. If you have sharing that occurs natively in the tool, then you don’t have to cross that bridge, you don’t have the delay, and you don’t have the complexity to get there.

So there is a methodology within the way you run the environment and the way employees collaborate that is also accelerated. We also think that training is something that can benefit from this agnostic approach.

But also, generically, if you’re using the same tools, then things like master data management (MDM) challenges become more comprehensive, if the tool chain understands where that MDM is coming from, and so on.

You also codify how and where resources are shared. So if you have a person who has to provision data for an analyst, and they are using one tool to reach to relational data, another to reach into another type of data, or a third-party tool to reach into properties and SaaS environments, then you have an ineffective process.

You’re reaching across domains and you’re not as effective as you would be if you could do that all with one tool chain.

So those are some of the high-level ideas. That’s why we think there’s value there. If you go back to what would have existed maybe 10 or 15 years ago, you had one set of staff who used one set of tools to go back against all relational data. It was a construct that worked well then. We just think it needs to be updated to account for the variance within the nuances that have come to the fore as the technology has progressed and brought about new types of technology and databases.

Gardner: What are typically some of the business paybacks, and do they outweigh the cost?

Investment cycles

Wolken: It all depends on how you go about it. There are lots of stories about people who go on these long investment cycles into some massive information management strategy change without feeling like they got anything out of it, or at least were productive or paid back the fee.

There’s a different strategy that we think can be more effective for organizations, which is to pursue smaller, bite-size chunks of objective action that you know will deliver some concrete benefit to the company. So rather than doing large schemes, start with smaller projects and pursue them one at a time incrementally — projects that last a week and then you have 52 projects that you know derive a certain value in a given time period.

Other things we encourage organizations to do deal directly with how you can use data to increase competitiveness. For starters, can you see nuances in the data? Is there a tool that gives you the capability to see something you couldn’t see before? So that’s more of an analytical or discovery capability.

There’s also a capability to just manage a given data type. If I can see the data, I can take advantage of it. If I can operate that way, I can take advantage of it.

Another thing to think about is what I would call a feedback mechanism, or the time or duration of observation to action. In this case, I’ll talk about social sentiment for a moment. If you can create systems that can listen to how your brand is being talked about, how your product is being talked about in the environment of social commentary, then the feedback that you’re getting can occur in real time, as the comments are being posted.

Now, you might think you’ll get that anyway. I would have gotten a letter from a customer two weeks from now in the postal system that provided me that same feedback. That’s true, but sometimes that two weeks can be a real benefit.

Imagine a marketing campaign that’s currently running in the East, with a companion program in the West that’s slightly different. Let’s say it’s a two-week program. It would be nice if, during the first week, you could be listening to social media and find out that the campaign in the West is not performing as well as the one in the East, and then change your investment thesis around the program — cancel the one that’s not performing well and double down on the one that’s performing well.

There’s a feedback mechanism increase that also can then benefit from handling data in a modern way or using more modern resources to get that feedback. When I say modern resources, generally that’s pointing towards unstructured data types or textual data types. Again, if you can comprehend and understand those within your overall information management status, you now also have a feedback mechanism that should increase your responsiveness and therefore make your business more competitive as well.

Gardner: Given that these payoffs could be so substantial, what’s between companies and the feedback benefits?

It’s the complexity

Wolken: I think it’s complexity of the environment. If you only had relational systems inside your company previously, now you have to go out and understand all of the various systems you can buy, qualify those systems, get pure feedback, have some proofs of concept (POCs) in development, come in and set all these systems up, and that just takes a little bit of time. So the more complexity you invite into your environment, the more challenges you have to deal with.

After that, you have to operate and run it every day. That’s the part where we think the tool chain can help. But as far as understanding the environment, having someone who can help you walk through the choices and solutions and come up with one that is best suited to your needs, that’s where we think we can come in as a vendor and add lots of value.

When we go in as a vendor, we look at the customer environment as it was, compare that to what it is today, and work to figure out where the best areas of collaboration can be, where tools can add the most value, and then figure out how and where can we add the most benefit to the user.

What systems are effective? What systems collaborate well? That’s something that we have tried to emulate, at least in the tool space. How do you get to an answer? How do you drive there? Those are the questions we’re focused on helping customers answers.

For example, if you’ve never had a data warehouse before, and you are in that stage, then creating your first one is kind of daunting, both from a price perspective, as well as complexity perspective or know-how. The same thing can occur on really any aspect — textual data, unstructured data, or social sentiment.

Each one of those can appear daunting if you don’t have a skill set, or don’t have somebody walking you through that process who has done it before. Otherwise, it’s trying to put your hands on every bit of data and consume what you can and learning through that process.

Those are some of the things that are really challenging, especially if you’re a smaller firm that has a limited number of staff and there’s this new demand from the line of business, because they want to go off in a different direction and have more understanding that they couldn’t get out of existing systems.

How do you go out and attain that knowledge without duplicating the team, finding new vendor tools, and adding complexity to your environment, maybe even adding additional data sources, and therefore more data-storage requirements. Those are some of the major challenges — complexity, cost, knowledge, and know-how.

Gardner: Why are mid-market organizations now more able to avail themselves of some of these values and benefits than in the past?

Mid-market skills

Wolken: As the products are well-known, there is more trained staff that understands the more common technologies. There are more codified ways of doing things that a business can take advantage of, because there’s a large skill set, and most of the employees may already have that skill set as you bring them into the company.

There are also some advantages just in the way technologies have advanced over the years. Storage used to be very expensive, and then it got a little cheaper. Then solid-state drives (SSD) came along and then that got cheaper as well. There are some price point advantages in the coming years, as well.

Dell overall has maintained the status that we started with when Michael Dell started recreating PCs in his dorm room from standard product components to bring the price down. That model of making technology attainable to larger numbers of people has continued throughout Dell’s history, and we’re continuing it now with our information management software business.

We’re constantly thinking about how we can reduce cost and complexity for our customers. One example would be what we call Quickstart Data Warehouse. It was designed to democratize data to a lower price point, to bring the price and complexity down to a much lower space, so that more people can afford and have their first data warehouse.

We worked with our partner Microsoft, as well as Dell’s own engineering team, and then we qualified the box, the hardware, and the systems to work to the highest peak performance. Then, we scripted an upfront install mechanism that allows the process to be up and running in 45 minutes with little more than directing a couple of IP addresses. You plug the box in, and it comes up in 45 minutes, without you having to have knowledge about how to stand up, integrate, and qualify hardware and software together for an outcome we call a data warehouse.

Another thing we did was include Boomi, which is a connector to automatically go out and connect to the data sources that you have. It’s the mechanism by which you bring data into it. And lastly, we included services, in case there were any other questions or problems you had to set it up.

If you have a limited staff, and if you have to go out and qualify new resources and things you don’t understand, and then set them up and then actually run them, that’s a major challenge. We’re trying to hit all of the steps, and the associated costs — time and/or personnel costs – and remove them as much as we can.

It’s one way vendors like Dell are moving to democratize business intelligence a little further, bring it to a lower price point than customers are accustomed too and making it more available to firms that either didn’t have that luxury of that expertise link sitting around the office, or who found that the price point was a little too high.

Gardner: You mentioned this concept of the tool chain several times — being agnostic to the data type, holistic management, complete view, and then of course integrate it. What is it about the tool chain that accomplishes both a comprehensive value, but also allows it to be adopted on a fairly manageable path, rather than all at once?

Wolken: One of the things we find advantageous about entering the market at this point in time is that we’re able to look at history, observe how other people have done things over time, and then invest in the market with the realization that maybe something has changed here and maybe a new approach is needed.

Different point of view

Whereas the industry has typically gone down the path of each new technology or advancement of technology requires a new tool, a new product, or a new technology solution, we’ve been able to stand back and see the need for a different approach. We just have a different point of view, which is that an agnostic tool chain can enable organizations to do more.

So when we look at database tools, as an example, we would want a tool that works against all database types, as opposed to one that works against only a single vendor or type of data.

The other thing that we look at is if you walk into an average company today, there are already a lot of things laying around the business. A lot of investment has already been made.

We wanted to be able to snap in and work with all of the existing tools. So, each of the tools that we’ve acquired, or have created inside the company, were made to step into an existing environment, recognize that there were other products already in the environment, and recognize that they probably came from a different vendor or work on a different data type.

That’s core to our strategy. We recognize that people were already facing complexity before we even came into the picture, so we’re focused on figuring out how we snap into what they already have in place, as opposed to a rip-and-replace strategy or a platform strategy that requires all of the components to be replaced or removed in order for the new platform to take its place.

What that means is tools should be agnostic, and they should be able to snap into an environment and work with other tools. Each one of the products in the tool chain we’ve assembled was designed from that point of view.

But beyond that, we’ve also assembled a tool chain in which the entirety of the chain delivers value as a whole. We think that every point where you have agnosticism or every point where you have a tool that can abstract that lower amount of complexity, you have savings.

You have a benefit, whether it’s cost savings, employee productivity, or efficiency, or the ability to keep sanctioned data and a set of tools and systems that comprehend it. The idea being that the entirety of the tool chain provides you with advantages above and beyond what the individual components bring.

Now, we’re perfectly happy to help a customer at any point where they have difficultly and any point where our tools can help them, whether it’s at the hardware layer, from the traditional Dell way, at the application layer, considering a data warehouse or otherwise, or at the tool layer. But we feel that as more and more of the portfolio – the tool chain – is consumed, more and more efficiency is enabled.

Gardner: It also sounds as if this sets you up for a data and information lifecycle benefits, not just on the business and BI benefits, but also on the IT benefits.

Wolken: One of the problems that you uncover is that there’s a lot of data being replicated in a lot of places. One of the advantages that we’ve put together in the tool chain was to use virtualization as a capability, because you know where data came from and you know that it was sanctioned data. There’s no reason to replicate that to disk in another location in the company, if you can just reach into that data source and pull that forward for a data analyst to utilize.

You can virtually represent that data to the user, without creating a new repository for that person. So you’re saving on storage and replication costs. So if you’re looking for where is there efficiency in the lifecycle of data and how can you can cut some of those costs, that’s something that jumps right out.

Doing that, you also solve the problem of how to make sure that the data that was provisioned was sanctioned. By doing all of these things, by creating a virtual view, then providing that view back to the analyst, you’re really solving multiple pieces of the puzzle at the same time. It really enables you to look at it from an information-management point of view.

One of the advantages

Gardner: How should enterprises and mid-market firms get started?

Wolken: Most companies aren’t just out there asking how they can get a new tool chain. That’s not really the strategy most people are thinking about. What they are asking is how do I get to the next stage of being an intelligent company? How do I improve my maturity in business intelligence? How would I get from Excel spreadsheets without a data warehouse to a data warehouse and centralized intelligence or sanctioned data?

Each one of these challenges come from a point of view of, how do I improve my environment based upon the goals and needs that I am facing? How do I grow up as a company and get to be more of a data-based company?

Somebody else might be faced with more specific challenges, such a line of business is now asking me for Twitter data, and we have no systems or comprehension to understand that. That’s really the point where you ask, what’s going to be my strategy as I grow and otherwise improve my business intelligence environment, which is morphing every year for most customers.

That’s the way that most people would start, with an existing problem and an objective or a goal inside the company. Generically, over time, the approach to answering it has been you buy a new technology from a new vendor who has a new silo, and you create a new data mart or data warehouse. But this is perpetuating the idea that technology will solve the problem. You end up with more technologies, more vendor tools, more staff, and more replicated data. We think this approach has become dated and inefficient.

But if, as an organization, you can comprehend that maybe there is some complexity that can be removed, while you’re making an investment, then you free yourself to start thinking about how you can build a new architecture along the way. It’s about incremental improvement as well as tangible improvement for each and every step of the information management process.

So rather than asking somebody to re-architect and rip and replace their tool chain or the way they manage the information lifecycle, I would say you sort of lean into it in a way.

If you’re really after a performance metric and you feel like there is a performance issue in an environment, at Dell we have a number of resources that actually benchmark and understand the performance and where bottlenecks are in systems.

Sometimes there’s an issue occurring inside the database environment. Sometimes it’s at the integration layer, because integration isn’t happening as well as you think. Sometimes it’s at the data warehouse layer, because of the way the data model was set up. Whatever the case, we think there is value in understanding the earlier parts of the chain, because if they’re not performing well, the latter parts of the chain can’t perform either.

And so at each step, we’ve looked at how you ensure the performance of the data. How do you ensure the performance of the integration environment? How do you ensure the performance of the data warehouse as well? We think if each component of the tool chain in working as well as it should be, then that’s when you enable the entirety of your solution implementation to truly deliver value.

Listen to the podcast. Find it on iTunes. Read a full transcript or download a copy. Sponsor: Dell Software.

You may also be interested in:

• For Dell’s Quest Software, BYOD Puts Users First and with IT’s Blessing
• Data explosion and big data demand new strategies for data management, backup and recovery, say experts
• Ocean Observatories Initiative: Cloud and Big Data come together to give scientists unprecedented access to essential climate insights
• Case Study: Strategic Approach to Disaster Recovery and Data Lifecycle Management Pays Off for Australia’s SAI Global
• Virtualization Simplifies Disaster Recovery for Insurance Broker Myron Steves While Delivering Efficiency and Agility Gains Too

Available in consumer basic, consumer pro, and enterprise editions, nCrypted Cloud encrypts information stored on popular cloud services such as Dropbox, Google Drive and Microsoft’s SkyDrive. The software is as simple to use as the services it works with, says Nick Stamos, the CEO and Co-Founder of nCrypted Cloud, while offering the robustness and controls that enterprise IT departments need.

Stamos says nCrypted Cloud’s security privacy protections fill a glaring gap in cloud storage services today.

“The promise of the cloud is ‘put everything in the cloud and it will be available’ – but that’s the problem as well as the promise,” says Stamos, who is also principal and founder of The Stamos Group.

Popular cloud-based storage services lack the security and privacy that enterprises require, yet employees are using them anyway — with the rise of BYOD and mobility, users want access to files anytime, from anywhere. This leaves enterprise IT departments searching for a way to protect corporate information stored in the cloud.

In a related develoment, last month we reported on OwnCloud, Inc. and its release of the latest version of the ownCloud Community Edition with a number of usability, performance, and integration enhancements. The ownCloud file sync and share software, deployed on-premise, not only offers users greater control, but allows organizations to integrate existing security, storage, monitoring and reporting tools.

Mobile data management solutions have proven too restrictive and inflexible, said Stamos, while trying to implement corporate policies that prohibit employees from storing and accessing personal and corporate data from a mobile device is unreasonable. Enterprise IT needs a solution that users won’t attempt to work around, but will embrace, he says.

“We allow users to apply privacy controls to personal data, as well as corporate data, so that if an employee parts ways with a company he can revoke access to that personal data from a corporate device, and vice versa,” explains Stamos. “That makes it a value proposition that users feel comfortable with.” Meanwhile, enterprise security policies can be used to govern work files and allow for revocation of access if needed.

Enhance, not replace

One key distinction about nCrypted Cloud is that it works with existing cloud-storage services, instead of replacing them.

“We provide the same sort of native user experience … so it’s not disruptive end users. The last thing the world needed was a new storage provider,” says Stamos. “What people need is to be able to use the Dropbox they love…in the context of it being more secure by just being able to make folders private or share them securely. They can continue to have their data where it is and how it’s organized without being disruptive in any way, shape or form.”

nCrypted Cloud’s persistent client-side encryption ensures that data isn’t exposed and the software offers comprehensive key-management features to facilitate administration. When a user accesses corporate files from any device, her predefined access policies and sharing status is verified and keys for her user ID are sent to the device.

That client caches keys for offline access to files, and keys can be removed if the access policies change. Users can easily access and share files in different cloud-based storage services and have a single-pane view of cloud and corporate file repositories.

The consumer basic version of nCrypted Cloud is available for free. The consumer pro version costs $5 per month and includes managed secure sharing, some file auditing, and the capability to manage files stored in different cloud services. The enterprise edition – which enters beta testing next week – well be priced at $10 per month. It includes all of the capabilities of the consumer pro version as well as  enhancements such as multiple identities, centralized provisioning and policy control and a full audit trail of 30-day archives.

Downloads and more information are available at www.ncryptedcloud.com.

(BriefingsDirect contributor Cara Garretson provided editorial assistance and research on this post. She can be reached on LinkedIn.)

You may also be interested in:

•  ownCloud debuts cloud tool to give organizations more control over file sync and software
• Convercent’s cloud app aims to help employees implement, measure, and rate corproate values and culture
• Improving signal-to-noise in risk management
• For Dell’s Quest Software, BYOD puts users first — and with IT’s blessing
• New Levels of Automation and Precision Needed to Optimize Backup and Recovery in Virtualized Environments
• Data explosion and big data demand new strategies for data management, backup and recovery, say experts