Ventana Research Analyst Perspectives provide unique fact-based insights and education on business, industry and technology vendor trends. Each Analyst Perspective presents the voice of the analyst, typically a practice leader and established subject matter expert,  reporting on new developments, the findings of benchmark research, market shifts and best practice insights. Each Analyst Perspective is prepared in accordance with Ventana Research’s strict standards for accuracy and objectivity and reviewed to ensure it delivers reliable, actionable news and insights.  

Internet of Things Requires Operational Intelligence

The emerging Internet of Things (IoT) is an extension of digital connectivity to devices and sensors in homes, businesses, vehicles and potentially almost anywhere. This innovation means that virtually any device can generate and transmit data about its operations – data to which analytics can be applied to facilitate monitoring and a range of automatic functions. To do these tasks IoT requires what Ventana Research calls operational intelligence (OI), a discipline that has evolved from the capture and analysis of instrumentation, networking and machine-to-machine interactions of many types. We define operational intelligence as a set of event-centered information and analytic processes operating across an organization that enable people to use that event information to take effective actions and make optimal decisions. Ventana Research first began covering operational intelligence over a decade ago.

In many industries, organizations can gain competitive advantage if they reduce the elapsed time between an event occurring and actions taken or decisions made in response to it. Existing business intelligence (BI) tools provide useful analysis of and reporting on data drawn from previously recorded transactions, but to improve competitiveness and maximize efficiencies organizations are concluding that employees and processes in IT, business operations and front-line customer sales, service and support also need to be able to detect and respond to events as they happen.

Both business objectives and regulations are driving demand for new operational intelligence technology and practices. By using them many activities can be managed better, among them manufacturing, customer engagement processes, algorithmic trading, dynamic pricing, yield management, risk management, security, fraud detection, surveillance, supply chain and call center optimization, online commerce and gaming. Success in efforts to combat money laundering, terrorism or other criminal behavior also depends on reducing information latency through the application of new techniques.

The evolution of operational intelligence, especially in conjunction with IoT, is encouraging companies to revisit their priorities and spending for information technology and application management. However, sorting out the range of options poses a challenge for both business and IT leaders. Some see potential value in expanding their network infrastructure to support OI. Others are implementing event processing (EP) systems that employ new technology to detect meaningful patterns, anomalies and relationships among events. Increasingly, organizations are using dashboards, visualization and modeling to notify nontechnical people of events and enable them to understand their significance and take appropriate and immediate action.

As with any innovation, using OI for IoT may require substantial changes to organizations. These are among the challenges they face as they consider adopting this evolving operational intelligence:

  • They find it difficult to evaluate the business value of enabling real-time sensing of data and event streams using radio frequency identification (RFID) tags, agents and other systems embedded not only in vr_oi_factors_impeding_ol_implementationphysical locations like warehouses but also in business processes, networks, mobile devices, data appliances and other technologies. 

  • They lack an IT architecture that can support and integrate these systems as the volume, variety and frequency of information increase. In addition, our previous operational intelligence research shows that these data sources are incomplete or inadequate in nearly two out of five organizations.
  • They are uncertain how to set reasonable business and IT expectations, priorities and implementation plans for important technologies that may conflict or overlap. These can include BI, event processing, business process management, rules management, network upgrades, and new or modified applications and databases. 

  • They don’t understand how to create a personalized user experience that enables nontechnical employees in different roles to monitor data or event streams, identify significant changes, quickly understand the correlation between events and develop a context adequate to enable determining the right decisions or actions to take. 

Today’s fast-paced, 24-by-7 world has forced organizations to reduce the latency between when transactions and other data are recorded and when applications and BI systems are made aware of them and thus can take action. Furthermore, the introduction of low-cost sensors and the instrumentation of devices ranging from appliances and airline engines to crop management and animal feeding systems creates opportunities that have never before existed. Technological developments such as smart utility meters, RFID and embedded computing devices for environmental monitoring, surveillance and other tasks also are creating demand for tools that can provide insights in real time from continuous streams of event data.

As organizations expand business intelligence to serve operational needs by deploying dashboards and other portals, they are recognizing the need to implement technology and develop practices that collect events, correlate them into meaningful patterns and use workflow, rules and analytics to guide how employees and automated processes should react. In financial services, online commerce and other industries, for example, some organizations have built proprietary systems or have gone offshore to employ large teams of technicians at outsourcing providers to monitor transactions and event streams for specific patterns and anomalies. To reduce the cost, complexity and imperfections in these procedures, organizations now are seeking technology that can standardize and automate event processing and notify appropriate personnel of significant events in real time.

Conventional database systems are geared to manage discrete sets of data for standard BI queries, but event streams from sources such as sensing devices typically are continuous, and their analysis requires tools designed to enable users to understand causality, patterns, time relationships and other factors. These requirements have led to innovation in event stream processing, event modeling, visualization and analytics. More recently the advent of open source and Hadoop-related big data technologies such as Flume, Kafka, Spark and Storm are enabling a new foundation for operational intelligence. Innovation in the past few years has occurred in both the open source community and proprietary implementations.

Many of the early adopters of operational intelligence technologies were in financial services and intelligence, online services and security. However, as organizations across a range of other industries seek new competitive advantages from information or require real-time insight for risk management and regulatory compliance, demand is increasing broadly for OI technologies. Organizations are considering how to incorporate event-driven architectures, monitor network activity for significant event patterns and bring event notification and insight to users through both existing and new dashboards and portals.

To help understand how organizations are tackling these changes Ventana Research is conducting benchmark research on The Internet of Things and Operational Intelligence. The research will explore how organizations are aligning themselves to take advantage of trends in operational intelligence and IoT. Such alignment involves not just information and technology, but people and VentanaResearch_IoT_OI_BenchmarkResearchprocesses as well. For instance, IoT can have a major impact on business processes, but only if organizations can realign IT systems to a discover-and-adapt rather than a model-and-apply paradigm. For instance, business processes are often outlined in PDF documents or through business process systems. However, these processes are often carried out in an uneven fashion different from the way the model was conceived. As more process flows are directly instrumented and some processes carried out by machines, the ability to model directly based on the discovery of those event flows and to adapt to them (either through human learning or machine learning) becomes key to successful organizational processes.

By determining how organizations are addressing the challenges of implementing these technologies and aligning them with business priorities, this research will explore a number of key issues, the following among them:

  • What is the nature of the evolving market opportunity? What industries and LOBs are most likely to adopt OI for IoT?
  • What is the current thinking of business and IT management about the potential of improving processes, practices and people resources through implementation of these technologies? 

  • How far along are organizations in articulating operational intelligence and IoT objectives and implementing technologies, including event processing? 

  • Compared to IT management, what influence do various business functions, including finance and operations management, have on the process of acquiring and deploying these event-centered technologies? 

  • What suppliers are organizations evaluating to support operational intelligence and IoT, including for complex event processing, event modeling, visualization, activity monitoring, and workflow, process and rules management? 

  • Who are the key decision-makers and influencers within organizations?

Please join us in this research. Fill out the survey to share your organization’s existing and planned investments in the Internet of Things and operational intelligence. Watch this space for a report of the findings when the research is completed.


David Menninger

SVP & Research Director

Qlik Makes Sense of its Analytics and Business Value

At the 2015 technology analyst summit in Austin, Texas, analytics and business intelligence software vendor Qlik discussed recent market and product developments and explained its roadmap and strategy for 2016. Discussion topics included its Qlik Analytics Platform and QlikView 12.0, Qlik Sense and Qlik DataMarket, applications built on the platform but also how it is expanding its analytics experience for business.

The engine of Qlik Analytics Platform is Qlik Indexing Engine (QIX) provides sophisticated correlation analysis, or what the company calls an “associative experience.” Qlik uses a simple but powerful visual approach to help users understand and explore data. For instance, values in a data set can be highlighted in green, directly linked values are white, excluded but still related values are light gray, and completely unrelated values are dark gray. The key differentiator from other tools in the market is in the light gray areas, which lead users to natural next steps in investigation of the data or what we call guided analytics. Put another way, this associativeVR_AnalyticsandBI_VI_HotVendor_2015 experience enables users to explore all of the data relationships and avoid confirmation bias, which results from having a predefined idea of how data should be related. Most other visual discovery tools are still beholden to confirmation bias since the data model is based on a specific hypothesis of data relationships put forward by a developer or business user. Neither visual exploration nor human intellect alone can discover all patterns, especially the most complex ones. To make sense of large data sets, however, data mining and statistical techniques such as correlation can find patterns, relationships and anomalies in the data. The associative experience helped contribute to Qlik earning a Hot Vendor rating in our 2015 Analytics and Business Intelligence Value Index.

Qlik Sense is the company’s flagship visual analytics software that combines the associative functionality with easy-to-manage, high-performing and scalable approach. Its aim is to give business users a simplified visual analytic experience that takes advantage of modern technologies that can operate in cloud computing environment. The Qlik Sense architecture allows a choice to do visual design on the server or on the client and provides users with streamlined management capabilities and an intuitive user experience. Other ease-of-use functions include probabilistic search capabilities and automatic linking of objects within newly created dashboards. The user experience in both design and in consumption is important; our benchmark research on analytics software in the last four years consistently finds that usability is the most important product evaluation criterion for companies. But the importance of manageability and reliability is critical to which is why organizations should broaden its evaluation to not just be about the features of the product.

Qlik Sense, at time of this analysis is version 2.1, is complemented by announcements Qlik made over the last year. They include Qlik Sense Cloud, which provides cloud hosting services for Qlik Sense, and Qlik DataMarket, which offers enriched analytic data sets that are integrated and ready for consumption by analytic users. This service, often called data as a service (DaaS), provides information to be used in both descriptive and predictive analytic scenarios. My colleague Robert Kugel has written about this in what is called Cryptic Data and where Qlik is removing the hassle of integrating relevant external data into analytics.  Using a cloud-based architecture, vr_DAC_07_importance_of_external_data_sourcesQlik is able to easily bring together data from external sources, which according to our data and analytics in the cloud benchmark research include cloud-based business applications (61%), social media (49%), Internet information (48%), government sources (33%), market sources (29%) and data brokers (27%). Preintegration of data sets is an emerging trend that helps address the most formidable challenge in cloud computing, which is data preparation (cited by 55% of organizations).

Qlik was a pioneer in the visual discovery market with QlikView. More recently, it took time to rearchitect Qlik Sense to take advantage of technological advances such as cloud computing. That move temporarily disrupted the company’s momentum in the market but has rapidly accelerated forward and is approaching to be a billion dollar provider of analytics software. Now Qlik appears to have gotten much of its momentum back in company revenue growth but in the adoption and deployment of Qlik Sense.

Qlik’s partner strategy continues to advance where they have been embedded in a significant number of applications across industries. Having a modern architecture, the company can take several directions, such as entry into various platform-as-a-service (PaaS) ecosystems and be part of those environments. The Qlik Branch tool provides resources for embedding Qlik Sense directly into applications, enabling developers to build extensions using modern RESTful approaches. The site provides developer tools, community efforts such as d3.js integration and synchronization with Github for sharing and branching of designs. This provides an advantage to Qlik as these community assets can be used by innovative enterprises and independent software vendors (ISVs). Furthermore, Qlik can use these development efforts to decide where to invest its own resources in product development and support. The ability to also combine DaaS into its efforts reinforces the company’s competitive position and unique differentiation with these innovative efforts for enterprises and application assemblers and developers including ISVs.

Organizations considering self-service visual analytics software should put Qlik on their shortlist. For companies that already use QlikView, recently released version 12.0 is a logical path especially if they are exploring accompanying deployment of Qlik Sense. With the release of QlikView 12.0, both Qlik Sense and QlikView will utilize a common QIX engine to provide the associative experience. For first-time implementations of Qlik, Qlik Sense will likely be the best option except in some industry-specific cases in which QlikView offers sophisticated tailored solutions. Qlik Sense Cloud provides sharing of Qlik applications in a hosted and managed environment. While the company has made improvements in developing its capabilities and partner ecosystem for Qlik Sense, these should be closely examined in conjunction with the specific business objectives in mind. For developers, Qlik Sense provides a fully featured cloud platform on which to build and well-documented APIs to create extensions and customize the product. Partners, content providers and ISVs should consider the Qlik platform and Qlik Branch for embedding resources directly into applications. Every class of user can download Qlik Sense for free and test it directly on the desktop.

Overall, we find that Qlik Sense’s flexible approach can support various technology directions for analytics and is a strong choice especially for analysts and also application-oriented approaches that are needed.  Qlik has focused on the broader analytic experience and what is required to streamline analysis but also to ensure that it is comprehensive and easily shared with others in the enterprise. If you have not looked at Qlik lately, now is the time to try it out.


Mark Smith

CEO and chief research officer

Zuora Enables Subscriptions to Engage Customers for Revenue Results

As the global economy transforms into a world of digital services that cross industries, including those that provide value-added services for physical products, managing the complications that arise from digital browsing, selection and purchasing of goods, as well as activation, billing and servicing of accounts, becomes a challenge. Organizations have to not just engage customers but provide satisfying vr_NGCE_Research_01_impetus_for_improving_engagementexperiences that keep them coming back. Our benchmark research on next-generation customer engagement shows that improving the customer experience is the most widespread impetus to improve engagement, for almost three-quarters (74%) of organizations. Few however have established business processes and applications that support these efforts, which today involve marketing, sales, customer service, operations and accounting departments. We also find that some of the largest suppliers of cloud computing software provide the worst experiences when it comes to billing for and changing existing subscriptions.

Ventana Research tracks these dramatic changes in how business is conducted. I have written analyst perspectives on digital transformation in business overall and specifically in sales and commerce and marketing. My colleague Richard Snow has commented on customer engagement, and Robert Kugel has discussed finance. Organizations that do not take these challenges seriously will find their customers expressing their dissatisfaction directly or through social media. Yet this does not have to happen. A range of vendors now offer products that can ease the difficulties of navigating the digital business environment.

One of them is Zuora, which has been growing rapidly in providing what it calls relationship business management applications to address needs in subscriber management and recurring revenue. Zuora provides subscriber management, pricing and packaging, billing, payment, quoting, revenue management and analytics on its cloud-based platform. A key distinction of Zuora’s approach is a common foundation for all data related to the demographics, behavior and financial aspects of subscribers’ identity to provide insights about customers and enable interactions across the lines of business.

Zuora’s platform and applications can help organizations adapt their business functions, including marketing, sales, customer engagement, operations, finance and even IT, to subscription-based processes. Unlike ERP approaches that are designed around products and invoicing, Zuora’s focuses on the subscriber from engagement to fulfilling services and supports the full range of recurring revenue processes.

At Subscribed, its annual customer and industry event, the company introduced Zuora ’17, the latest release of its platform. Its primary aim is to help sales and marketing, product management, finance, IT and business leaders work in a synchronous manner to maximize the potential of subscription-related services. CEO Tien Tzuo addressed the need for a unified approach that is efficient and can drive better results. It provides an alternative to “stove pipe” approaches that isolate front-office functions and finance and accounting processes.

Zuora’s latest product roadmap, articulated at Subscribed, describes a series of new products coming to market over the next year. The company plans to come out with incremental improvements on a monthly basis that its customers can take advantage of as part of continuous optimization efforts. In its Zuora community it releases details and collaboration between company and customers occurs. For example, in the April 2016 release, the product is localized for more languages around the world. It supports invoice creation through a template and assists financeVR2015_InnovationAwardWinner groups in foreign currency conversion and processing of exchange rates, as well as tracking and reconciling currency gains and losses. The platform is designed to be integrated with using SOAP API and interface using WSDL. The previous March 2016 enhanced product pricing and bundling through business rules. It also expanded reporting through a drag-and-drop report builder that includes scheduling and interactive slicing of data. The goal is to enable incremental improvements that organizations can take advantage of easily.

Last year Zuora identified a need to use analytics to advance the subscriber experience. Its first step was the acquisition of Frontleaf in 2015. Combining their products it created Z-Insights and a collection of modules that use analytics to gain insights on the life cycle of subscribers. Now that has evolved into a metrics-driven approach that aims not just to understand subscribers but to segment subscribers and interact with them in a personalized manner. Z-Insights enables users to see the lifetime value of customers, their level of engagement and the health of the relationship – a unique approach to what we call continuous optimization. This advancement led us to award Zuora our 2015 Technology Innovation Award in Customer Excellence. Our research on recurring revenue finds that analytics is the top priority for new technology in 82 percent of organizations. Zuora’s focus on analytics-driven subscription processes can facilitate continuous optimization in recurring revenue.

For sales, Zuora can help through its Quotes module and its interface with’s sales force automation (SFA) to manage needs for more configurable products, and its fulfills what many organizations are looking for in configure price quote (CPQ) software. Organizations do not need to use a separate product that has not been well integrated with its SFA or subscription processes. This shift to embed capabilities is evident elsewhere, as Oracle bought and integrated Big Machines and more recently acquired Steelbrick; that can already be done within Zuora for subscription processes. For flexibility in packaging and pricing it can handle a catalog of pricing models, even those that require prepaid addressing, draw-down methods and real-time updates of billing.

For finance, Zuora has worked on managing invoices and billing through a subledger that can interface with and post to an organization’s accounting and ERP system. This helps Finance manage subscriptions and general ledger postings as they occur if necessary or in batches for routine updates. Zuora interfaces to ERP systems from providers used by small and midsize business such as Intacct and NetSuite and larger, more complicated ones such as SAP. While CFOs may be willing to examine a dedicated approach to recurring revenue, many are still fixated on manual processing through ERP and miss the point that automation in finance is only a small part of the value of new technology. My colleague Robert Kugel pointed out many of these challenges. The larger value for finance that Zuora provides is immediate access to subscription metrics and analytics to understand how existing business will impact future revenue and in having visibility into subscription processes across the organization.

vr_Recurring_Revenue_10_recurring_revenue_technology_limitationsZuora also has advanced what it calls Data Connect, which integrates the applications and data of its platform to key third-party application areas including payment, ERP and accounting GL, CRM, tax and Web systems for commerce. It also provides event-based notifications and interfaces to make it easy to adapt to the platform from other environments. Such integration points are essential for subscription processes across business, and Zuora will have to continue to invest in connecting to a growing number of critical systems, at some point also supporting third-party integration systems. Zuora is addressing a key limitation often found in recurring revenue: lack of integration, which our research finds is an issue for almost two-thirds (62%) of organizations.

Last year Zuora launched RBM Connect Marketplace where extensions are provided as applications by Zuora and its customers. These partner applications include capabilities to process sales taxes and provide invoice notifications. Partners including Xactly can help organizations pay incentives on subscription-based revenue. Zuora also has been expanding its Zuora University to expeditiously train customers and partners on its platform and products. This sort of facility is becoming increasingly important, as is certification to ensure quality of deployment and use of its applications.

Zuora has three key editions of its software, called Growth, Enterprise and Nine, to meet the diverse needs of companies by industry and size. Zuora has scaled its platform to ensure it can meet the largest deployments and has been validated by major companies using it, including Ford, IBM, Schneider Electric and Symantec. At the conference it presented what it calls BRISM (build run insane mode), which can handle any burst requirements for billing that happen to customers on its platform. It also supports the range of security for customer and financial information and complies with PCI, SOC, ISO, HIPAA, FIPS and other methods. In addition control of the platform is accomplished through roles and permissions, along with audit trails. The newest announcement is support for multiple-entity deployment in its Nine edition, which will help organizations that want a common approach to managing separate divisions of subscriber operations in diverse deployments.

The Subscribed conference presented customer validation on the diversity of what is possible with Zuora. Gerber Technology offers vr_Recurring_Revenue_03_recurring_revenue_challengesproduct life cycle management to large clothing providers including Levi’s, Nike and REI and more than 17,000 customers in 130 countries. The Seattle Times newspaper is transitioning its print and digital services to a fully automated subscription approach using Zuora. Another customer, Surf Air, has introduced on-demand membership to its fleet of airplanes flying in California.

Overall Zuora is blazing new ground to expand the possibilities of subscription processes and recurring revenue applications in cloud computing. In the end organizations need to expand their engagement with new and existing customers and ensure that the experience is seamless. Our research finds that customer engagement throughout the life cycle (55%) and cross-selling and up-selling (46%) are top challenges for organizations using these models. Zuora is focused on helping organizations in any industry succeed with recurring revenue and maximize subscription-focused efforts. Organizations that are interested in the value of using a dedicated approach to managing and optimizing subscriptions to engage customers and optimize financial results should check out Zuora.


Mark Smith

CEO and Chief Research Officer


 Copyright © 2016 Ventana Research All Rights Reserved :: Privacy Statement :: Contact Us ::