Data, Information, and Knowledge – The Trinity of Enterprise Value
Based on the fundamental premise that data, information, and knowledge, are three intricate, indispensable, and interdependent elements, hyperscale systems – distributed computing environments that efficiently scale from a few servers to thousands of servers – are being built to unearth its untapped business values with unprecedented processing power, speed, and accuracy. CCC is at the center of this innovation within the insurance industry, working to help customers convert data from discrete facts into meaningful structures, and ultimately, into domain knowledge. Enterprises seeking to capture a strategic advantage and growth will need to harness the value buried deep inside this domain knowledge, which includes generating metrics, categorizing results, assessing values, making forecasting and predictions and finally enabling informed decisions.
The first thing to understand is that today’s data is different. We think about it in the context of “3 V’s”: Volume, Variety, and Velocity.
The vast amount of dataset (Volume) that are generated now are distributed, diverse, disparate, and heterogeneous in nature. They are structured,
unstructured, and semi- structured (Variety). And, these data set are growing at exponential pace (Velocity). For example, a single blade in a GE gas or wind turbine, generates 500 gigabytes of data each day. That means in 30 days a single blade would generate as much content as the print collection of the Library of Congress. For the record, there are about 4,500 GE gas turbines around the world, each with dozens of blades. There are examples like this everywhere, including within the P&C insurance industry.
The 3Vs of the modern data characteristics generate enormous challenges in the areas of storage, retrieval, security, sharing, analysis and reporting. On the flip side, they also open massive business opportunities throughout different phases of data lifecycle. Besides the 3Vs nature of the data we also recognize the density of information embedded in them. That is where true enterprise value lies. Without it any enterprise will be flying blind.
Data is Liquid and it is Everywhere
The nature of today’s hyperscale data has striking similarities with water – precious, abundant resources that are essential to survival. Hyperscale
data, like water, is also storable, transportable, transformable, vulnerable, and susceptible to contamination when being processed for consumption. And, much like the way massive resources and infrastructures – dams/reservoirs, electric power stations, security and backup systems, purification and filtration systems, distribution channels, maintenance, monitoring systems, billing/accounting/monetization systems – are built to harness the power of water, we believe that hyperscale data needs massive storage structures, security systems, high speed networks, processing machines, monitoring, and regulatory structure to extract and harness the vast power embedded in them.
The CCC Hyperscale Platform
With so much excitement about the potential in the area of hyperscale data, predictive analytics, and deep learning and multilayer neural networks, the insurance industry in many ways is taking the lead in getting real business value from the technology buzz. We are immensely proud to be part of this new technology wave with our partners. We understand that as the hyperscale data business evolves, so does the technology stack, and enterprise application architectures are evolving from integration-centric enterprise service bus (ESB) architectures to application-centric, micro-services, platform-as-a-service (PaaS), multi-cloud, and API-driven architectures.
We understand APIs are the lynchpin to the success for many of our business and technology partners: these APIs are used by applications to access key services and data. These services can be microservices, cloud workloads, legacy SOAP services, or the Internet of Things (IoT).
Using the CCC API foundation layer, we reinforce our technology partnership to create rich insights into how safe drivers are using auto physical damage and injury data, telematics, big data, and analytics. We recognize APIs and API management are essential to scale quickly and can support integration with partner companies’ complex infrastructure. In order to process the hyper density data we are building a hyperscale processing platform.
CCC Next Gen Hyperscale Platform
CCC’s hyperscale platform has several important foundational components.
Data Ingress/Egress Layer
Our Ingress/Egress layer has two separate yet equally important goals: Interactivity (real-time queries) and data freshness (real-time ingestion).
This layer has been built to help our clients make sense of large amounts of data in real-time. Every day the platform ingests tens of millions of new
events, and currently handles several hundred million aggregated events. The platform has been designed to also support the ability to automatically and efficiently move large amounts of data in and out of platform; and to parallelize the execution, across multiple execution nodes in the application
framework layer.
Data As a Service (DAAS) Layer
Our DAAS layer is built on the fundamental guiding principle that underlying raw business data will be very fluid – structured, unstructured, and semistructured – and stored in diverse data storage types at a it’s a volume with an exponential pace. Treating DAAS and not a dependency layer, large scale applications can be built to be data storage, structure and location agnostic. By insulating the applications from the above three concerns that hamstrung application portability and scaling for several decades, DAAS enables the business logic to become highly portable across diverse applications platforms. Being location-agnostic enables applications to be highly available across different geographic regions as DAAS can be made available 24×7. Our DAAS layer has been built to address concerns on the both application level features and operational area, including application latency; linear scalability; high availability; and operational economics.
Application Framework Layer
The hyperscale application layer has been designed to support an array of diverse applications that can access data stored in the DAAS layer in a storage-, structure-, and location-agnostic way. It supports high velocity data streaming apps, high volume transactional and batch type apps, Petabytes scale business intelligence and predictive analytical apps, and multilayer neural network – (deep learning apps).
Hyperscale Data Security
Lastly, with big data comes big responsibility; its security. A multilayered data security strategy – prevention, detection, and policy/administration –
can be both efficient and effective at maximizing security controls.
Preventive controls stop intruders from gaining unauthorized access to data. Detective controls centralize auditing and reporting across the organization so that either security breach or compromised system can be swiftly detected and necessary actions be taken. And finally, policies / administrative controls can prevent unlimited and ad-hoc access to application data while still allowing legitimate administrative activity.
CCC’s hyperscale data security layer has been implemented as a three-pronged approach: two level identification ata encryption, and data de-identification.
The Road Ahead
Hyperscale data is still in its infancy and evolving, but its potential is immense. Equally are its challenges. We at CCC are working on next generation initiatives to address the huge challenges our partners face and deliver solutions that are unique to their business.