Big-Time Data Terminology
The term "big data" is so broad that when commenting about data management and the industry, it's better to consider topics such as data quality, data consistency or deriving value from data – or at least discuss matters in those terms.
A presentation given this past week by Pierre Feligioni, head of real-time data strategy at S&P Capital IQ, defined "big data" as "actionable data," and sought to portray big data concerns as really being about four issues: integration, technology, content and scalability.
Integration, particularly the centralization of reference data, is the biggest challenge for managing big data, as Feligioni sees it. While structured data is already quite "normalized," unstructured data, which can include messaging, emails, blogs and Twitter feeds, needs to be normalized.
Unstructured data is fueling rapid exponential growth in data volumes, justifying the name "big data." Data volumes are counted in terabytes (1,000 gigabytes), or even petabytes (1,000 terabytes). When it comes to unstructured data at those levels, central repositories that can collect and normalize data – and coordinate it with structured data – are a must, Feligioni contends.
Technology and scalability the building blocks necessary to make such central repositories functional, as he describes it. Natural language processing and semantic data approaches are also being applied. "The biggest challenge is understanding documents and creating analytics on top of this content, for the capability to make a decision to buy or sell," says Feligioni.
Scalability makes it possible to process more and more information, and is achieved through new resources, such as cloud computing, which carry their own issues and require additional decisions [as described in my column two weeks ago, "Cloud Choices"].
Everything that Feligioni calls part of "big data" actually revolves around getting higher quality data by incorporating more sources and checking them against each other to keep that data consistent. It's also about creating new value from data that can be acted upon by trading and investment operations professionals.
So, whatever buzzwords one uses, whether "big data" or sub-categories under that umbrella, what they are really talking about is quality, consistency and value. Other terms just describe the means.
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@waterstechnology.com or view our subscription options here: http://subscriptions.waterstechnology.com/subscribe
You are currently unable to print this content. Please contact info@waterstechnology.com to find out more.
You are currently unable to copy this content. Please contact info@waterstechnology.com to find out more.
Copyright Infopro Digital Limited. All rights reserved.
As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (point 2.4), printing is limited to a single copy.
If you would like to purchase additional rights please email info@waterstechnology.com
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (clause 2.4), an Authorised User may only make one copy of the materials for their own personal use. You must also comply with the restrictions in clause 2.5.
If you would like to purchase additional rights please email info@waterstechnology.com
More on Data Management
FactSet unveils Data-as-a-Service offering
The vendor is introducing the suite of managed services for more efficient data management as emerging technologies, like GenAI, require more from datasets.
Moral models: The ethics of data management
The IMD Wrap: You may be managing data efficiently, but are you managing it ethically? And is that something you should be concerned about? Yes, says Max, you should.
Footsteps in the dark: Private markets’ data quality “problem”
Data quality in the private markets is poor. But is this a quirk of the market or a problem that needs fixing?
Deep in the heart of Texas, market data vets sweat the talent gap
The secrets to unlocking all of market data’s questions and the antidote for all its ills were discussed in Texas last week. Unfortunately, we promised not to tell—not all of them, anyway.
Fidelity’s quantum exploration unites theory and proof
The asset manager and Amazon have teamed to put a quantum twist on machine learning.
Interop after acquisitions remains daunting for buyers
Executives from a variety of vendors speaking at WFIC explained why desktop interoperability is important and why progress has been slow.
GenAI could connect ‘constellation’ of vital information technologies
At WFIC, Six Group’s Marion Leslie highlighted the opportunities and risks that the technology holds.
TRG Screen cuts 20 jobs following review and restructure
The review follows an eight-year period of acquisitions and buy-in from a new private equity owner last year.