Cranking Up To Eleven
![james-rundle james-rundle](/sites/default/files/styles/landscape_750_463/public/import/IMG/765/194765/james-rundle-580x358.jpg.webp?itok=KSqZWuPJ)
Every conference agenda, and nearly every conversation regarding data, now has an element of big data to it. From Doug Laney's original Three Vs definition of velocity, variety and volume through to the more multifaceted understanding now, debate still rages over the key point regarding big data itself ─ is it actually happening?
Yes, is the simple answer. It's impossible to argue against the idea that datasets are getting bigger, that they're coming from many different sources and the time horizons for processing them are shrinking, whether that's due to technology development or function demand. But there's also an argument for no, as well. Big data, by its very definition, has always been there from a pure development perspective, in that it's the upper limit of what we can feasibly process in realistic timeframes, and what's beyond the ken of current computing ability.
Relativism and Realism
Taking that explanation into account, big data itself isn't actually a distinct phenomenon, but an intrinsic part of data usage, structured or otherwise. Labeling it as such, some argue, betrays a lack of understanding about the essence of information usage ─ it will always get bigger, and there will always be a limit. Finite resources and all that.
But neither seems particularly correct, and both have an element of facetiousness to their basic descriptions. Yes, data sets get bigger with the iterative expansion of computer power. Yes, what was considered big data even ten years ago, for instance, the organic database of every position across a large investment firm's enterprise, updated with corporate actions and projection logic, can comfortably fit onto most peoples' iPhones today. But given the level of electronic expansion in the past decade, and the consummate bloating of data generated, what we currently experience in terms of data growth is far beyond the precedent.
It's all relative, of course. The level of data that Google takes in, as an extreme example, is far in excess of what a small brokerage in the south of England may concern itself with. But both experience the same essential requirement ─ even for the small company, the addition of an extra source of market data, and incoming regulations over record keeping present it with a big data issue of processing and storage, even if it's not on a par with the sheer amount of data that Google deals with. Without reconciling two separate industries, as well, a tier-one investment bank with retail operations will generate an enormous level of data that fits what is becoming the traditional big data paradigm, but a small regional bank will also struggle with increased electronification and the information that produces as well.
The level of data that Google takes in, as an extreme example, is far in excess of what a small brokerage in the south of England may concern itself with. But both experience the same essential requirement.
Living, Breathing
But even the issue becomes the process eventually. Take our coverage of big data at Waters, for instance. A while back, I filed a lengthy story on the basics of big data, and we decided that, as a rule going forward, we would capitalize the words in order to differentiate the idea of big data from the fact that there was a large amount of data. Last week, we decided to revert to non-capitalized forms, as the concept is so widespread now that it almost seems ridiculous to refer to it as a proper noun.
In summary, I'm falling somewhere between the lines, as arguably should be the case as a journalist. While I agree that data naturally evolves and expands, I also think that the sharp incline, plotted on the metaphorical graph, can't be ignored. But I'm mainly interested in what you, the end users and the experts, think.
The keen readers among you, finally, may also have noticed a new byline on the staff this past week. Marina Daras, formerly of Private Banker International and Investment Europe, among other titles, joins us in London as our European staff writer. She can be reached at marina.daras@incisivemedia.com.
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@waterstechnology.com or view our subscription options here: http://subscriptions.waterstechnology.com/subscribe
You are currently unable to print this content. Please contact info@waterstechnology.com to find out more.
You are currently unable to copy this content. Please contact info@waterstechnology.com to find out more.
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. Printing this content is for the sole use of the Authorised User (named subscriber), as outlined in our terms and conditions - https://www.infopro-insight.com/terms-conditions/insight-subscriptions/
If you would like to purchase additional rights please email info@waterstechnology.com
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. Copying this content is for the sole use of the Authorised User (named subscriber), as outlined in our terms and conditions - https://www.infopro-insight.com/terms-conditions/insight-subscriptions/
If you would like to purchase additional rights please email info@waterstechnology.com
More on Data Management
$135.6m fines prompt Citi to modernize infrastructure, controls
The bank was hit with a combined $135.6 million fine on Wednesday for failing to resolve “longstanding internal controls and risk issues,” amid continued internal work across the enterprise.
SocGen pushes data, analytics use cases for SG Markets
The bank is letting a handful of clients experiment with its proprietary data and models to inform their research.
Finra clears hurdle with CAT launch, but several others remain
Two major components of the consolidated audit trail are now in place. But wrangling over the CAT’s future continues.
Ace high or busted flush? Digital Asset’s mixed fortunes mirror DLT adversity
The vendor hoped to remodel post-trade using blockchain technology—and it still might—but its bumpy progress raises questions over the future of DLT in finance.
The IMD Wrap: It’s the data, Cupid!
As BlackRock buys Preqin, and LSEG strikes a data deal with Dow Jones, Max notes that in data, strange bedfellows breed valuable offspring.
This Week: BlackRock/Preqin, Trading Technologies, FIA Tech and more
A summary of some of the past week’s financial technology news.
US banks seek to open vendors’ black box on green data
Inaugural Fed climate scenario analysis flags lack of transparency around third-party models.
IEX Cloud closure forces fintech clients to seek data alternatives
IEX says it is ditching its unprofitable data arm to focus on its core exchange business, but other vendors believe they can turn a profit from its former client base of fintechs, retail investors and some institutions.