Don't Go Small on Big Data

This week the Waters team put together a special report on Big Data. In his opening letter, Waters editor-in-chief Victor Anderson points to the monetary value for those who are on the cutting edge of this large-scale frontier.
I completely agree. Those firms that are at the forefront of mining this data, and those that are innovative in the ways they use the information gained, will have an enormous competitive advantage over the laggards that are in a reactionary position.
Unfortunately, though, the financial services industry has chosen to sit on the sidelines rather than innovate when it has come to things like cloud technology, mobile technology, social media and field-programmable gate arrays (FPGA).
My colleague Tim Murray covered a panel discussion this week that addressed Big Data. Knight Capital's Steven Sadoff told the audience that the market rarely delves into the cutting edge of new technology.
"Advances in technology simply haven't kept up," he said. "Whatever you want to throw at a particular tech problem, we've only seen evolutionary improvements."
There is hope, though, that buy-side firms will look to address the challenge of Big Data internally, rather than outsource it. At that same event, Tudor Investments’ CTO Oleg Olovyannikov said that Big Data storage is something the firm is looking at and that it has tended to build its solutions in-house.
"We have always had a very proprietary mindset—and therefore tend to build everything ourselves," he said. "We manage hundreds of data feeds—real-time as well as research feeds, and track them all in-house. We looked, and simply don't find a lot of savings in outsourcing, when our junior personnel can handle those tasks at lower cost. As a smaller, agile buy-side firm, our challenge is personnel, and keeping the high-value ‘boutique' knowledge in-house."
I would hope that more people in the industry choose to take this approach. For non-proprietary things like market data, the vendors should be leading the charge and rolling out solutions. But when it comes to monetizing Big Data, there's much to be gained by being at the head of the class.
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@waterstechnology.com or view our subscription options here: http://subscriptions.waterstechnology.com/subscribe
You are currently unable to print this content. Please contact info@waterstechnology.com to find out more.
You are currently unable to copy this content. Please contact info@waterstechnology.com to find out more.
Copyright Infopro Digital Limited. All rights reserved.
As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (point 2.4), printing is limited to a single copy.
If you would like to purchase additional rights please email info@waterstechnology.com
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (clause 2.4), an Authorised User may only make one copy of the materials for their own personal use. You must also comply with the restrictions in clause 2.5.
If you would like to purchase additional rights please email info@waterstechnology.com
More on Data Management
In data expansion plans, TMX Datalinx eyes AI for private data
After buying Wall Street Horizon in 2022, the Canadian exchange group’s data arm is looking to apply a similar playbook to other niche data areas, starting with private assets data.
Saugata Saha pilots S&P’s way through data interoperability, AI
Saha, who was named president of S&P Global Market Intelligence last year, details how the company is looking at enterprise data and the success of its early investments in AI.
Data partnerships, outsourced trading, developer wins, Studio Ghibli, and more
The Waters Cooler: CME and Google Cloud reach second base, Visible Alpha settles in at S&P, and another overnight trading venue is approved in this week’s news round-up.
A new data analytics studio born from a large asset manager hits the market
Amundi Asset Management’s tech arm is commercializing a tool that has 500 users at the buy-side firm.
One year on, S&P makes Visible Alpha more visible
The data giant says its acquisition of Visible Alpha last May is enabling it to bring the smaller vendor’s data to a range of new audiences.
Accelerated clearing and settlement, private markets, the future of LSEG’s AIM market, and more
The Waters Cooler: Fitch touts AWS AI for developer productivity, Nasdaq expands tech deal with South American exchanges, National Australia Bank enlists TransFicc, and more in this week’s news roundup.
‘Barcodes’ for market data and how they’ll revolutionize contract compliance
The IMD Wrap: Several recent initiatives could ease arduous data audit and reporting processes. But they need buy-in from all parties if all parties are to benefit.
‘The opaque juggernaut’: Private credit’s data deficiencies become clear
Investor demand to take advantage of the growing private credit markets is rising, despite limited data, trading mechanisms, and a lack of liquidity.