Opening Cross: Nightmares and Data Dreamscapes
Market data is scarier than any trick or treat. So either learn to laugh at the frights, or be ready for things to go bump in the night.

For example, imagine you’re a company like Estimize, which has just invested a not insignificant amount of money in joining the gameification trend by creating an app that crowd-sources investor opinions on where a stock will rank compared to others, only to find that by charging users to participate and awarding cash prizes to the winners, the contests constitute securities-based swaps, according to US regulator the Securities and Exchange Commission. As a result, despite taking steps to avoid falling under that designation, Estimize was forced to pay a $50,000 fine and remove the payments and incentives from its Forcerank app. Fortunately, officials say, participants continue to rank stocks in the app, and the predictive dataset being created from their recommendations continues to deliver alpha. Certainly, that’s the silver lining in this situation that may yet yield more results over the long term.
And while most of you aren’t Estimize, many readers will know the agony and frustration of sinking investment into a project, only to have it scaled back or even scuppered at the last minute.
In recent years, some of these projects have related to low-latency connectivity, where a firm initially believes it can gain a trading advantage only to realize that the cost of building and maintaining such an infrastructure is greater than the advantage gained, while the firm seeks to balance “good-enough” latency an different itself with smart strategies instead.
In this low-latency world, datacenters became the new central marketplaces, with trading venues and trading firms co-locating side by side. These setups became critical because even if your strategy doesn’t depend on the fastest inbound data, you still need to ensure the ability to execute as fast as possible so the market doesn’t move before you can respond. So whether you consider your business strictly low latency you still need to be in the same place as others who do.
Now consider the nightmare scenario—not necessarily one of those sudden waking episodes, but rather a long, drawn-out cold sweat—of moving your infrastructure between datacenters without impacting your business, such as the London Metal Exchange’s decision to switch its primary datacenter from a CenturyLink facility in Slough, outside London, to Interxion’s datacenter in the heart of the city. Coordinating a move and seamless switchover is no small task, but in this case the burden is offset by latency gains resulting from the move. And while you may question the importance of latency to a commodity futures exchange, consider the stories we’ve written in recent weeks about software vendors releasing high-performance feed handlers for foreign exchange and fixed income markets. Latency is becoming important across all asset classes. And if you thought handling high volumes of low-latency equities and options data was hard, wait until other asset classes get in on the act.
And even buy-side firms seeking to offload most of the burden of handling data can’t escape its clutches, since—according to a panel at last week’s Buy-Side Technology North American Summit—they remain ultimately responsible for data quality and all the business impacts associated with it.
So the moral of the story is, when dealing with data, be prepared to encounter something terrifying at every turn. Steel yourself against it, if you choose. Or even better, welcome the fright like a horror movie fan, and consider each one a challenge to be faced and dispatched with a silver bullet and a sly wisecrack.
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@waterstechnology.com or view our subscription options here: http://subscriptions.waterstechnology.com/subscribe
You are currently unable to print this content. Please contact info@waterstechnology.com to find out more.
You are currently unable to copy this content. Please contact info@waterstechnology.com to find out more.
Copyright Infopro Digital Limited. All rights reserved.
As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (point 2.4), printing is limited to a single copy.
If you would like to purchase additional rights please email info@waterstechnology.com
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (clause 2.4), an Authorised User may only make one copy of the materials for their own personal use. You must also comply with the restrictions in clause 2.5.
If you would like to purchase additional rights please email info@waterstechnology.com
More on Emerging Technologies
DeepSeek success spurs banks to consider do-it-yourself AI
Chinese LLM resets price tag for in-house systems—and could also nudge banks towards open-source models.
Standard Chartered goes from spectator to player in digital asset game
The bank’s digital assets custody offering is underpinned by an open API and modular infrastructure, allowing it to potentially add a secondary back-end system provider.
Saugata Saha pilots S&P’s way through data interoperability, AI
Saha, who was named president of S&P Global Market Intelligence last year, details how the company is looking at enterprise data and the success of its early investments in AI.
Data partnerships, outsourced trading, developer wins, Studio Ghibli, and more
The Waters Cooler: CME and Google Cloud reach second base, Visible Alpha settles in at S&P, and another overnight trading venue is approved in this week’s news round-up.
Are we really moving on from GenAI already?
Waters Wrap: Agentic AI is becoming an increasingly hot topic, but Anthony says that shouldn’t come at the expense of generative AI.
Cloud infrastructure’s role in agentic AI
The financial services industry’s AI-driven future will require even greater reliance on cloud. A well-architected framework is key, write IBM’s Gautam Kumar and Raja Basu.
Waters Wavelength Ep. 310: SigTech’s Bin Ren
This week, SigTech’s CEO Bin Ren joins Eliot to discuss GenAI’s progress since ChatGPT’s emergence in 2022, agentic AI, and challenges with regulating AI.
Microsoft exec: ‘Generative AI is completely passé. This is the year of agentic AI’
Microsoft’s Symon Garfield said that AI advancements are prompting financial services firms to change their approach to integrating AI-powered solutions.