Azul Takes Aim at Java Warm-Up Issues with ReadyNow!
The performance issue occurs when JVMs compile Java applications into forms that can be run on servers, in that part-compilation will occur throughout the application's run cycle in order to perform at optimal levels. In financial services, this can become problematic during peak periods, such as unforseen market events, or market opens and closes.
Typically, traders and system operators have overcome this through simulating events ahead of predicted increased loads, or by coaxing the JVM into optimizing the applications early through the use of historical data and test trades. This allows applications to be cycled up in order to perform during high-stress periods, although they may not reach optimal efficiency at key moments, particularly if those are unexpected.
Further complications with de-optimization occur when the systems are shut down at night and then restarted the following morning. This is primarily to deal with "garbage collection" (GC), essentially a process by which unused memory is reclaimed by the system in order to be recycled for use, but one that often introduces pauses or lag into Java-based applications. With low-latency systems such as execution engines, there is a tendency to build in processes to delay GC and the accompanying pauses. This means, however, that nightly system restarts are essential to prevent the build-up of GC reaching critical mass and introducing millisecond-to-second pauses during the trading day, which, in high-speed environments, could prove costly. As a natural consequence of these restarts, however, systems then have to be cycled up again the next day in order to be optimized once more.
Aggressive Initialization
Azul's Zing JVM addresses a number of GC-related challenges already, but with ReadyNow!, the vendor has taken this process a step further by introducing specific behaviors in the compiler as well as more granular levels of control in order to combat de-optimization at crucial periods.
"Over the past year, we've identified multiple real-world causes for actual de-optimizations that occur during phase shifts and market open, or similar execution stages of applications," says Gil Tene, CTO at Azul. "The ReadyNow! feature set encompasses multiple features and capabilities that are all focused on addressing this problem, starting with specific runtime and just-in-time (JIT) compiler behaviors aimed at reducing or eliminating the need to de-optimize. These include aggressive class loading and resolution, and aggressive initialization during warm-up to help prevent late resolution and late initialization from causing an entire series of de-optimizations later on. JIT optimization choices that pre-optimize or generate code, even for rare or never-taken paths, help avoid another class of de-optimization.
Over the past year, we've identified multiple real-world causes for actual de-optimizations that occur during phase shifts and market open, or similar execution stages of application. - Gil Tene, Azul Systems.
"Additional features include compiler application programming interfaces (APIs) that allow developers to explicitly control optimization choice, and to force the pre-compilation of problematic classes, or rare but critical code paths during warm-up, before they are actually encountered during performance-critical execution," he continues.
Separately, Azul also announced that Zing's runtime would be included in technology vendor Cinnober's TRADExpress product.
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@waterstechnology.com or view our subscription options here: http://subscriptions.waterstechnology.com/subscribe
You are currently unable to print this content. Please contact info@waterstechnology.com to find out more.
You are currently unable to copy this content. Please contact info@waterstechnology.com to find out more.
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. Printing this content is for the sole use of the Authorised User (named subscriber), as outlined in our terms and conditions - https://www.infopro-insight.com/terms-conditions/insight-subscriptions/
If you would like to purchase additional rights please email info@waterstechnology.com
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. Copying this content is for the sole use of the Authorised User (named subscriber), as outlined in our terms and conditions - https://www.infopro-insight.com/terms-conditions/insight-subscriptions/
If you would like to purchase additional rights please email info@waterstechnology.com
More on Trading Tech
Getting aggressive: Overbond uses AI to assess dealer axes
The fixed-income analytics specialist has developed a new tool to help buy-side firms decide if they’re getting a good price from their dealers.
TS Imagine integrates LTX’s pre-trade analytics tool
Users of the fixed-income EMS will now have access to LTX’s Liquidity Cloud tool, which provides a pre-trade score for the likelihood of trading success.
European exchanges turn to dark trading in battle for flow
The EU’s two biggest exchanges are launching dark pools this year. The apparent change in their stances on dark trading reflects a profound shift in equities markets.
After contentious Opra upgrades, vendors brace for a faster future
Upgrades to the datafeed widely used to gauge the current market price for options contracts went into effect in February after three separate delays, which market participants say were caused by persistent bandwidth issues at some important recipients.
The IMD Wrap: No more turf wars, or why CDOs should heed the Voice of the CTO
Max reviews how our recent Voice of the CTO series has implications for those beyond a firm’s technology function, and how communication and collaboration between tech, data, and leadership will deliver better results.
Dark horse: Deutsche Börse building dark pool
New functionality allowing exchange members to execute sweep trades comes hot on the heels of European rival Euronext launching its own dark pool.
Waters Wrap: The tough climb for startups
Anthony speaks with two seasoned technologists to better understand why startups have such a tough time getting banks and asset managers to sign on the dotted line.
European firms prime for lopsided settlement in North America and at home
With T+1 imminent in North America and increasingly likely to traverse the Atlantic, operations and trading professionals in Europe are fighting on two fronts.
Most read
- Women in Technology & Data Awards 2024: All the winners and why they won
- Witad Awards 2024: Above and beyond award (vendor)—Susan Bennett, Tradeweb
- Fighting FAIRR: Inside the bill aiming to keep AI and algos honest