Past FIF Latency Discussions - Financial Information Forum

Download Report

Transcript Past FIF Latency Discussions - Financial Information Forum

Past FIF Latency Discussions
Discussion Topics:
Definitions and Dependencies:
 Low latency versus Ultra low latency
 Market data microburst
 Network load, traffic, queuing, processing
 Packet loss
 Measurement interval (week, day, open/close time)
Synchronization:
 How do we achieve consistent time synchronization?
 Synchronization issues when publishing / receiving market data
Measurement:
 Latency measurement as advertised through various venues needs to be well understood:
 Additional topics to keep in mind include whether latency being measured is maximum latency on 99% of the
traffic or on outliers?
 Is it propagation delay through the systems or at the point of the multicast lines?
 Is the Latency being measured for transactional data or market data?
 How do member firms define what is measured in their latency reports?
 How much latency does the maximum (or a particular number) capacity give me? Would getting the biggest pipe have an
impact on latency given the presence of microbursts in traffic?
 Who measures the latency?
Next Steps:
• SIPs to provide average latency statistics to FIF on a monthly basis
• Exchanges to review their internal latency metrics (trade and market data feeds) for inclusion in FIF reports
Financial Information Forum, Distribution limited to FIF Members
1
Past FIF Latency Discussions
Progress to Date: SIPs will provide average latency statistics to FIF on a monthly basis
NYSE provided description of the types of metrics they capture for their matching engine/trading systems:

CCG Latency for NYSE Classic: Calculate round trip latencies using CCG timestamps for the following messages: Order Ack,
Cancel Replace Ack, Cancel Request, NX Fill, Cancel Confirm. Collect mean, std. dev, min, max, average, 90%, 95%, 99%.

Arca Direct Latency Equities & Options: Calculate for each Gateway and Matching Engine, order ack latencies – mean, std. dev,
min, max, average, 90%, 95%, 99%.

Euronext, LIFFE Financials, LIFFE Equities and LIFFE US: Order Ack latencies – mean and std dev
Latency Questions:

Measurement of Latency by message type: Do different trade / market data messages matter? E.g. Order Ack, Cancel/Replace

What is the ideal Unit of Measurement: Mean, Standard Deviation, Min, Max, Average, 90%, 95%, 99%?

What is the impact of Clock Sync and Clock Drift based on timestamps from cross system calculations

Where do you measure latency from - Internal (LAN vs WAN) vs Colo vs External (LAN vs WAN)?
FIF Next Steps

Obtain additional latency statistics:

Additional Market Data Feeds

Trading System / Matching Engine latency

Agree to common latency measurement methodology
Financial Information Forum, Distribution limited to FIF Members
2
Past FIF Latency Discussions
Exchange Input – Latency Definition & Current Measurement Issues



CTA / SIP

Latency is measured from the time a message is received from an exchange to the time it takes to take that
message and put it out to the multicast feed. The measurement is taken at the application level and begins
the moment the message is received at the input server from an exchange to the time it is time stamped and
put out on the multicast feed on the output server.

SIPs measurement defined above is on application level. Also working towards measuring the time when
data arrives from outside the network which is more important. Besides the average, also provide min, max,
90%, 95%, 99% percentile. Striving to get to the correct degree (include networking components, TCP/IP
stack, etc).
NASDAQ

Currently use application based methodology from the time a message is received by the front end server
from a UTP participant until the time it is put out on the multicast line going out. What is not included is
network infrastructure and getting it out of the building and back in. Looking at options to be more
comprehensive for measurements and provide characterization to this which is measuring percentile, mean,
median.

On direct feed: order-ack, cancel-ack and roundtrip latency for ITCH from outside (extranet switches).
Published on NASDAQ at: http://nasdaqtrader.com/trader.aspx?id=inet and updated on a weekly basis.

SIP data is in milliseconds which doesn’t really matter (even once when network components are included)
because microseconds are more important. Other important issues include time synchronization and getting
accuracy down, ideally deploying a tool to compare internal & external latencies

Unable to obtain granularity from application timestamps, ideally utilize an external appliance.
NYSE

Difficult to measure between two systems that have different clocks which is why the appliance tools are a
better idea than application timestamps (which sometimes can provide the required granularity), need taps
on the outside to capture and analyze packets. Also looking at various latency management solutions.
Financial Information Forum, Distribution limited to FIF Members
3
Past FIF Latency Discussions
Exchange Input – Proposed Latency Measurement Methodology

BATS






Consider following points when talking about latency of a given feed:
1. Latency within market center / exchange / member
2. Latency from outside of market center / exchange network to outside of member’s network
3. Establish a consistent time source at each latency point to get accurate measurement of aggregate
latency
Work with all participants to get all three measurements. Put these pieces together and show total latency.
Industry also wants to measure the speed of a matching engine/internal components of the market
compared to FIX gateway? Ultimately interested in how fast it takes for the whole system to process either
market data or trade traffic.
If one is able to provide a consistent metric starting from outside the market’s firewall, that will be most
valuable.
BATS today provides statistics on the public website in real-time for members.
Additional latency thoughts:


Obtain market wide statistics in terms of different types of latencies across exchanges.
Measure individual customer latencies which can be broken down into
 Different gateways
 Couple of paths
Financial Information Forum, Distribution limited to FIF Members
4
Past FIF Latency Discussions
Broker Dealer Input – Establish Framework for Latency Measurement

Define latency vocabulary

Order acknowledgement ,order cancellation, order modification latencies

Matching engine, market data latency

Measure latency during different times in a day (create a distribution curve)


Market open, important economic announcements, market close
Latency metrics of interest: max, min, standard deviation, 90%, 99.9%

Create diagrams to define start and end points of measurement

Latency survey

Questions include:

Which feeds provide source time stamps and where do they originate from?

Identify start and end points of latency measurement

Additional questions?

Compare anonymous broker dealer statistics with exchange provided statistics

FIF 2011 Latency Survey Report Available
Financial Information Forum, Distribution limited to FIF Members
5