Free lesson · HFT & microstructure
HFT research promotion, drift and operating limits
Open interactive lessonPractice calculationsExplore labs
Start with the idea
A trading policy is only one part of the system. Promotion requires evidence that the signal, fill model and operating process remain consistent when observed outside the development environment.
Symbols, units & horizon
- f: filled attempts
- n: comparable order attempts
- p̂: observed fill fraction
- p₀: reference fill probability
- SE_iid: approximate standard error assuming independent Bernoulli attempts
- z: descriptive standardised deviation
- Dependence: requires session/block-based uncertainty instead of the iid approximation
When and why to use this
Use monitoring to detect where the research-to-execution assumptions have changed and trigger investigation before automatically retraining.
Split by sessions or longer contiguous periods, preserving distinct volatility and liquidity conditions. Hold out days for final evaluation; do not mix event-level samples from the same session across training and test. Many closely spaced events share the same latent market state.
Monitor latency quantiles, reject rates, fill ratios, signed markouts, realised versus forecast volatility and inventory concentration. Distinguish data drift from concept drift: a feature distribution may change without losing predictive value, while the same feature values may acquire a different outcome relationship.
Use shadow decisions and constrained paper operation to compare intended orders with plausible fills. Keep independent stale-feed, position, loss and order-rate limits outside the learned policy. A malfunctioning learner should not decide whether its own risk controls apply.
HFT research promotion, drift and operating limits
- Represent a fill as 1 and no fill as 0. The sample mean of these indicators is f/n.
- A Bernoulli variable has variance p(1−p). For n independent attempts, the variance of the mean is p(1−p)/n; plug in p̂ and take the square root.
- Subtract the reference fill rate and divide by the estimated scale. This is a diagnostic, not a production alert rule when events are dependent.
400 fills in 1000 attempts give p̂=.4 and iid SE≈.01549. Against p₀=.45, z≈−3.23. Clustered fills can make this iid scale too small.
Apply it in a strategy
- Freeze a promotion dossier with candidate policy, costs, queue assumptions, training data and final holdout.
- Monitor per-session diagnostics against uncertainty bands estimated from comparable historical blocks.
- Use predetermined rollback and retraining criteria; any new parameter choice starts a new documented research cycle.
Research deliverable
Prepare a shadow-trading report that reconciles forecasts, desired orders, plausible fills, costs and operating failures by session.
Research checkpoint · reviewed 11 September 2026
These sources inform the questions to test. A result is conditional on its data, simulator and evaluation design. The examples in this module are teaching calculations, not reproductions of the reported experiments.
Regime and inventory failure modes. This newly submitted preprint studies a distributional-DQN market maker. The setup, stress discussion and limitations were reviewed in full text. Evaluation uses a zero-intelligence simulated order book, unit lots and at most one order per side; there is no historical trading sample. Persistent directional flow can saturate inventory, and the authors study regime-aware fine-tuning. Our implementation lesson is to test inventory saturation and simulator assumptions, rather than treat simulated improvement as an executable market edge.
Further reading: Moret & Lillo · Deep Learning of Robust Market Making under Regime-Switching Order Flow · 10 September 2026 ↗
Review a causal volume-clock feature and its measurement limits →
Research sources, review dates and limitations
Extend the research question
Compare inventory management in a continuous-price instrument with binary terminal settlement. Test a quote policy under both adverse order flow and resolution risk.
Continue with the connected research module →
Python implementation
Self-contained teaching example. Python 3.10+; dependencies and input conventions are shown in the code and notation. Run in your own Python environment.
from math import sqrt
def fill_diagnostic(fills,attempts,reference):
if attempts<=0 or not 0<=fills<=attempts or not 0<=reference<=1: raise ValueError("Invalid counts")
p=fills/attempts
se=sqrt(p*(1-p)/attempts)
return p,se,(p-reference)/se if se>0 else None
print(fill_diagnostic(400,1000,.45))Continue learning
High-Frequency Trading: Signals, Queues & Execution — all lessons- HFT economics and the information-to-fill timeline
- Order-book features: imbalance, microprice and event flow
- Volume clocks, trade imbalance and VPIN
- Queue position, fill probabilities and adverse selection
- Inventory-aware quoting and economic edge development
- Event-driven backtesting and order lifecycle correctness
- HFT research promotion, drift and operating limits
Quantitative finance and development glossary · Python resources and libraries · Research sources and limitations