LOW-LATENCY MESSAGING FRAMEWORK

Chronicle Queue Enterprise

Persisted low-latency messaging framework for high-performance and critical applications that stores a complete history of all your messages to disk. Goes beyond Chronicle Queue Open Source by delivering superior control of outliers with asynchronous writes, and replication across hosts.

"I am an admirer of all things Chronicle, can honestly say, Chronicle Queue changed my entire perspective"

-Nicholas Whitehead, DriveWealth

Records Every Message

performance icon

Designed as a “record everything store” that reads with microsecond real-time latency. By making use of the available disk space, storage is not limited by the main memory.

Lossless with Replication

mapping icon

Messages can be automatically copied to queue replicas on different systems to essentially eliminate data loss. This is achieved with minimal impact on latencies.

Keeps Outliers in Check

tick icon

Chronicle Queue Enterprise can be run asynchronously to hide OS latencies. This dramatically reduces outliers to consistently deliver low latency.

Supported by Our Experts

handshake icon

Get full support from our technical experts, with decades of experience building low-latency software for some of the largest players in the financial sector.

Robust and Resilient

configurable icon

Equipped with full HA/DR capabilities via multi-node replication and hot-hot configurations. This helps achieve uninterrupted communication.

Protects Sensitive Data

padlock secure icon

All stored messages can be encrypted to comply with regulatory requirements such as  GDPR, which may mandate that all data is stored safely.

Records Every Message

performance icon

Designed as a “record everything store” that reads with microsecond real-time latency. By making use of the available disk space, storage is not limited by the main memory.

Lossless with Replication

mapping icon

Messages can be automatically copied to queue replicas on different systems to essentially eliminate data loss. This is achieved with minimal impact on latencies.

Supported by Our Experts

handshake icon

Get full support from our technical experts, with decades of experience building low-latency software for some of the largest players in the financial sector.

Keeps Outliers in Check

tick icon

Chronicle Queue Enterprise can be run asynchronously to hide OS latencies. This dramatically reduces outliers to consistently deliver low latency.

Robust and Resilient

configurable icon

Equipped with full HA/DR capabilities via multi-node replication and hot-hot configurations. This helps achieve uninterrupted communication.

Protects Sensitive Data

padlock secure icon

All stored messages can be encrypted to comply with regulatory requirements such as  GDPR, which may mandate that all data is stored safely.

mapping icon

Lossless with Replication

Messages can be automatically copied to queue replicas on different systems to essentially eliminate data loss. This is achieved with minimal impact on latencies.

performance icon

Records Every Message

Designed as a “record everything store” that reads with microsecond real-time latency. By making use of the available disk space, storage is not limited by the main memory.

handshake icon

Supported by Our Experts

Get full support from our technical experts, with decades of experience building low-latency software for some of the largest players in the financial sector.

tick icon

Keeps Outliers in Check

Chronicle Queue Enterprise can be run asynchronously to hide OS latencies. This dramatically reduces outliers to consistently deliver low latency.

padlock secure icon

Protects Sensitive Data

All stored messages can be encrypted to comply with regulatory requirements such as  GDPR, which may mandate that all data is stored safely.

configurable icon

Robust and Resilient

Equipped with full HA/DR capabilities via multi-node replication and hot-hot configurations. This helps achieve uninterrupted communication.

Multilanguage Support

Chronicle Queue is available as a fully native Java, Rust or C++ library, and also supports a Python API. All versions are fully binary compatible.

Java logo
C++ logo
Python logo
Rust logo

Chronicle Queue Enterprise in Action

Chronicle Queue Enterprise is most often used for producer-centric systems where data needs to be retained for days or years.

A producer-centric system does everything possible to never push back on the producer, or tell it to slow down.

Market Data

Market data publishers do not allow pushing back on the producer for long; if at all. Chronicle Queue can e.g. consume data from CME OPRA, that produces peaks of 10 million events per minute, sent as UDP packets without any retry. A missed or dropped packet is lost. Hence, packets must be consumed and recorded as fast as they arrive, with very little buffering in the network adapter.

For market data, real-time means microseconds.

Compliance Systems
Compliance is non-negotiable; everyone has to have compliance systems, but no one wants to be slowed down by them. By using Chronicle Queue to buffer data between monitored systems and the compliance solution, there is no reason to worry about the impact of compliance recording for your monitored systems.
 

Chronicle Queue can support millions of events per second, per server, and access data that has been retained for years.

Latency Sensitive Micro-services

Chronicle Queue supports low-latency IPC (Inter Process Communication) between JVMs on the same machine in the order of magnitude of 1 microsecond; as well as between machines with a typical latency of 10 microseconds for modest throughputs of a few hundred thousands. Chronicle Queue supports throughputs of millions of events per second, with stable microsecond latencies.

Log Replacement

A Chronicle Queue can be used to build state machines. All the information about the state of those components can be reproduced externally, without direct access to the components, or to their state. This significantly reduces the need for additional logging. However, any logging you do need can be recorded in great detail. This makes enabling debug logging in production practical as the cost of logging is very low; less than 10 microseconds. Logs can also be replicated centrally for log consolidation.

Lamda Stream Processing

Non-batching streaming components built with this technology are highly performant, deterministic, and reproducible. You can reproduce bugs that only show up after a million events played in a particular order, with accelerated realistic timings.

Experience the Speed

Chronicle Queue Enterprise can consistently deliver low latencies across all percentiles by allowing asynchronous reads and writes. 

This is verified with thorough benchmarks, described in a number of articles that invite anyone to delve into the details of the performance and latency advantages of Chronicle Queue Enterprise. Or even better, experience the speed first hand by running our performance demos.

<4 micro seconds

Read-to-write latency in async mode

100 million

Comfortably handles 100M events per minute

~1 µs

Read/write latency at 99.9% percentile

Trusted by Top-Tier Financial Institutions

UOB logo
RBC Royal Bank logo
MUFG Logo

LIGHTWEIGHT PROXY

Securing Your Chronicle Queue Replication

As an optional feature of Chronicle Queue, we provide a lightweight TCP and TLS Proxy. Key features are:

  • Configurable Routing Policies - multiple policies supported, including Round Robin, Sticky Round Robin and “Blue-Green” partitioning
  • Transparent Failover - to enable High Availability and Disaster Recovery
  • TLS Support - initiation and termination of TLS for encryption and authentication
  • Network Segmentation - can be installed in DMZ to satisfy network security requirements
  • Low Overhead - less than 100ns plus additional TCP hop
Screenshot 2022-08-18 at 12.10.26

Licensing and support

At Chronicle we pride ourselves on the stability and knowledge of our development and support team. With decades of experience from the financial industry, you can trust us with your toughest challenges.

Get expert help

Our expert consultants are ready to support you with any issues that may arise. We understand that the Chronicle Queue is usually only a small part of a system, and our experienced developers can help with architecture and latency issues in other areas if needed.

 

Simple licensing model

Our simple and transparent licensing model provides certainty and ensures that Chronicle Queue Enterprise is available to businesses of all sizes, from the largest bank to the smallest hedge fund.

Articles about Chronicle Queue

Big Data and Chronicle Queue

The Big Question How is Chronicle Queue being used for Big Data solutions in Java, and how does it work under the covers? What is Chronicle Queue? Chronicle Queue is a persisted journal of messages which supports concurrent writers and readers even across multiple JVMs on the same machine. Every reader sees every message, and…

Continue Reading >>

Improving Percentile Latencies in Chronicle Queue

Compared to a year ago, we have significantly improved the throughput at which we can achieve the 99%ile (worst one in 100). What tools and tricks did we use to achieve that? What are we testing? Chronicle Queue appends messages to a file while another thread or process can be reading it. This gives you…

Continue Reading >>

Chronicle Queue storing 1TB in virtual memory on a 128GB machine

If you use a standard JVM like the Oracle JVM or the OpenJDK, you might find that as the heap size grows the performance of your JVM can drop as GC pause time escalates. This tends to be a problem around 32 GB of heap, but it often depends on the application at which point…

Continue Reading >>
What's Next?

Get Started Today

If you want to learn more about how Chronicle Queue Enterprise works, why not start experimenting with our demos or read the documentation? For example, you can learn how to get up and running quickly and how Chronicle Queue Enterprise can be optimised for your environment.