article thumbnail

Netflix Cloud Packaging in the Terabyte Era

Netflix Tech

As described by the white paper Apple ProRes ( link ), the target data rate of the Apple ProRes HQ for 1920x1080 at 29.97 The index file keeps track of the physical location (URL) of each chunk and also keeps track of the physical location (URL + byte offset + size) of each video frame to facilitate downstream processing.

Cloud 95
article thumbnail

Rockset: 1 Billion Events in a Day with 1-Second Data Latency

Rockset

Multiple instances of the benchmark connect to the database under test The Evaluating Data Latency for Real-Time Databases white paper provides a detailed description of the benchmark. The size of an event is chosen to be around 1K bytes, which is what we found to be the sweet spot for many real-life systems.

Bytes 40
article thumbnail

How We Use RocksDB at Rockset

Rockset

For more details on leaf nodes, please refer to Aggregator Leaf Tailer blog post or Rockset white paper. We limit the number of bytes that can be written per second to all RocksDB instances assigned to a leaf node. We also limit the number of threads used to apply writes to RocksDB instances.

Bytes 40