Read now
Introducing Quill: the live context layer for AI →
QuillNEW
Get Started
QuillNEW
Decoration background
Posts
Articles
Working With Market Data Using Time Series in RavenDB

Working With Market Data Using Time Series in RavenDB

December 29, 2021

In this article, I’ll walk through how the Time Series document extension in RavenDB can be used to build a chart visualization for crypto prices using basic APIs. The video above demonstrates a sample crypto price demo modeled after the popular Robinhood trading app. The histogram is powered by RavenDB, a NoSQL document database that…

nosql-database
Blog
A year or monitoring production

A year or monitoring production

December 29, 2021

The end of the year is closing fast, and I run into the following metric (below). What you can see here is one of our RavenDB production instances over the past year. We are continuously dogfooding our own software, and there is a clear indication of the results. What you can see here is the total memory used by RavenDB (production load, fairly…

Blog
Implementing a file pager in Zig: Managing chunk metadata

Implementing a file pager in Zig: Managing chunk metadata

December 28, 2021

The file pager needs to know what values it has in memory and what it needs from the disk. Instead of tracking values on a per page level, we are going to do that on a chunk basis, where each chunk in 2MB (256 pages). A single file is going to be limited to 8 GB in size, so we have a maximum of 4,096 chunks in a file. We can allocate a simple…

Blog
Implementing a file pager in Zig: Overall design

Implementing a file pager in Zig: Overall design

December 27, 2021

In the previous post, I showed how we can get a pretty nice pager (important for building a storage system) in under 100 lines of code using mmap(). If that was all of it, it would be a pretty short series of posts. However, I want to explore what it would take to take ownership of that part of the storage system and build our own from scratch.…

Blog
Implementing a file pager in Zig: Using mmap

Implementing a file pager in Zig: Using mmap

December 24, 2021

Now that we know what we want to implement, let’s dig a bit deeper and see how to do it. An interesting way to implement a file pager is to… not do that. Instead, we can rely on the OS’ memory mapping to do most of the heavy lifting. Let’s see how we can do that. The first thing that we need to manage is the setup and teardown of the pager, which…

Blog
Implementing a file pager in Zig: What do we need?

Implementing a file pager in Zig: What do we need?

December 23, 2021

A file pager is a component in database systems that is responsible for reading and writing pages (typically 8KB blocks) from the file system. The pager is responsible for the I/O operations and is crucial for the overall performance of the system. Ideally, it should manage details such as caching pages in memory, reduce I/O costs and continuously…

Videos
Rate Limits & Capacity Based Pricing with RavenDB

Rate Limits & Capacity Based Pricing with RavenDB

December 22, 2021

Watch RavenDB CEO Oren Eini show you how to protect the roses of your application by cutting the thorns to detect and disable anyone trying to bleed your application dry.

Blog
Optimizing local and distributed transactions with batching

Optimizing local and distributed transactions with batching

December 22, 2021

I got into a good discussion about how RavenDB implements some optimizations with transaction handling. The details got big enough (and hopefully interesting enough) that they warrant their own post. When we are talking about transactions, one of the key factors in the cost of a transaction is the amount of time that it takes to persist that. This…

Blog
Negative feature response: Protect the user from accidental collection deletion

Negative feature response: Protect the user from accidental collection deletion

December 20, 2021

A RavenDB user has accidentally deleted a collection. They intended to do something else, probably, but…  They have a backup, but as you can imagine, this is a bad place to be in. They talked to us and mentioned that they want a feature where deletion in the studio can be locked by a password or even two factor authentication, to prevent such a…