Read now
Introducing Quill: the live context layer for AI →
QuillNEW
Get Started
QuillNEW
Decoration background
Posts
Podcasts
Build a Database from the Ground Up

Build a Database from the Ground Up

January 25, 2022

In this talk, Oren Eini, founder of RavenDB, is going to take apart a database engine on stage. We are going to inspect all the different pieces that make for an industrial-grade database.

Blog
Implementing a file pager in Zig: Pages, buffers and metadata, oh my!

Implementing a file pager in Zig: Pages, buffers and metadata, oh my!

January 24, 2022

Databases will typically divide their data files into pages, and manage all data in pages. As you can imagine, the notion of pages is pretty important to a database. Up to this point, we worked with pages, but not really. A page was just a buffer that we could read and write to. It took me 13 posts to manage to read and write pages from disk, but…

Blog
Implementing a file pager in Zig: Write behind implementation

Implementing a file pager in Zig: Write behind implementation

January 21, 2022

In the last post, we figured out how we can find what pages we should flush to disk. In this one, I want to talk about how we can actually do the flushing. Once a page is marked as ready for flushing, we need to start an async process in which we write it to the disk. While that process is running, we need to ensure that there are no further…

Blog
Implementing a file pager in Zig: Write behind policies

Implementing a file pager in Zig: Write behind policies

January 19, 2022

In the previous post I outlined some ideas about how to implement a more efficient write behind. The idea is that whenever we write pages to the Pager, we’ll not trigger an immediate write to the disk. Instead, we’ll keep the data in memory and only write to the disk when we hit a certain threshold. In many write scenarios, there are certain pages…

Blog
Implementing a file pager in Zig: Write durability and concurrency

Implementing a file pager in Zig: Write durability and concurrency

January 18, 2022

In the last blog post I presented the manner in which the Pager can write data to disk. Here is a reminder: We acquire the writer (and a lock on it), call write on the pages we want to write on (passing the buffer to write on them), and finalize the process by calling flushWrites() to actually write the data to disk. As a reminder, we assume…

Blog
Implementing a file pager in Zig: Writing data

Implementing a file pager in Zig: Writing data

January 17, 2022

At long last, we are now at the point where we can write data back to the disk.  Before we can do that, however, we need to figure out what sort of writes we want to allow. The idea that I have in mind for the Pager is to follow the same path as Voron does. In other words, for writes, we can make the following assumptions: There is only a single…

Videos
Pivoting to Success With a High-Agility Database

Pivoting to Success With a High-Agility Database

January 17, 2022

RavenDB CEO Oren Eini explains how RavenDB provides the flexibility to adapt your data to changing business needs and the scalability to grow with your success.

Blog
re: Are You Sure You Want to Use MMAP in Your Database Management System?

re: Are You Sure You Want to Use MMAP in Your Database Management System?

January 14, 2022

I was pointed to this paper on twitter: Are You Sure You Want to Use MMAP in Your Database Management System? As you can imagine, this is a topic near and dear to my heart. This is especially the case since I am currently writing the Implementing a file pager in Zig posts series. I implemented the same low level mechanics using mmap, using mmap, I…

Blog
Working With Market Data Using Time Series in RavenDB

Working With Market Data Using Time Series in RavenDB

January 13, 2022

Kamran Ayub has another great article discussing how to utilize RavenDB to analyze crypto markets data. In addition to the article, you can see the full source code for the sample application. There is even a really cool intro video for the application and…