All views are my own and not a representation for those of any other entity
Most underestimate the power of virtualization: to alter reality in a way that the resources in front of a consumer seem infinite and unbounded, but in truth, are limited by physics
This is a philosophy that powers all of the virtual world. How streams of content are computed (windowing), how state is cached locally (a stale subset of a remote database), how video games synchronize highly concurrent agents (lazy collision detection).
The following article hopes to take the reader on a journey through concurrency, elasticity, and the trends inside modern computing through the case study of building a scheduler (named Romulus) that automatically transforms any serial data structure into a high-performant, concurrent key-value store. By bringing concepts from distributed computing and database design into local memory, a new paradigm in the analysis and extensibility of range locks will form a series of simplistic yet powerful governance principles that partition and protect data as a function of target contention.
As the best paper from ASPLOS ’17 describes:
“Concurrent data structures are used…
The following article hopes to (i) explain the first principles behind RDMA, a technology producing an order of magnitude performance increase in scale-limited systems (ii) discuss the shift from a “one-size fits all” approach in the assumptions and governance of distributed systems towards application-specific views, (iii) and demonstrate how to quickly bootstrap a cool technology.
The last decade observed an acceleration in the volume/diversity of I/O devices at the edge of the network and software applications living therein. The symbiotic relationship between the two magnified this trend. As new application layers required novel forms of computing, new hardware was created…