All views are my own and not a representation for those of any other entity
Most underestimate the power of virtualization: to alter reality in a way that the resources in front of a consumer seem infinite and unbounded, but in truth, are limited by physics
This is a philosophy that powers all of the virtual world. How streams of content are computed (windowing), how state is cached locally (a stale subset of a remote database), how video games synchronize highly concurrent agents (lazy collision detection).
An app that flows state through a near infinite page, virtualized by windowing all directions (in, out, up, down), optimized by prefetching data one click away. A collection of nested views that symbolize kernel drivers: edge experiences loaded at runtime. Overall, an opportunity to centralize the entire internet onto a hierarchy of feeds, the experience that drives most of consumer discovery…
The following article hopes to take the reader on a journey through concurrency, elasticity, and the trends inside modern computing through the case study of building a scheduler (named Romulus) that automatically transforms any serial data structure into a high-performant, concurrent key-value store. By bringing concepts from distributed computing and database design into local memory, a new paradigm in the analysis and extensibility of range locks will form a series of simplistic yet powerful governance principles that partition and protect data as a function of target contention.
As the best paper from ASPLOS ’17 describes:
“Concurrent data structures are used everywhere in the software stack, from the kernel (e.g., priority queues for scheduling), to application libraries (e.g., tries for memory allocation), to applications (e.g., balanced trees for indexing). These data structures, when inefficient, can cripple performance.” — Calciu et. …
The following article hopes to (i) explain the first principles behind RDMA, a technology producing an order of magnitude performance increase in scale-limited systems (ii) discuss the shift from a “one-size fits all” approach in the assumptions and governance of distributed systems towards application-specific views, (iii) and demonstrate how to quickly bootstrap a cool technology.
The last decade observed an acceleration in the volume/diversity of I/O devices at the edge of the network and software applications living therein. The symbiotic relationship between the two magnified this trend. As new application layers required novel forms of computing, new hardware was created to adapt to their demands. Likewise, as new hardware evolved, new markets and experiences increased total time spent in the digital world. …