Terraform Module for a serverless Nix LRU S3 binary cache. Runs fully in your own AWS Account. Unlike other self-hosted caches, there is no HTTP server or any other "moving part": the binary cache is the raw S3 bucket. Garbage collection is done async.
Uses AWS S3 server logs for LRU tracking. Uses lifecycle rules and AWS Lambda to prune the logs and cache.
LRU (Least Recently Used) is a cache replacement policy where items are garbage collected based on how recently they have been used. In contrast, a FIFO cache, for example, purges items based on when they were added.
Note
Common LRU cache implementations allow specifying a maximum cache size, and pruning least-recently-used elements until the total cache size drops below that size. This implementation does not support such a configuration; rather, it prunes all items which haven't been used in a (configurable) timeframe (e.g. 1 month). This is not a fundamental limitation; it just happens to be what we needed.
The idea is to deploy this in your own AWS account, giving you billing, colocation, and simplicity benefits.
These are offered here Open Source, and Free for all to use (following the LICENSE), but with zero warranty or guarantees.
If you want to use these tools we advise reading the license and forking the repo.
To explore, checkout the repo and run:
$ nix flake show
git+file:///Users/you/path/s3-nix-lru-cache
├───checks
...And take it from there
s3-nix-lru-cache is authored by Anterior, based in NYC, USA.
We’re hiring! If you got this far, e-mail us at hiring+oss@anterior.com and mention Nix Cache.
The code is available under the AGPLv3 license (not later).
See the LICENSE file.