Endless Storage is a distributed multi-cloud storage engine that transforms multiple personal cloud accounts into a single unified, expandable storage layer.
Instead of storing files on its own servers, Endless Storage connects directly to user-owned cloud providers (starting with Google Drive), automatically splits files into chunks, distributes them across connected drives based on available capacity, and reconstructs them seamlessly on download — all via streaming.
No local persistence. No storage limits tied to a single provider. Just distributed cloud capacity powered by your own infrastructure.
-
Automatic File Sharding Files are split into chunks and distributed across multiple connected cloud accounts.
-
Pooled Capacity If you connect multiple drives, their available storage is combined logically.
-
Streaming Reconstruction Files are reconstructed in order during download without loading the full file into memory.
-
No Local Storage The backend never stores files on disk. All operations are streamed.
-
Provider-Agnostic Architecture Modular connector layer allows adding new providers (OneDrive, Dropbox, etc.) in the future.
Traditional cloud storage ties you to a single provider’s limits.
Endless Storage creates a virtual distributed filesystem on top of multiple consumer cloud accounts, enabling:
- Larger single-file uploads than any individual drive
- Logical capacity expansion
- Provider flexibility
It is effectively a distributed storage engine built on consumer cloud APIs.
- Docker & Docker Compose (Recommended)
- Node.js 18+ (if running frontend natively)
- Python 3.12+ (if running backend natively)
git clone https://github.com/rajtoshranjan/endless-storage.git
cd endless-storage
cp .env.template .env.development
docker compose up --buildFrontend: http://localhost:3000 API: http://localhost:8000
cd client
npm install
npm run devcd server
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt
python manage.py migrate
python manage.py runserverThis project is licensed under the MIT License.