Epic Games Open-Sources Lore to Tackle Large-Asset Version Control

Version control has long been a tale of two worlds. In one, software developers enjoy the distributed flexibility of Git. In the other, game developers and digital artists—burdened by multi-gigabyte 3D models, textures, and audio files—grudgingly stick to centralized, proprietary giants to avoid choking their local machines.

Epic Games is attempting to bridge this divide with the release of Lore, a new open-source version control system designed from the ground up to handle massive binary assets alongside code. Released under the permissive MIT license, Lore is a centralized, content-addressed VCS that aims to scale to massive team and repository sizes without the performance degradation typical of traditional systems.

The Architecture of a Binary-First VCS

At its core, Lore rejects the pure distributed model of Git in favor of a centralized, service-backed architecture. However, its underlying data structures borrow heavily from modern cryptographic concepts.

Lore represents repository state using Merkle trees, where every piece of data is stored and referenced by its content hash. This content-addressed storage model allows the system to perform rapid integrity checks and instantly compare states across history and branches.

To guarantee history remains tamper-evident, Lore organizes updates into an immutable revision chain. Each revision's hash signature is cryptographically derived from its entire state, including the hashes of its parent revisions and the specific data hashes it contains. This design ensures that while the system is centralized, its history is mathematically verifiable and secure against silent corruption.

Chunking and Sparse Workspaces

The real pain point in game development isn't tracking code; it's managing files that are too large to fit comfortably in standard diff tools. Lore addresses this by treating large binary assets as first-class citizens through chunked storage and on-demand hydration.

Advertisement

Shadow GPS — know where it is, always Real-time GPS tracking for vehicles, gear and loved ones. No monthly contracts.

Instead of treating large files as monolithic blocks, Lore breaks them down into reusable chunks with indexed lookups. When a file is modified, only the changed chunks need to be uploaded and stored, drastically reducing duplication and optimizing network transfer speeds.

This chunking strategy pairs with "sparse workspaces" and on-demand hydration. In a typical Git repository, cloning means downloading the entire history and every asset up front. With Lore, workspaces remain lightweight. The system only fetches file data when it is explicitly needed by the user, allowing developers and artists to get to work in minutes rather than waiting hours for a massive repository to sync.

Centralized Scale with Smart Caching

To support hundreds of developers and artists working on the same project, Lore relies on a centralized service architecture. To prevent the central server from becoming a bottleneck during peak hours, the architecture places a robust caching layer in front of durable storage. This setup is designed to scale throughput for large teams pushing and pulling massive assets simultaneously.

Branching in Lore is also optimized for speed. Rather than copying files or creating heavy directory structures, branches in Lore are lightweight, mutable references. This allows developers to create, manage, and switch between branches almost instantly, without duplicating the underlying data on their local drives.

Built for Integration

Epic Games is positioning Lore not just as an internal tool, but as an extensible platform for the broader industry. The system features a CLI that provides complete, one-to-one access to all Lore functionality, making it easy to script and automate.

For deeper integrations, Lore provides a full-surface API supported by SDKs across a wide range of languages. Developers can extend and customize the VCS using:

• C/C++
• C#
• Rust
• Go
• Python
• JavaScript

While the project is still in its early open-source days, the combination of a permissive MIT license, robust binary handling, and modern cryptographic integrity makes Lore a compelling alternative for any engineering team struggling to balance code and heavy assets in the same repository.