The University of Waterloo School of Computer Science (SCS) recently undertook a project to provide several hundred TB of redundant, multi-building distributed high-performance storage for SCS users and infrastructure use. The first part of this talk will recount the non-linear trajectory of the project from the formulation of goals through to the delivered Ceph system.
The design of this system allows for the modular addition of services utilizing the storage. The first such service, SCS Nextcloud, provides a DropBox-like functionality across all popular client platforms. We will give details of a high-availablity implementation of Nextcloud built using haproxy and containers.