|Daniel Gomes' video|
Arquivo.pt is the Portuguese Web Archive. It got started in 2007, and in 2010 was an early archive to support full-text search. In 2013 it suffered a hardware malfunction that took the service down and lost 17% of its content. This led to a complete re-think of the system architecture, implementation, and operations. Daniel describes this process and the encouraging results in detail. It is well worth the 20 minutes to watch it.
Daniel divides the re-think into 5 major sections:
- Hardware and software architecture shifted to shared-nothing
- Reinforced replication policies
- Monitor the service
- Quality assurance for software development
- Document and test procedures