Category Archives: Storage

Amazon S3 ETag Advanced Information

Posted on April 10, 2022 by tim

You are probably here because you looked at one of your S3 object’s ETag, and it had a dash character (“-“) in it. Most of your other ETag values are simple and correct md5sum hashes. But this one is weird. … Continue reading →

Posted in Software Engineering, Storage | Comments Off on Amazon S3 ETag Advanced Information

FreeNas 11 ZFS Replace Failed Drive

Posted on August 8, 2020 by tim

This documents the steps to replace a failed drive in a mirror configuration in FreeNAS 11.1-U7. This process is really easy with FreeNAS. This scenario is in contrast to replacing a failed drive before it fails (in a Centos “ad-hoc” … Continue reading →

Posted in Storage, ZFS | Comments Off on FreeNas 11 ZFS Replace Failed Drive

Hadoop Terasort VirtualBox benchmarks

Posted on August 6, 2017 by tim

Setup: 3-node hadoop (hdp v2.6.1), installed via Ambari 2.5.1 and running in VirtualBox 5.1 on one physical machine. The terasort is traditionally run on 1 terabyte of random data (SIZE=10,000,000,000). In 2008, Yahoo! ran terasort on 1TB of data in … Continue reading →

Posted in Storage | Comments Off on Hadoop Terasort VirtualBox benchmarks