1. Syncing GitHub and GitLab activity using Gitivity

    The activity charts of GitHub are a well known feature; some love them, some hate them. These charts are displayed on the profile page of users on the site, and represent a users contribution activity across the site in yearly blocks. This post is going to cover working with tool…

    Approximate 6 min read published

  2. Settings Aliases for Git Sources

    I'm sure many of you go to places like the GitHub or GitLab UI to copy the URL to clone a repository. I thought I'd share a small configuration I found recently in my .gitconfig that helps save some time when setting remotes in Git repositories (or cloning new ones). Before I fou…

    Approximate 2 min read published

  3. Building Simple APIs with Hyper and Usher

    When writing a web service, I often lean towards using tools that are as minimal as possible. One pretty obvious reason for this is the avoidance of dependencies you either don't want or don't need in your project. Whilst I'm not someone who goes out of their way to avoid depende…

    Approximate 13 min read published

  4. Writing MapReduce Jobs Using Rust and Efflux

    During my work life, I spend a lot of time working with MapReduce-style workflows, particularly with Hadoop infrastructure. A lot of this work is spent with larger amounts of data in order to implement the batch layer of the Lambda architecture. Due to this, the largest concern i…

    Approximate 8 min read published

  5. Simulating Distributed Clusters for Elixir Unit Tests

    During the recent addition of distribution to Cachex, I realised that testing distributed behaviour is quite annoying. Although there's a tonne of useful inside the OTP standard library, it's not particularly obvious if you don't know what you're looking for. Most projects (such…

    Approximate 5 min read published

  6. Quickly Concatenating Files in Amazon S3

    Amazon S3 is a storage solution used by pretty much everyone these days. Due to this there are naturally a bunch of tools for doing almost everything you can think of with S3. This post is about a tool I wrote to retrieve concatenate files efficiently in S3 buckets. If you don't…

    Approximate 4 min read published

  7. Easily Analyzing Your S3 Buckets

    Amazon S3 is a storage solution used by pretty much everyone these days. Due to this there are naturally a bunch of tools for doing almost everything you can think of with S3. This post is about a tool I wrote to retrieve metadata about S3 buckets. If you don't care for the post,…

    Approximate 3 min read published

  8. Filtering Duplicate Log Entries via Rust and Runiq

    If you work on any kind of backend system, odds are you're familiar with the pains of trawling through files looking for something specific only to discover huge amounts of entries which are basically all the same thing. Perhaps you have a really cool API that everyone calls all…

    Approximate 7 min read published