A small, informal (and hopefully fun) presentation on a 'high performance' API scraper I built for EVE Online/CREST a while ago. It mainly deals with the various problems and their solutions I encountered while designing/writing this piece of software. I will show different approaches to the problem set while touching on topics like:

OTP / GenServer / Supervisors memory-saving techniques simple performance analysis NIFs ZeroMQ and zlib 'smart' scraping oAuth fun ETS accidentally DoS'ing yourself ...and probably a couple more I forgot. There are a lot of bits and pieces which might be useful for beginners and advanced developers alike, so that they won't hit the same roadblocks I hit.