Setting up a Spark cluster on AWS

Big data, Spark

On 7th December 2017 I gave a presentation at CodeNode (London UK) in which I showed how to set up a Spark cluster on AWS spot-requested instances.

You can find the meeting notes on the Full Stack Quants website — there is a link to a video recording of the session as well as links to the GitHub repo and Trello board that I used.

Advertisement

Published by Robert

Mathematician (PhD in Probability Theory). Art lover (spent one excellent year studying painting and ceramics at Batley Art College). Ex investment banker (2yrs of fixed-income exotics trading, 5 yrs of quantitative research, 2 yrs of inflation structuring). Now busy as a quantitative software developer.

Published

Leave a Reply

Fill in your details below or click an icon to log in:

Gravatar
WordPress.com Logo

You are commenting using your WordPress.com account. ( Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. ( Log Out /  Change )

Cancel

Connecting to %s