Tag: Scala
-
Running An Apache Spark Application on Amazon Elastic MapReduce
This is a series of guided screenshots on how to run an AWS EMR Spark application. Last time we wrote a spark count application that found the list of channels with more than 24 hours of programming. We will run that same application this time on EMR instead of the…
-
Getting Unique Combinations Of Products with Apache Spark
This Apache Spark snippet looks at users who have rated a series of products and pulls out the unique combinations of the products rated by each user to start building a recommendation system. To get there though we will go through a multi-part MapReduce algorithm. Some Terminology: (k,v) denotes…
-
Running A Count With MapReduce in Apache Spark
Apache Spark Snippet - Counts This is the first in a series of snippets on Apache Spark programs. In a previous post I ran a machine learning algorithm through Spark and will be following a similar setup using the Hortonworks Sandbox. In the future I'll do some snippets on AWS'…
-
RabbitMQ, FTP Microservice and Docker
I decided to make a quick video on a microservice written in Scala and Akka working with a RabbitMQ message broker and a Pure FTPD service both running inside Docker containers. The video will demonstrate: An Intro to RabbitMQ and its web interface. Some fallback mechanisms if RabbitMQ goes down…
-
Solving A 2D Maze Game Using a Genetic Algorithm and A* Search - Part 2
Part 2 focuses on solving the simple maze in this earlier post. Just as a recap though the maze looks like this: # = Wall P = Player F = Finish = Floor Tile # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # P # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # F # # # # # # # # # # # # # # # # Solving it might not be the right word as a genetic algorithm is more of an optimization algorithm. Optimization…
-
Solving A 2D Maze Game Using a Genetic Algorithm and A* Search - Part 1
There's a lot of material out there on genetic algorithms and A * Search. I decided to just make a little 2D maze and approach the problem two different ways to better understand both algorithms without introducing too much complexity, get familiar with Scala and of course make it a bit…