Summary
In this chapter we performed affinity analysis in order to recommend movies based on a large set of reviewers. We did this in two stages. First, we found frequent itemsets in the data using the Apriori algorithm. Then, we created association rules from those itemsets.
The use of the Apriori algorithm was necessary due to the size of the dataset. In Chapter 1, Getting Started With Data Mining, we used a brute-force approach, which has exponential growth in the time needed to compute those rules required for a smarter approach. This is a common pattern for data mining: we can solve many problems in a brute force manner for small datasets, but smarter algorithms are required to apply the concepts to larger datasets.
We performed training on a subset of our data in order to find the association rules, and then tested those rules on the rest of the data—a testing set. From what we discussed in the previous chapters, we could extend this concept to use cross-fold validation to better evaluate...
