Chapter 7. Executors and Pools
In this chapter, we will look in depth at concepts such as Thread pools and Process pools, and how we can work with Python's implementation of these concepts in order to speed up the execution of our programs.
We'll be looking at the following topics in some detail:
- Concurrent Futures
- Future Objects
- Process Pool Executors
We'll also continue with our progress on the website crawler that we created in Chapter 5, Communication between Threads, by adding functionality, such as writing the results to a CSV file and refactoring our code, to use the new techniques you'll be learning about in more detail within this chapter.
By the end of this chapter, you should have an appreciation as to how we can improve the performance of our Python program by leveraging executor objects as well as how they can help to simplify the amount of work we have to do with regard to handling threads and processes.
