Packt+ | Advance your knowledge in tech

0

All Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Free Learning

Python Web Scraping Cookbook

You're reading from Python Web Scraping Cookbook Over 90 proven recipes to get you scraping with Python, microservices, Docker, and AWS

Product type Paperback

Published in Feb 2018

Publisher Packt

ISBN-13 9781787285217

Length 364 pages

Edition 1st Edition

Languages

Python

Tools

AWS

Concepts

Data Mining

Author (1):

Michael Heydt

View More author details

Table of Contents (18) Chapters

Title Page

Copyright and Credits

Contributors

Packt Upsell

Preface

1. Getting Started with Scraping FREE CHAPTER

2. Data Acquisition and Extraction

3. Processing Data

4. Working with Images, Audio, and other Assets

5. Scraping - Code of Conduct

6. Scraping Challenges and Solutions

7. Text Wrangling and Analysis

8. Searching, Mining and Visualizing Data

9. Creating a Simple Data API

10. Creating Scraper Microservices with Docker

11. Making the Scraper as a Service Real

1. Other Books You May Enjoy

Leave a review - let other readers know what you think

Index

Chapter 10. Creating Scraper Microservices with Docker

In this chapter, we will cover:

Installing Docker
Installing a RabbitMQ container from Docker Hub
Running a Docker container (RabbitMQ)
Stopping and removing a container and image
Creating an API container
Creating a generic microservice with Nameko
Creating a scraping microservice
Creating a scraper container
Creating a backend (ElasticCache) container
Composing and running the scraper containers with Docker Compose

The rest of the chapter is locked

Register for a free Packt account to unlock a world of extra content!

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at €14.99/month. Cancel anytime

Authors (1)

Michael Heydt

Michael Heydt

Michael Heydt is an independent consultant, programmer, educator, and trainer. He has a passion for learning and sharing his knowledge of new technologies. Michael has worked in multiple industry verticals, including media, finance, energy, and healthcare. Over the last decade, he worked extensively with web, cloud, and mobile technologies and managed user experiences, interface design, and data visualization for major consulting firms and their clients. Michael's current company, Seamless Thingies , focuses on IoT development and connecting everything with everything. Michael is the author of numerous articles, papers, and books, such as D3.js By Example, Instant Lucene. NET, Learning Pandas, and Mastering Pandas for Finance, all by Packt. Michael is also a frequent speaker at .NET user groups and various mobile, cloud, and IoT conferences and delivers webinars on advanced technologies.

See other products by Michael Heydt

Other recommended products

Related to this chapter

Python Web Scraping

Python Web Scraping

This book is the ultimate guide to using latest features of Python 3.x to scrape data from websites. Learn right from extracting data from static web pages to creating class-based scrapers with Scrapy libraries. This book will also help you build crawlers and determine how to scrape data from JavaScript dependent website using PyQt and Selenium. You will also explore testing websites with scrapers, remote scraping, best practices, working with images and many more.

May 2017 7h 20m

Hands-On Web Scraping with Python

Hands-On Web Scraping with Python

Web scraping is an essential technique used in many organizations to scrape valuable data from web pages. This book will help you master web scraping techniques and methodologies using Python libraries and other popular tools such as Selenium. By the end of this book, you will have learned how to efficiently scrape different websites.

Jul 2019 11h 40m

Personalised recommendations for you

Based on your interests and search pattern

Modern Computer Vision with PyTorch

Modern Computer Vision with PyTorch

This book provides a hands-on approach to solving over 30 prominent real-world computer vision problems using PyTorch 2.x on actual datasets. Here you'll learn to build a neural network from scratch and optimize hyperparameters, perform image classification, multi-object detection, segmentation, and more. You'll also explore facial expression manipulation and combining CV with NLP and RL techniques, build generative AI applications, and take your model to production on AWS. By the end of this book, you'll master modern NN architectures and confidently solve real-world CV problems.

Jun 2024 24h 52m

Microsoft Power BI Cookbook

Microsoft Power BI Cookbook

Microsoft Power BI is the most sought-after platform for BI professionals' visualization needs. Explore the latest Power BI features, future AI enhancements, and integration with other Power Platform tools via new recipes in this updated edition.

Jul 2024 19h 56m

RAG-Driven Generative AI

RAG-Driven Generative AI

Explore the transformative potential of RAG-driven LLMs, computer vision, and generative AI with this comprehensive guide, from basics to building a complex RAG pipeline

Sep 2024 11h 8m

Building AI Intensive Python Applications

Building AI Intensive Python Applications

Unlock the power of generative AI with LLMs, vector databases, Python, and MongoDB. Build intelligent apps, master retrieval-augmented generation, optimize models, and explore real-world use cases.

Sep 2024 9h 56m

Using Stable Diffusion with Python

Using Stable Diffusion with Python

This book shows you how to use Python to control Stable Diffusion and generate high-quality images. In addition to covering the basic usage of the diffusers package, the book provides solutions for extending the package for more advanced purposes.

Jun 2024 11h 44m

Getting Started with DuckDB

Getting Started with DuckDB

This hands-on book teaches you to analyze large datasets with blazing speed and ease. You will learn how to use DuckDB to quickly load, query, transform, analyze, and visualize data effectively through a series of practical examples.

Jun 2024 12h 44m

Databricks Certified Associate Developer for Apache Spark Using Python

Databricks Certified Associate Developer for Apache Spark Using Python

This guide gets you ready for certification with expert-backed content, key exam concepts, and topic reviews. Additionally, you'll be able to make the most of Apache Spark 3.0 to modernize workloads and more using specific tools and techniques.

Elastic Stack 8.x Cookbook

Elastic Stack 8.x Cookbook

With its practical approach and real-world examples, this essential resource explores the full potential of Elastic Stack for data-driven projects. Learn how to build scalable and efficient data analytics and search solutions using Elastic Stack.

Jun 2024 22h 56m

Google Machine Learning and Generative AI for Solutions Architects

Google Machine Learning and Generative AI for Solutions Architects

Whether you are relatively new to AI/ML or an experienced solutions architect working to address emerging business challenges, this book covers everything you need to design, implement, and manage complex AI/ML workloads on Google Cloud.

Jun 2024 18h 24m

Generative AI with Amazon Bedrock

Generative AI with Amazon Bedrock

This book provides a hands-on approach to building generative AI applications at scale, covering several architectural patterns and use cases to help you solve business problems and innovate within your organization.

Jul 2024 12h 48m