• For Individuals
  • For Businesses
  • For Universities
  • For Governments
Coursera
  • Online Degrees
  • Careers
  • Log In
  • Join for Free
    Coursera
    • Browse
    • Web Crawler

    Web Crawler Courses Online

    Learn to build web crawlers for data extraction. Understand how to collect and analyze web data using automated scripts.

    Skip to search results

    Filter by

    Subject
    Required
     *

    Language
    Required
     *

    The language used throughout the course, in both instruction and assessments.

    Learning Product
    Required
     *

    Level
    Required
     *

    Duration
    Required
     *

    Skills
    Required
     *

    Subtitles
    Required
     *

    Educator
    Required
     *

    Explore the Web Crawler Course Catalog

    • Status: Free
      Free
      C

      Coursera Project Network

      Launch an auto-scaling AWS EC2 virtual machine

      Skills you'll gain: Amazon Elastic Compute Cloud, Amazon Web Services, Virtual Machines, Infrastructure As A Service (IaaS), Cloud Infrastructure, Scalability, Verification And Validation

      4.6
      Rating, 4.6 out of 5 stars
      ·
      55 reviews

      Intermediate · Guided Project · Less Than 2 Hours

    • Status: Free Trial
      Free Trial
      B

      Board Infinity

      ISTQB Usability Tester Certification Preparation

      Skills you'll gain: Usability Testing, Usability, Human Centered Design, User Acceptance Testing (UAT), Software Testing, User Research, Surveys, Human Computer Interaction, UI/UX Research, Test Planning, Quality Assurance, Software Quality (SQA/SQC), Survey Creation, Verification And Validation, User Experience Design, User Experience, Risk Management Framework, User Interface (UI) Design, Technical Communication, Web Content Accessibility Guidelines

      3.1
      Rating, 3.1 out of 5 stars
      ·
      7 reviews

      Advanced · Specialization · 1 - 3 Months

    • Status: Free Trial
      Free Trial
      U

      Universidad Austral

      Procesamiento de Lenguaje Natural

      Skills you'll gain: Web Scraping, Natural Language Processing, Data Integration, Data Processing, MLOps (Machine Learning Operations), PyTorch (Machine Learning Library), Machine Learning Algorithms, Data Cleansing, Keras (Neural Network Library), Artificial Neural Networks, Tensorflow, Text Mining, Jupyter, Application Lifecycle Management, Pandas (Python Package), Systems Architecture, Analysis, Deep Learning, Application Development, Scripting

      4.1
      Rating, 4.1 out of 5 stars
      ·
      53 reviews

      Beginner · Specialization · 3 - 6 Months

    • Status: Free Trial
      Free Trial
      E

      EDUCBA

      Azure Networking Fundamentals

      Skills you'll gain: Network Architecture, Network Monitoring, Load Balancing, Microsoft Azure, Network Troubleshooting, Network Infrastructure, Scalability, Network Security, Cloud Infrastructure, Computer Networking, Firewall, Virtual Private Networks (VPN), Distributed Denial-Of-Service (DDoS) Attacks, Virtual Machines

      4.5
      Rating, 4.5 out of 5 stars
      ·
      32 reviews

      Beginner · Course · 1 - 4 Weeks

    • Status: Free
      Free
      D

      DeepLearning.AI

      Understanding and Applying Text Embeddings

      Skills you'll gain: Large Language Modeling, Anomaly Detection, Google Cloud Platform, Text Mining, Applied Machine Learning, Natural Language Processing, Semantic Web, Unsupervised Learning, Unstructured Data

      4.8
      Rating, 4.8 out of 5 stars
      ·
      64 reviews

      Beginner · Project · Less Than 2 Hours

    • Status: Free Trial
      Free Trial
      P

      Packt

      Advanced Exploitation and Scripting Techniques

      Skills you'll gain: Penetration Testing, Scripting, Python Programming, Cyber Security Assessment, Email Security, Malware Protection, Command-Line Interface, Program Development, Network Security, Debugging, Network Protocols

      4.9
      Rating, 4.9 out of 5 stars
      ·
      8 reviews

      Advanced · Course · 1 - 3 Months

    • Status: Free Trial
      Free Trial
      G

      Google Cloud

      Reliable Cloud Infrastructure: Design and Process 日本語版

      Skills you'll gain: Microservices, Application Deployment, CI/CD, Google App Engine, API Design, Cloud Computing Architecture, Kubernetes, Google Cloud Platform, Cloud Security, DevOps, Hybrid Cloud Computing, Service Level Agreement, Network Architecture, Cloud Storage, Service Design, Scalability, System Monitoring, Load Balancing, NoSQL, Key Performance Indicators (KPIs)

      4.6
      Rating, 4.6 out of 5 stars
      ·
      81 reviews

      Advanced · Course · 1 - 3 Months

    • Status: Free Trial
      Free Trial
      P

      Packt

      Advanced Selenium WebDriver Techniques and Framework Design

      Skills you'll gain: Cucumber (Software), Selenium (Software), Apache Maven, Object Oriented Programming (OOP), Behavior-Driven Development, Java, Jenkins, Test Case, Test Automation, CI/CD, Test Execution Engine, Application Frameworks, Software Testing, Software Design Patterns

      Intermediate · Course · 1 - 3 Months

    • Status: Free
      Free
      C

      Coursera Project Network

      Access an EC2 instance shell from the AWS console

      Skills you'll gain: Amazon Elastic Compute Cloud, Amazon Web Services, Application Deployment, Virtual Machines, Web Applications, Public Cloud, Linux Servers, Remote Access Systems

      4.6
      Rating, 4.6 out of 5 stars
      ·
      50 reviews

      Beginner · Guided Project · Less Than 2 Hours

    • Status: Free
      Free
      A

      Amazon Web Services

      Migrating SAP Workloads to AWS

      Skills you'll gain: Digital Transformation, Amazon Web Services, SAP Applications, Cost Reduction, Data Migration, Cloud Solutions, Performance Improvement, Platform As A Service (PaaS), Cloud Hosting, Amazon Elastic Compute Cloud, Cloud Management, Cloud Services

      4.4
      Rating, 4.4 out of 5 stars
      ·
      22 reviews

      Mixed · Course · 1 - 4 Weeks

    • Status: New
      New
      C

      Coursera Instructor Network

      GenAI for Dynamic Advertising and Media Buying

      Skills you'll gain: Pay Per Click Advertising, Google Ads, Advertising Campaigns, Media Buying, Content Performance Analysis, Online Advertising, Digital Advertising, Advertising, Generative AI Agents, Data Ethics, Campaign Management, Paid media, Marketing Automation, AI Personalization, Automation, Content Creation, A/B Testing, Budget Management

      Intermediate · Course · 1 - 4 Weeks

    • Status: Free
      Free
      A

      Amazon Web Services

      AWS Glue Getting Started

      Skills you'll gain: Amazon Web Services, Data Processing, Amazon S3, Data Cleansing, Extract, Transform, Load, Data Architecture, Data Pipelines, Data Integration

      4.5
      Rating, 4.5 out of 5 stars
      ·
      22 reviews

      Beginner · Course · 1 - 4 Weeks

    Web Crawler learners also search

    Web Development
    Web Design
    Web Technologies
    Front-end Web Development
    Beginner Web Development
    Web Development Projects
    Beginner Web Design
    Web Design Projects
    1…132133134…259

    In summary, here are 10 of our most popular web crawler courses

    • Launch an auto-scaling AWS EC2 virtual machine: Coursera Project Network
    • ISTQB Usability Tester Certification Preparation: Board Infinity
    • Procesamiento de Lenguaje Natural: Universidad Austral
    • Azure Networking Fundamentals: EDUCBA
    • Understanding and Applying Text Embeddings: DeepLearning.AI
    • Advanced Exploitation and Scripting Techniques: Packt
    • Reliable Cloud Infrastructure: Design and Process 日本語版: Google Cloud
    • Advanced Selenium WebDriver Techniques and Framework Design: Packt
    • Access an EC2 instance shell from the AWS console: Coursera Project Network
    • Migrating SAP Workloads to AWS: Amazon Web Services

    Skills you can learn in Software Development

    Programming Language (34)
    Google (25)
    Computer Program (21)
    Software Testing (21)
    Web (19)
    Google Cloud Platform (18)
    Application Programming Interfaces (17)
    Data Structure (16)
    Problem Solving (14)
    Object-oriented Programming (13)
    Kubernetes (10)
    List & Label (10)

    Other topics to explore

    Arts and Humanities
    338 courses
    Business
    1095 courses
    Computer Science
    668 courses
    Data Science
    425 courses
    Information Technology
    145 courses
    Health
    471 courses
    Math and Logic
    70 courses
    Personal Development
    137 courses
    Physical Science and Engineering
    413 courses
    Social Sciences
    401 courses
    Language Learning
    150 courses

    Coursera Footer

    Technical Skills

    • ChatGPT
    • Coding
    • Computer Science
    • Cybersecurity
    • DevOps
    • Ethical Hacking
    • Generative AI
    • Java Programming
    • Python
    • Web Development

    Analytical Skills

    • Artificial Intelligence
    • Big Data
    • Business Analysis
    • Data Analytics
    • Data Science
    • Financial Modeling
    • Machine Learning
    • Microsoft Excel
    • Microsoft Power BI
    • SQL

    Business Skills

    • Accounting
    • Digital Marketing
    • E-commerce
    • Finance
    • Google
    • Graphic Design
    • IBM
    • Marketing
    • Project Management
    • Social Media Marketing

    Career Resources

    • Essential IT Certifications
    • High-Income Skills to Learn
    • How to Get a PMP Certification
    • How to Learn Artificial Intelligence
    • Popular Cybersecurity Certifications
    • Popular Data Analytics Certifications
    • What Does a Data Analyst Do?
    • Career Development Resources
    • Career Aptitude Test
    • Share your Coursera Learning Story

    Coursera

    • About
    • What We Offer
    • Leadership
    • Careers
    • Catalog
    • Coursera Plus
    • Professional Certificates
    • MasterTrack® Certificates
    • Degrees
    • For Enterprise
    • For Government
    • For Campus
    • Become a Partner
    • Social Impact
    • Free Courses
    • ECTS Credit Recommendations

    Community

    • Learners
    • Partners
    • Beta Testers
    • Blog
    • The Coursera Podcast
    • Tech Blog

    More

    • Press
    • Investors
    • Terms
    • Privacy
    • Help
    • Accessibility
    • Contact
    • Articles
    • Directory
    • Affiliates
    • Modern Slavery Statement
    • Manage Cookie Preferences
    Learn Anywhere
    Download on the App Store
    Get it on Google Play
    Logo of Certified B Corporation
    © 2025 Coursera Inc. All rights reserved.
    • Coursera Facebook
    • Coursera Linkedin
    • Coursera Twitter
    • Coursera YouTube
    • Coursera Instagram
    • Coursera TikTok