website-crawler-spider

Website Crawler Workflow

This workflow performs web crawling and content summarization.

Prerequisites

• Spider API key

Workflow Details

• Input Schema:

  • url: Target URL for crawling

• Tools:

  • spider_crawler: Web crawling service integration

• Main Steps:

  1. Crawl Execution
     • Process target URL
     • Gather website content
  2. Summary Generation
     • Create concise summary (100 words)
     • Format results

Usage

Perfect for applications requiring automated web content extraction and summarization.