adv-web-scraper-api

Advanced Web Scraper API - Domain Documentation

This documentation organizes the API’s functionality by core domains, providing a structured way to understand and work with the system.

Core Domains

graph TD
    DH[Domains] --> API[API Layer]
    DH --> NAV[Navigation]
    DH --> EXT[Extraction]
    DH --> STG[Storage]
    DH --> SESS[Sessions]
    DH --> DEPLOY[Deployment]
    
    API --> QS["Queue System<br>(api/queue-system.md)"]
    NAV --> NST["Step Types<br>(navigation/navigation-types.md)"]
    NAV --> NEX["Examples<br>(navigation/navigation_examples.md)"]
    EXT --> REG["Regex Extraction<br>(extraction/regex-extraction.md)"]
    STG --> ADPT["Adapters<br>(storage/README.md)"]
    SESS --> BCFG["Browser Config<br>(sessions/browser-configuration.md)"]
    SESS --> SADPT["Session Adapters<br>(sessions/storage-adapters.md)"]
    DEPLOY --> DOCKER["Docker<br>(deployment.md)"]
    DEPLOY --> COOLIFY["Coolify<br>(coolify-deployment.md)"]

API Layer Domain

• Queue System - Asynchronous job handling
• API Reference - Main API documentation

Navigation Domain

• Navigation Types - Available step types
• Navigation Examples - Practical configurations

Extraction Domain

• Regex Extraction - Pattern-based data extraction
• Selector Strategies - Various extraction methods

Storage Domain

• Storage Adapters - Supported storage backends
• Adapter Comparison - Performance characteristics

Session Domain

• Browser Configuration - Browser setup options
• Session Management - Persistent session handling

Deployment Domain

• Docker Deployment - Standard container deployment
• Coolify Deployment - Platform-as-a-service setup

Cross-Domain Features

For architecture overview and cross-domain interactions, see the main documentation.