Site Crawler

Copyright © by Kasper Skaarhoj, Daniel Poetzinger, Fabrizio Branca, Tolleiv Nietsch, Timo Schmidt, Michael Klapper <dev@no spam pleaseaoemedia.de>
Published under the Open Content License available from http://www.opencontent.org/opl.shtml

Table Of Contents

• 1. EXT: Crawler
  • 1.1. Read online
  • 1.2. Introduction
    • What does it do?
    • What's new?
    • Screenshots
  • 1.3. Configuration
    • Extension Manager Configuration
    • Configuration records
    • Read online
    • Page TSconfig Reference (tx_crawler.crawlerCfg)
  • 1.4. Read online
  • 1.5. Executing the queue
    • Executing queue with cron-job
    • Run via backend
  • 1.6. Read online
    • Adding entries to the queue by context menue
    • Building and Executing queue right away (from cli)
  • 1.7. Read online
  • 1.8. Read online
  • 1.9. Read online
  • 1.10. Features
    • Pollable processing instructions
    • Multiprocess support
    • Hooks
  • 1.11. FAQ

This document is related to version 3.2.0 of the extension crawler.