Site Crawler

Site Crawler

Libraries and scripts for crawling the TYPO3 page tree.

 

TYPO3 version support

This version works for TYPO3 6.2.0 - 7.99.99
If you look for other TYPO3 versions, click the "Download" tab to get a history of all extension versions.

Last upload comment

[RELEASE] Release of crawler 5.0.9

Downloads by version

Other extensions from extension owner

Extension key crawler
Version 5.0.9 stable
Last updated September 16, 2016
First upload December 22, 2005
Downloads 27,661
Category Backend Modules
Dependencies
  • PHP (5.3.0 - 7.99.99)
  • TYPO3 (6.2.0 - 7.99.99)
Conflicts none
Manual Extension Manual
External manual
External repository Take a look into the code
Username aoepeople
Author AOE GmbH
AOE GmbH

Download current version 5.0.9

Version history

5.0.8
September 16, 2016
[RELEASE] Release of crawler 5.0.8
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.7
September 06, 2016
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.6
August 22, 2016
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.9
September 16, 2016
[RELEASE] Release of crawler 5.0.9
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.8
September 16, 2016
[RELEASE] Release of crawler 5.0.8
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.7
September 06, 2016
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.6
August 22, 2016
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.5
August 15, 2016
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.4
March 18, 2016
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.3
March 10, 2016
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.2
January 26, 2016
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.1
December 08, 2015
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
5.0.0
October 27, 2015
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 6.2.0 - 7.99.99
Download T3X Package Download ZIP Archive
4.1.1
March 10, 2016
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 4.5.0 - 6.2.99
Download T3X Package Download ZIP Archive
4.1.0
October 27, 2015
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 4.5.0 - 6.2.99
Download T3X Package Download ZIP Archive
4.0.0
August 11, 2015
New TER Release

git-svn-id: https://svn.typo3.org/TYPO3v4/Extensions/crawler/tags/V_3-5-0@67349 735d13b6-9817-0410-8766-e36946ffe9aa
Supports TYPO3 version 4.5.0 - 6.2.99
Download T3X Package Download ZIP Archive
3.5.0
October 22, 2012
- Update Documentation
- Add Multiprocessing CLI
- Add Feature to use sys_domain record for BaseURL
- Added UnitTests
- Enable Crawling with HTTPS
- Improve Scheduler Tasks
- Bug-Fixes
Download T3X Package Download ZIP Archive
3.2.0
June 29, 2010
Improve scheduler integration, minor bug fixes. Download T3X Package Download ZIP Archive
3.1.2
April 19, 2010
Improve handling with "t3lib_FlashMessage", Update documentation, Reimplement "Result Log" column. Download T3X Package Download ZIP Archive
3.1.1
April 01, 2010
Fix documentation Download T3X Package Download ZIP Archive
3.1.0
March 31, 2010
Update documentation
Improved scheduler and TYPO3 4.3 integration
Fixed several bugs
Add more tests
Download T3X Package Download ZIP Archive
3.0.5
February 27, 2010
Release notes:

* TYPO3 4.3 integration
* Scheduler integration
* CLI API cleanup
* Bugfixes
Download T3X Package Download ZIP Archive
3.0.0
September 10, 2009
- multiprocessing
- new way to configure
- see manual for details
Download T3X Package Download ZIP Archive
2.1.0
July 24, 2008
diffrent options in em to control sleeptimes / change "keep-alive" header / add debugmode / readurl fixes
Download T3X Package Download ZIP Archive
2.0.0
March 23, 2007
Updated various features, see manual Download T3X Package Download ZIP Archive
1.1.0
March 21, 2006
Download T3X Package Download ZIP Archive
1.0.0
February 16, 2006
Download T3X Package Download ZIP Archive
0.0.1
December 22, 2005
[Dont download yet - its only for beta testing before 4.0] Download T3X Package Download ZIP Archive
Back to Extension List