HTMLgobble
| Name |
HTMLgobble |
| Cover |
|
| Details |
|
| Status |
|
| Description |
A mirroring robot. Configured to stay within a directory,
sleeps between requests, and the next version will use HEAD
to check if the entire document needs to be
retrieved |
| Purpose |
mirror |
| Type |
|
| Platform |
|
| Language |
|
| Availability |
|
| Owner Name |
Andreas Ley |
| Owner URL |
|
| Owner Email |
ley@rz.uni-karlsruhe.de |
| Exclusion |
|
| Exclusion User-Agent |
|
| NOINDEX |
no |
| Host |
tp70.rz.uni-karlsruhe.de |
| From |
yes |
| UserAgent |
HTMLgobble v2.2 |
| History |
|
| Environment |
|
| ID |
htmlgobble |
| Modified Date |
|
| Modified By |
|
