| Q: |
I have been visited by Hostharvest, should I panic?
|
| A: |
You should by no means be worried. Hostharvest is a
well-behaved bot, and will generally not cause
problems. Hostharvest has paid you a visit, because it found
a link to your page somewhere on the web.
|
| Q: |
How often will Hostharvest visit my site?
|
| A: |
It is difficult to give an exact answer to this question, as
Hostharvest randomly selects where to go next. However,
there is an upper limit of 5 urls per host. Therefore, you
will be visited no more than 5 times within a period of
several hours.
|
| Q: |
Can I avoid being visited by Hostharvest?
|
| A: |
Sure. Hostharvest respects
robots.txt files. See this link
for more information.
|
