There was another post on here where the creator responded, and he had intentionally built a site that had bots endlessly digging further through pages, though I can't recall which. I believe his site was pretty old too, and of simple html.