jmeter-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sebb <>
Subject Re: JMeter 4.0RC... is still at
Date Thu, 03 Oct 2019 12:32:23 GMT
On Thu, 3 Oct 2019 at 12:52, Vladimir Sitnikov
<> wrote:
> sebb>So surely that means it won't return matches to the staging site based
> on content?
> Which documentation do you read?

As below:

"Google won't crawl or index the content blocked by robots.txt"

If Google does not index the content, it can't return searches for
text in the content.

> As for me, Google WILL display those results.

If they don't have the content, how can they return matching results?

>    - While Google won't crawl or index the content blocked by robots.txt,
>    we might still find and index a disallowed URL if it is linked from other
>    places on the web. As a result, the URL address and, potentially, *other
>    publicly available information such as anchor text in links to the page can
>    still appear in Google search results*. To properly prevent your URL
>    from appearing in Google Search results, you should password-protect the
>    files on your server <>
>     or use the noindex meta tag or response header
>    <> (or remove the page
>    entirely).
> They recommend password-protect the page though.
> So the only viable options so far are:
> 1) drop the page
> 2) password-protect it
> Vladimir

View raw message