httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug McNutt <>
Subject Re: [users@httpd] disable wget-like user-agents
Date Tue, 04 Jan 2011 23:33:55 GMT
At 18:19 -0500 1/4/11, Mark Montague wrote:
>Follow the example below, but use only the user agent condition, omit the IP condition,
and suitably adjust the RewriteRule regular expression to match the URL(s) you wish to block:
>Note that wget has a -U option that can be used to get around this block by using a user
agent string that you are not blocking -- so the block will not prevent a determined downloader.


You might want to have a look at this rather new mailing list.  It's interested in doing exactly
the opposite of what you want. 

List-Id: webscrapers talk <>
List-Archive: <>
List-Post: <>
List-Help: <>
List-Subscribe: <>, <>


--> From the U S of A, the only socialist country that refuses to admit it. <--

The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:> for more info.
To unsubscribe, e-mail:
   "   from the digest:
For additional commands, e-mail:

View raw message