nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mike Smith" <mike.smith....@gmail.com>
Subject Amazon S3/Ec2 problem [injection and fs.rename() problem]
Date Tue, 16 Jan 2007 20:30:03 GMT
I've testing Tom's nice S3/EC2 patch on couple of EC2/S3 machine. Injector
fails to inject urls, because fs.rename() in line 145 of
CrawlDb.javadeletes the whole content and only renames the parent
folder from xxxxx to
current. Basiclly,. crawl_dir/crawldb/current will an empty folder after
renaming.

I have not gone through the hadoop fs.rename code, I thought maybe somebody
have solved this problem before.

Thanks, Mike

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message