4

I'm looking for software that will recursively crawl a website to download all of the images from the entire website. (Not just from a single webpage.)

To illustrate:

If the site is www.example.com the program should download all images that it finds on www.example.com. It should also follow any links that it finds on www.example.com and continue doing this to download all images from www.example.com/*. It should categorically ignore any links that lead off of www.example.com, but not links such as images.example.com/picture.jpg.

The program must be free but not necessarily open source.

The program should run on Windows.

Improve this question
3
  • Software for AmigaOS OK – or do you prefer Atari TOS? ;)
    – Izzy
    Commented Apr 12, 2016 at 6:09
  • Should it crawl URLs like www.example.com/page.php?id=4875 or www.example.com/post.php?name=ibid ?
    – Nicolas Raoul ♦
    Commented Apr 12, 2016 at 6:19
  • @NicolasRaoul - Not so sure what those are. I've never seen them on the site in question, so I'd assume no. The only "?" modifiers I've seen there are cropping the images (which I would prefer removed, as I want the full size image.)
    – user22923
    Commented Apr 12, 2016 at 7:13

4 Answers 4

Reset to default
3

HTTrack is a free (GPL, libre/free software) and easy-to-use offline browser utility.

For mirroring only images you need to set scan rules properly.

Limit external depth download and ensure that you have appropriate image filters (Options > Scan rules). The following will accept any images found even if they are linked from other servers:

 +*.gif +*.jpg +*.png +*.bmp
Improve this answer
1
  • Only problem is that all of the links to imageson the site include query strings to crop and shrink the pictures. I want the full size pictures. Is there a way to use httrack to ignore query strings when downloading?
    – user22923
    Commented Apr 15, 2016 at 17:10
1

WFDownloader App can download images while crawling a website. It also meets your other criteria like being free and being able to run on Windows. You use its crawler mode to achieve this.

  1. Open the application and go to Tasks > Add a batch download via manual links fetcher.
  2. Enter the URL you want to start the search from, select "Crawler mode" and click "Next".
  3. Select "Images" as what you want to download. You can use the various filters to filter what pages are crawled or what images are fetched.
  4. Click "Search".
Improve this answer
0

Download them all, is an add-on for Firefox that can allow you to download anything (you can filter for just images) from a selected webpage

Improve this answer
1
  • 3
    To quote the OP: I'm looking for software that will recursively crawl a website to download all of the images from the entire website. (Not just from a single webpage.)
    – user22923
    Commented Apr 13, 2016 at 11:22
0

ImgDownloader can do the job very efficiently. I have personally used it for some tasks and it worked fine for me.

Improve this answer

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.