Web crawler needed [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.

---

开发者_JAVA技巧

We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.

Closed 6 years ago.

Improve this question

Does anybody know where I can get a free web crawler that actually works with minimal coding by me?

I've Googled it and can only find really old ones that don't work or openwebspider which doesn't seem to work.

Ideally I'd like to store just the web addresses and which links that page contains.

Any suggestions?

---

I would recommend writing one from scratch. You can use the time you spend searching for the crawler to write one.