Visualizing the SiteMap of a large (page number) website

I'm looking for a tool or service that can spider a web domain with a large number of pages, create a sitemap, and then visua开发者_JAVA技巧lize that map in a way that will help me see, understand and group content (I'm new to the site) Something like a tree-view or other standard Site Map visualizations would be great. I am yet unable to find a tool that does this (I've found plenty of things to spider the site and create an xml file, nothing to visualize it)

Thanks!

The software Gephi and one of its plugins provides exactly the function that you need.

For visualization you can check D3.js

For example Force-Directed Graph

Visualize website structure you can with Site Visualizer software.

Download and install it, then create new project and click Start toolbutton. After the site will be crawled, open Visual Sitemap tab and click Draw button. Visual map of the site will be created as a set of pages (rectangles) and links (arrows). Click on a rectangle in order to highlight all outbound links of the page. You can also save this visualization to an image file: png, jpg, bmp, etc.: