New 80app: Link Mapper - Generate Sitemaps for any Website
We've just release a new 80app called Link Mapper. Link Mapper can be used to automatically generate sitemaps for any website.
Link Mapper is available with Plus or Premium plans. To use it, we recommend the following 80legs job settings:
- Seed list: the domain for which you want to generate a sitemap
- Outgoing links to crawl: restrict the crawl to only the domain(s) in your seed list
- Analysis to run: select the Link Mapper 80app
When the crawl is complete, you'll get output that looks something like this for each URL:
http://www.80legs.com parent link: null outgoing links: http://www.80legs.com/_css/styles.css http://www.80legs.com/index.html http://www.80legs.com/_images/logo.gif https://portal.80legs.com/portal https://portal.80legs.com/portal/register http://www.80legs.com/docs.html http://www.80legs.com/contact.html http://www.80legs.com/tour.html http://www.80legs.com/plans.html http://www.80legs.com/who-uses-80legs.html http://www.80legs.com/services.html http://www.80legs.com/about-us.html http://blog.80legs.com http://vimeo.com/moogaloop.swf?clip_id=11065804&server=vimeo.com&show_title=0&show_byline=0&show_portrait=0&color=&fullscreen=0&autoplay=1 http://www.80legs.com/_images/front_page_custom_crawling.gif http://www.80legs.com/_images/front_page_crawl_package.gif http://www.80legs.com/_images/front_page_support.gif http://www.80legs.com/_images/front_page_view_all_pricing.gif http://blog.80legs.com/2010/08/10/case-study-monotype-imaging http://blog.80legs.com/2010/08/05/crawling-and-the-programmable-web http://blog.80legs.com/2010/04/20/crawl-packages-aggregate-website-data-in-a-few-clicks http://www.80legs.com/_images/front_page_see_whos_using.gif http://www.leadforce1.com http://www.leadforce1.com/bf/bf.js http://olark.com/about
This data can then be used to generate a sitemap :)
