Site Crawler Sitemap Creator


y u no do it?

Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

Starts at just $1 per CPM or $0.10 per CPC.

Magento 1.9 Separate XML sitemap for categories and products

I am maintaining a Magento 1 store from the SEO perspective and I hope for your help. I have been looking for answers inside the forum and elsewhere. But I have found nothing, what describe clear the process.

Question 1:
In Magento 1.9, how can I have one XML sitemap for products, a second sitemap for categories and one sitemap for the remaining pages, like Company and Service?

Question 2: Currently all products and categories are in one sitemap. Where do I set that “Last-Modified” is not renewed every day for pages that I have not worked on? Currently, the Last Modified date is renewed every day for all products and categories. Which is not true.

I hope you can help me.

Thanks a lot for your help.


How to create sitemap exclude in magento 2?

I need to create a custom module that allows excluding/skipping the Products, Categories and CMS Pages URLs from generating in sitemap.xml. How could I do it in Magento 2?

plugin development – Custom post type not showing in xml sitemap

I create a custom post type in WordPress and it’s working. My issue is when I create my XML sitemap then I am getting my all the pages and post but not getting the custom post type.

Would you help me out with this?

// Register Custom Post Type blog
function create_blog_cpt() {

    $labels = array(
        'name' => _x( 'blogs', 'Post Type General Name', 'bloglist' ),
        'singular_name' => _x( 'blog', 'Post Type Singular Name', 'bloglist' ),
        'menu_name' => _x( 'blogs', 'Admin Menu text', 'bloglist' ),
        'name_admin_bar' => _x( 'blog', 'Add New on Toolbar', 'bloglist' ),
        'archives' => __( 'blog Archives', 'bloglist' ),
        'attributes' => __( 'blog Attributes', 'bloglist' ),
        'parent_item_colon' => __( 'Parent blog:', 'bloglist' ),
        'all_items' => __( 'All blogs', 'bloglist' ),
        'add_new_item' => __( 'Add New blog', 'bloglist' ),
        'add_new' => __( 'Add New', 'bloglist' ),
        'new_item' => __( 'New blog', 'bloglist' ),
        'edit_item' => __( 'Edit blog', 'bloglist' ),
        'update_item' => __( 'Update blog', 'bloglist' ),
        'view_item' => __( 'View blog', 'bloglist' ),
        'view_items' => __( 'View blogs', 'bloglist' ),
        'search_items' => __( 'Search blog', 'bloglist' ),
        'not_found' => __( 'Not found', 'bloglist' ),
        'not_found_in_trash' => __( 'Not found in Trash', 'bloglist' ),
        'featured_image' => __( 'Featured Image', 'bloglist' ),
        'set_featured_image' => __( 'Set featured image', 'bloglist' ),
        'remove_featured_image' => __( 'Remove featured image', 'bloglist' ),
        'use_featured_image' => __( 'Use as featured image', 'bloglist' ),
        'insert_into_item' => __( 'Insert into blog', 'bloglist' ),
        'uploaded_to_this_item' => __( 'Uploaded to this blog', 'bloglist' ),
        'items_list' => __( 'blogs list', 'bloglist' ),
        'items_list_navigation' => __( 'blogs list navigation', 'bloglist' ),
        'filter_items_list' => __( 'Filter blogs list', 'bloglist' ),
    $args = array(
        'label' => __( 'blog', 'bloglist' ),
        'description' => __( '', 'bloglist' ),
        'labels' => $labels,
        'menu_icon' => 'dashicons-admin-comments',
        'supports' => array('title', 'editor', 'thumbnail', 'custom-fields'),
        'taxonomies' => array(),
        'public' => true,
        'show_ui' => true,
        'show_in_menu' => true,
        'menu_position' => 5,
        'show_in_admin_bar' => true,
        'show_in_nav_menus' => true,
        'can_export' => true,
        'has_archive' => true,
        'hierarchical' => false,
        'exclude_from_search' => true,
        'show_in_rest' => true,
        'publicly_queryable' => true,
        'capability_type' => 'post',
    register_post_type( 'blog', $args );

add_action( 'init', 'create_blog_cpt', 0 );

What Is The Best Tool To Create Sitemap?

What is the best tool to create sitemap?

How to create a sitemap for Google to re-index 40,000 fake pages?

How to remove from the Google index pages of my site that were created by a virus Japanese keyword hack&?

It is necessary to remove from the Google index links to the pages of my site that were created by a virus – about 43 800 pages in Google index. The virus and the pages it created were removed from the site. A week ago, changes were made to the sitemap for reindexing. But so far the pages have not been deleted – moreover, new “garbage” pages appear in Google Webmaster. The site has no more than 100 “real” pages in the index. Everything else is non-existent links to garbage pages.

The main question we have now is how to remove this spam information from the Google index?


Sitemap & Robots.txt? Where are they located?

Hey friends,

Where are they located actually?

magento2 – Sitemap and Product URLS to include a specific parent category in URL – Magento 2

I would like to use the “Use Categories Path for Product URLs” feature within Magento 2 however default to it. Not only that but in the case a product belongs to multiple categories be able to set the default path to include a “Master” category.

By default the sitemap seems to generate basic urls like And even when “Use Categories Path for Product URLs” is set to enabled the products are accessible from other urls. I want to achieve as the only route to that product if possible.

Not sure the best route to achieve this weather it be a module that creates redirects based on master categories and generates URLS redirects accordingly and then similarly mods the sitemap generation to include these URLS or if there is an easier route e.g default settings or recommended module?

Sitemap of a Website versus Mobile App

I noticed that sitemap is usually created for a website. Is it also applicable to a Mobile Application?

seo – Use XML Based Sitemap and/or Static Page Sitemap?

I have a question about which sitemap to use – XML based that is sent to Google Search Console or static HTML based sitemap that is added to the website footer.

If you search “dump trucks for sale”, you will find this result in the third position:

Our website uses faceted navigation to filter inventory results, like the Commercial Truck Trader website example I posted regarding a search query.

I see the Commercial Truck Trader website has a sitemap link added to their footer. This is a static HTML based sitemap that can help the user navigate parts of the website.

Do you think the search query “dump trucks for sale” is showing the Commercial Truck Trader website in the third position on a serp from using a static HTML based sitemap that is added to the website footer, or from an XML based sitemap that is sent to Google?