What is crawling?

Crawling is the term used to describe the process that search engines use to add new and updated pages to their indexes, so that when you do a search using Google or Bing! the results you are shown are the most relevant to your search.

Crawling is an automated process, with a huge set of computers 'crawling' billions of pages on the web. Computer programs determine which sites to crawl, how often, and how many pages to fetch from each site.

Google's crawl process begins with a list of web page URLs, generated from previous crawl processes, and augmented with Sitemap data provided by webmasters.

As 'Googlebot' visits each of these websites it detects links on each page and adds them to its list of pages to crawl. New sites, changes to existing sites, and dead links are noted and used to update the Google index.

It will usually take search engines around 2 weeks to find your new site and include it in their index. If you want to speed up this process, you can manually submit the website address to the search engine and it will usually be included within 3-5 days.

If you have any questions regarding submitting your website to search engines, please email enquiries@enchantedweb.com.au.

Kind regards

Nichole
Enchanted Web
www.enchantedweb.com.au