JL Forums

working of google spiders

0 Members and 1 Guest are viewing this topic.

working of google spiders
« on: January 06, 2018, 12:53:50 AM »
HI every one:
can any one help me to understand the working of spiders? Are crawlers and spiders are same thing?

Re: working of google spiders
« Reply #1 on: January 06, 2018, 10:17:16 AM »

Yes, spiders, crawlers and bots are basically the same thing. In short they are programs that fetch the content of webpages and try to extract data about the content and about outgoing links. This data is then added to the bot/spider/crawler's owner's index and used e.g. for search results. Where do the funny names come from? I dunno... it's basically just a piece of software...


Re: working of google spiders
« Reply #2 on: January 08, 2018, 12:31:46 AM »
Main crawlers of google and other search engine are same or different?