How Google Crawls and Indexes Web Pages

How your site ranks depends on how Google crawls and indexes your website. If you've never worried about the Google crawling and how it indexes your website, better late than never, you should get an idea of what this Google Crawling and Google indexing is all about.
Herein I provide you with some knowledge on what Google Crawling is, What Google Indexing is all about and what might be the reasons behind your website not being crawled or indexed by Google.
First let me tell you a few words or terms that you should know before moving further.

Google's Index:
Google's index is the list of all pages that Google has crawled and indexed so far. When someone searches for something on Google, the resulting information (in the form of pages) is pulled from Google's index. Around 40+ billion web pages are indexed by Google.

Fun Fact: "The Invisible Web" is something that has not escaped from Google, which is 90% of the entire web, making a count of 450 billion web pages.

Crawling:
Crawling is the process by which Google uses its programs called "SPIDERS" to index your site.

• these spiders are created with the idea to browse the webpages like humans (the final consumers/ users)
• they move from page to page and from link to link of the entire site
• they try to find and index each and every page on the web

Crawls can happen several times a day or once in 6 months.

TIP: make sure to regularly update your content such that Google's spiders crawls your webpage more often.

7 most common reasons behind your website not being crawled by Google Spiders:

1. Incorrectly configured robots.txt file, which is used to block parts of the website from being accessed by Google's spiders.
The worst robots.txt file is that which resulted a website with just a single page being crawled and indexed while blocking all the other pages.
2.A badly configured configured .htaccess file, which is used to redirect URLs from one domain to another domain. If not optimized well, will results in loss of huge organic traffic, during redirection.
3. Incorrectly written meta tags, title and author tags.
4. Configuring URL parameters incorrectly in Google Webmaster Tools.
URL parameters can be configured in GWT so as to let Google know what dynamic URLs you don't want Google to index.
5. Low Page Rank - Page Rank is roughly proportionate to the number of pages Google crawls, as per Matt Cutts.
6. Any DNS or connectivity issues may cause Google's spiders from reaching your servers. So make sure maintaining high quality servers and hosting.
7. Domains used for a big link-spam farm or private link network or any other penalization worth schemes causes de-indexation from Google.

Ways to improve Google crawling and increase number of indexed pages:

• Regularly check and fix any crawl errors that appear in Google Webmaster tools.
• Make sure that AJAX application with content is crawlable and indexable.
• Make sure to carefully add a proper and well optimized robots.txt file
• Add sitemap  to the website.

ref: http://www.quicksprout.com/

Amazon Seller Central Supportive and Useful Websites, Tools and Softwares

Amazon, the giant marketplace on which 1000s of sellers sell products is a big puzzle which yields good results when implemented in a knowledged way. The tools, softwares or websites listed here in this post are helpful to sellers to gain knowledge on various metrics, product listings,....

http://www.profitspotlight.com/ - Gives the list of top products based on category chosen

http://www.fbatoolkit.com/ - Has 3 features

http://www.junglescout.com/  - Amazon Product Research made easy with this site, gives estimated sales for each category, given sales rank.

Unicorn Smasher - Chrome extension that gives complete analysis of search results in Amazon.com
Amazon seller browser - Chrome extension to get the sales rank, performance over a period of time for all search results in Amazon.com

1. Estimates sales per day with the sales rank given as input
2. Price list analysis, generating information that simplifies your purchase decisions (current offers, estimated sales rate, profit)
3. Product tracking, tracks the price, stock and sales from all the relevant merchants for any given product

https://amzshark.com/ - Provides sales data for every product on Amazon.com. Limited time free access.

A list of sites useful while researching on Amazon:
https://www.amazing.com/
http://www.supersellersuite.com/
https://www.amztracker.com/
https://www.merchantwords.com
http://www.junglescout.com/
http://www.feedbackgenius.com/
http://www.feedbackfive.com/
https://www.reviewkick.com/
https://www.salesbacker.com/
http://thebestspinner.com/
https://members.junglescout.com/
https://keepa.com/
http://camelcamelcamel.com/
http://amzrc.com/
http://www.unicornsmasher.com/
amazontools

MarketShare of various CMS Platforms

Impotant Facebook Apps for Improved Social Marketing Results

With 1 in every 7 people on earth on Facebook, it has evolved as a big stage for marketing and reaching a large group of targeted people. In order to get more from the available advantage of marketing on Facebook in the form of subscribers and capture lead data you need to integrate with some apps. Here I provide list of Facebook apps together with their purpose.

ContactMe: Include a contact form and let your users contact you without actually logging out of Facebook and navigate to your website.

FanAppz: Turn fans to loyal customers. Create promotions easily that require fans like your page and grow your community.

Scope of Digital Marketing

Internet is growing day-by-day and the number of users is also growing exponentially. At this juncture, website forms the mediator between a company and its target audience. Digital marketing is the only way that gives popularity and brand awareness of a particular website or company or brand and takes it to the target customers. Please find attached the document with the SEO and SMO activities. 

Scope of SEO and SMO:

SEO gets organic and long lasting traffic to a website. SMO builds brand popularity and forms a medium to target a large customer base. SEO and SMO both forms the organic way and will get results slowly but lasts forever.

Scope of SEM and SMM:

SEM and SMM are the paid ways to sell services or products to a target group of audience. If the point is to get immediate conversions then SEM and SMM are the chosen ways. With SEM and SMM you can see immediate results. In the case of SEM and SMM continuous monitoring of the campaigns is suggested and keywords in the campaigns should be chosen manually. If proper monitoring isn't done then money will be spent as water.

Strategies for Online Retailers

Started a new eCommerce store and are worried about how to get traffic and conversions. Include these few tips and tricks shared in the infographic design into your eCommerce activity and get awesome results for sure.

Strategies for Online Retailers

Best Sites for a Photoshop practitioner

Its not always comfortable to design an image, banner, infographic or anything else from the scratch. So here comes a few sites from where a designer can download directly PSDs and can edit them to suit there feasibility.

https://www.behance.net/

http://www.deviantart.com/

https://dribbble.com/

http://www.ui.cn/

http://www.zcool.com.cn/

http://www.lanrentuku.com/
http://www.istockphoto.com
http://freedesignfile.com/


Websites that facilitate with various fonts are listed here for your comfort.
http://www.fontsquirrel.com/
http://www.dafont.com/

Content, Conversions and Lead Generation Webinar

Content, Conversions and Lead Generation Webinar (presented by Andy Crestodina of Orbit Media). Seems Helpful..

Best Presentation Editors

Hi guys,

Are you not good in Photoshop or paint then this stuff I'm about to share is for you. These are the online sites wherein using which you can create awesome presentations. Just google some images that suits your requirement to insert in the presentation. Just include the text.
You can create the presentations using these top presentation sites, at a time less than what you usually spent in creating a presentation.

prezi
zoho show (zoho.com)
show.zohoo.com
slide rocket
presentation engine
google docs (google: more than search, screencests by john R. Sowesh)
empressr
zcubes
openoffice impress
glogster.com
animito.com
presentationzen.com
ted.com
techcrunch.com

Google Search Syntax Queries

Below is a list of all the Google syntax queries you can use to find exactly what you want:

Search Google Syntax Queries

Web Search: allinanchor, allintext, allintitle, allinurl, cache, define, filetype, id, inanchor, info,intext, intitle, inurl, link, phonebook, related, site

Image Search: allintitle, allinurl, filetype, inurl, intitle, site

Groups: allintext, allintitle, author, group, insubject, intext, intitle

Directory: allintext, allintitle, allinurl, ext, filetype, intext, intitle, inurl

News: allintext, allintitle, allinurl, intext, intitle, inurl, location, source

Product Search: allintext, allintitle

allinanchor:

If you start your query with allinanchor: Google restricts results to pages containing all query terms you specify in the anchor text on links to the page. For example, [allinanchor: best internet marketing] will return only pages in which the anchor text on links to the pages contain the words “best,” “internet,” and “marketing.”

allintext:

If you start your query with allintext: Google restricts results to those containing all the query terms you specify in the text of the page. For example, [allintext: seo services ] will return only pages in which the words “seo” and “services” appear in the text of the page.

allintitle:

If you start your query with allintitle: Google restricts results to those containing all the query terms you specify in the title. For example, [allintitle: internet marketing] will return only documents that contain the words “internet” and “marketing” in the title.

allinurl:

If you start your query with allinurl: Google restricts results to those containing all the query terms you specify in the URL. For example, [allinurl: google faq] will return only documents that contain the words “google” and “faq” in the URL, such as “www.google.com/help/faq.html”.

author:

If you include author: in your query, Google will restrict your Google Groups results to include newsgroup articles by the author you specify. The author can be a full or partial name or email address. For example, [ seo author:john author:doe ] or [ seo author:doe@someaddress.com ] return articles that contain the word “seo” written by John Doe or doe@someaddress.com.

cache:

The query cache:url will display Google’s cached version of a web page, instead of the current version of the page. For example, [ cache:www.espn.com] will show Google’s cached version of the ESPN home page.

define:

If you start your query with define: Google shows definitions from pages on the web for the term that follows. This advanced search operator is useful for finding definitions of words, phrases, and acronyms. For example, [ define: seo ] will show definitions for “SEO”.

ext:

This is an undocumented alias for filetype:

filetype:

If you include filetype:suffix in your query, Google will restrict the results to pages whose names end in suffix. For example, [ seo evaluation filetype:pdf ] will return Adobe Acrobat pdf files that match the terms “seo” and “evaluation.”

link:

The query link:URL shows pages that link back to that URL. For example, to find pages that point to ESPN’s home page, enter:[ link:www.espn.com ]

location:

If you include location: in your query on Google News, only articles from the location you specify will be returned. For example, [seo location:india ] will show articles that match the term “seo” from sites in India. Many other country names work; try them and see.

movie:

If you include movie: in your query, Google will find movie-related information.

phonebook:

If you start your query with phonebook: Google shows all public U.S. residence telephone listings (name, address, phone number) for the person you specify.

related:

The query related:URL will list web pages that are similar to the web page you specify. For instance, [related:www.consumerreports.org ] will list web pages that are similar to the Consumer Reports home page.

site:

If you include site: in your query, Google will restrict your search results to the site or domain you specify. The site: command is very helpful as an alternative to the mediocre search engines built into many sites.

source:

If you include source: in your query, Google News will restrict your search to articles from the news source with the ID you specify. For example, [ election source:new_york_times ] will return articles with the word “election” that appear in the New York Times.

weather:

If you enter a query with the word weather and a city or location name, if Google recognizes the location, the forecast will appear at the top of the results page. Otherwise, your results will usually include links to sites with the weather conditions and forecast for that location.

Daterange:
Daterange: (start date–end date).
This syntax used in google search box will throw you results indexed in the specified date range only.
. Daterange: is actually more useful if you go elsewhere to take advantage of it, because daterange: requires Julian dates, not standard Gregorian dates. An easier way of doing a Google daterange: search is by filling in a form at www.researchbuzz.com/toolbox/goofresh.shtml or www.faganfinder.com/engines/google.shtml.