How to Create robots.txt file for SEO

Category: Articles    |    1,284 views    |    Add a Comment  |   

It has been a half month since ThemeLib.com was created, not a long time, huh ?. Today, I decided to test how is my site in two popular Search Engines : Google and Yahoo.

Here is the result :

  • Google: get 48 results returned with keywords http://csshook.com
  • Yahoo: get 35 results returned with keywords http://csshook.com

All of the results in Google is fine. They indexed my posts, my tags, my keywords, … But there are some problems with my site in Yahoo. Yahoo indexed my wp-login page and download links !!! How did it happen, huh ? If you have knowledge on SEO (Search Engine Optimization), these results are not good, really. After examining ThemeLib.com a few minutes, I realized that I have not created a Robots.txt file yet !!! Oh man, how can I forget it? 

Introduction

The robots.txt file is used to instruct search engine robots about what pages on your website should be crawled and consequently indexed. Most websites have files and folders that are not relevant for search engines (like images, download links, admin files, …) therefore creating a robots.txt file can actually improve your website indexation. Read more…

 

How to Get Google to Index Your webSite too Fast

Category: Articles    |    745 views    |    Add a Comment  |   

 

How to get Google to index your site fast.

To understand how to get indexed, we need to examine how google actually indexes sites. Let’s pretend you have a brand new site. You have built some content and you are now waiting and wondering when Google is going to notice you. Google spiders crawl through the internet looking for new things all the time. Typically, they discover sites via links that are pointing out to someone else’s site.

 

  • In other words, let’s say that you are Site A. You have no links from any other sites.
  • You happen to go to a popular forum and point a link to your site in your signature.
  • Google crawls this site. This is what happens. Going from the top left of the forum, they will start to gather words and move on down. Each time they reach a link, they place this “in queue” to visit once they are finished crawling the page.
  • They find your site link and will eventually follow it to your site, and crawl your page looking for more links to follow.
  • And so on and so forth.

 

Some pages get crawled more often. This depends largely on how active the site it. In some cases, a site is crawled every minute because the site is constantly changing.. Alternatively, some sites are crawled once a month because the site doesn’t update very often. Read more…

 

Importance of Anchor Text in SEO

Category: Articles    |    572 views    |    Add a Comment  |   

 

When building links for the purpose of SEO, the single most important part of any link is the actual text that makes up the link, this text is called the Anchor Text.

Have a look at the following two examples:

To visit John Bloggs Watches website click here

To visit John Bloggs Watches website click > Diamond Watches

The last two words of the above sentences would be the text that is hyperlinked to a specific web page, and that text is called the Anchor Text.

What you must do in all of your links, external incoming links or internal links, is use your keywords in your Anchor Text. This is very important.

If the Anchor Text is made up from your Keywords that link will carry a lot more weight in the eyes of Google.

So, without doubt getting the words that are used to link to your website to be your keywords, is the single most important aspect of your SEO. Read more…