Web Traffic 101

You’ve had a website for your business for years now. Perhaps you hired a high end design agency to create an online brochure that rivals a work of art. Perhaps you partnered with a local shop to build you a set of Internet tools to help your business run more smoothly. Perhaps you even hired a local freelancer to work under your in-house marketing department.

You’ve probably already thought seriously about web traffic: how to increase website traffic, how to get more targeted web traffic, how to learn more about your customers and potential customers by doing a website traffic analysis, how to get more of your visitors to become buyers or clients.

Over the next several sections, we discuss in detail the many aspects of measuring, increasing, and focusing your web traffic: analyzing your existing traffic, identifying your best visitors, converting them to customers.

At the bottom of each section are links which you can follow to dig deeper into a concept. Use the site search engine in the upper right hand corner of every page to search for the answer to that specific question that has been bugging you.

If you can’t find the answer to your specific question, use our contact form to send it to us. We maintain an extensive Internet Marketing FAQ, and we would love to add your question to our list.

Site Visitors, A Misnomer

When most people think of site visitors, they think of people – people seeking information, people filling out forms, people shopping, hopefully buying, people returning to buy more.

Though most think of individual people when they think of site visitors, technically speaking, websites are not actually visited, even in an electronic form. In a sense, there is no such thing as a site visitor. Instead of saying a person visits a site, it is correct to say that a person’s user agent requests files which are retrieved from a website and rendered at the person’s personal computer, thus creating the website traffic. The traffic is your site being sent to the person’s computer after being invited by a user agent.

In a sense, your website is the visitor. Your website visits the people you have been thinking of as visitors.

User Agents, Not Site Visitors

User agents are basically different types of software that request files from your web server. A road is likely to be used by an automobile driven by a person on his or her way to work, by a cyclist out for exercise, by a person walking across the street, by a semi truck hauling goods, and even by the occassional opposum or deer crossing the street. Just like roads get used by lots of things for many different reasons, your website gets used by lots of things for many different reasons. The most common user agents requesting your website are web browsersoperated by a person, but your site is most likely used by other agents, such as crawlers, robots or spiders.

The World Wide Web Consortium states that “User agents include HTML browsers and other types of software that retrieve and render Web content.” They further state that a user agent is “Any software that retrieves and renders Web content for users. This may include Web browsers, media players, plug-ins, and other programs — including assistive technologies — that help in retrieving and rendering Web content.”

– from W3C: User Agent Accessibility Guidelines 1.0.

Crawlers, Robots, or Spiders

Many terms are used to label the software programs used to index websites. Most refer to them as web crawlers, web robots, webbots, or spiders. Web crawlers, robots, and spiders are used by many companies to retrieve information about your website. They are often automated and are programmed to simply follow hyperlinks throughout the web. Search engines are the most well known users of spiders, but others use them as well. All in all, crawlers, robots and spiders make up a significant number of the “website visitors” for a well established site.

The Google robot, known as Googlebot, will visit a well established site several times a day to check for updates. Of all the spiders who traverse the sites for which we have web log access, Googlebot is by far the most active, on average around twice as active as the Yahoo! crawler and six times more active than the new msnbot spider. On their website, Google refers to Googlebot as “Google’s web crawler” and as “Google’s web-crawling robot.”

Another common web crawler is the ia_archiver, which crawls sites in order to create and maintain a complete historical backup copy of the web, located at Archive.org, and also is used to provide screenshot thumbnail images for Alexa.com, which uses the Google search engine.

Crawlers, robots, or spiders are also used by companies which offer link checking or link validation services, and by companies which harvest company contact information or email addresses for sale.

More Information on Crawlers, Robots, or Spiders


The Web Robots Pages

Yahoo! Directory > Computers and Internet > Internet > World Wide Web > Searching the Web > Crawlers, Robots, and Spiders

Search Engine IP Addresses
Lists IP addresses of search engine spiders. Can be searched by IP address. Also links to resources on spiders.

Increase Traffic to Your Website

When we talk about increasing website traffic, we’re really talking about several different things, including increasing hits, increasing pageviews, increasing sessions, and increasing unique visitors. For some sites, increasing pageviews will be the immediate goal because the concern is that the vast majority of visitors view only one page of the site, then leave. For others the immediate goal will be to increase the number of unique and return visitors.

Because there are multiple metrics available to webmasters when reporting traffic, a great deal of confusion surrounds the whole affair. Many webmasters refer to website hits when they report their traffic. While many people have asked about increasing hits, website hits are not a very good measure of the success of a site.

First, let’s take a hypothetical tour of the process of measuring website traffic. Imagine Hypothetical Jim visiting the home page of a new website he learned about on Google.com. Hypothetical Jim visits the home page, then visits the “About Us” page, which he bookmarks. Later, Hypothetical Stu visits the home page, then leaves the site. Later that evening, Hypothetical Jim returns to the “About Us” page using his bookmark, and clicks on the link to the “Contact Us” page. After looking over the page, he leaves the site.

From the text description above, you can determine that: (1) the site has had 2 unique visitors, Hypothetical Jim and Hypothetical Stu; (2) the site has had three unique visitor sessions (two for Jim and one for Stu); and (3) the site has had 5 pageviews (4 by Jim and 1 by Stu). You may wonder wether to count Hypothetical Jim’s second visit to the “About Us” page as a second pageview. Count it.

What you cannot determine from the description above is the number of website hits. A hit is measured every time a specific unique file (HTML files, image files, script files, frames, etc.) is downloaded. In other words, many people refer to the total number of HTTP Requests a user makes as the number of hits the site receives. Since a single web page can be made up of any number of unique files (hundreds even), measuring hits is often meaningless in measuring the success of a website.

In this hypothetical example, the homepage consists of 24 files, so web analysis software will count 24 hits every time a visitor downloads the home page. There are 21 total images, 1 script, and one CSS file (plus the index html file itself). The “About Us” page consists of 14 files, so web analysis software will count 14 hits. There are 11 images, 1 script, and one CSS file (plus the about html file itself). The same goes for the “Contact Us” page.

As you can see, website hits do not consistently correlate with unique visitors, sessions, or pageviews. The only reason to look at hits is to measure the number of HTTP requests that a browser has to make in order to view your page. Generally speaking, the larger the hit count, the slower the download. For that reason, it is best to reduce the number of hits/page until the download speed is optimized.

Savvy media buyers ignore webmasters who claim to have thousands of hits. They measure pageviews, user sessions, and unique and return visitors.

Visit our Free Webmaster Tools page to get our Free Website Hit Counter.

Increase Site Visitors

A-Z Tips to Increase Site Visitors

We said A-Z and we meant it. Here are 26 sure-fire ways to increase web traffic and site visitors to your website. Use some or all of them, and let us know which ones worked best for you.

  1. Optimize your site (SEO).
    Win on the search engines when people search for keyword phrases related to your products or services.
    (More about search engine optimization.)
  2. Get your site listed in directories.
    Submit your site to all the major web directories. This will generate traffic directly from the directories themselves and will also help to improve your link popularity. That helps you win on Google!
  3. Get listed in search engines.
    Submit your site to all the major search engines.
  4. Get links to your site.
    Get people with complimentary sites to link to yours. You offer rental kayaks on the beach. Ask the local restaurant owners to link to you, and offer to link to them. Ask the local tour guides, the real estate agents, the night clubs, and everyone else. Links lead to clicks onto your website and help to improve your search engine rankings.
  5. Buy ads linking to your site.
    Buy sponsored links on other websites. That means more people visiting your site, and many sites offer a pay for performance model.
  6. Buy banner ads.
    Buy banner ads on other websites. It helps to build brand recognition.
  7. Participate in a banner exchange program.
    It won’t cost you anything, and will lead to a few extra visitors. Plus, you’re spreading your brand all over the place.
  8. Participate in a WebRing.
    Connect your site with other sites in your niche.
  9. Pay for clicks to your site.
    Pay for clicks or inclusion on the search engines so that people will see your site in the sponsored links section of the search results when they search for keyword phrases related to your products or services.
  10. Set up an affiliate marketing program.
    With affiliate marketing, you can either pay per click, pay per lead generated, pay per sale, or pay per customer acquired.
  11. Use smart public relations (PR).
    Get news coverage of your business and your site. Approach online and traditional media. This will often lead to others placing links pointing to your website, which leads to more clicks and also to improved search engine rankings.
  12. Use E-mail marketing.
    Ugly, but effective for the cost. Blast out your special offers, but be nice about it.
  13. Use off-line marketing.
    Promote your site. Put your url on all your license plates. Paint it on your car. Buy newspaper and yellow pages ads with your url. Put up flyers and stickers. Sponsor a little league team. Do anything and everything to spread the word about your website around your city.
  14. Run regular promotions.
    Stage regular giveaways and spread the word about it.
  15. Get published.
    Write articles for publication on other websites. The author profile will link to your site. The article will show that you’re an expert.
  16. Publish yourself.
    Write articles for your own site regularly. This will help you to win on the search engines and gives your visitors a reason to come back over and over.
  17. Ask for reviews.
    Ask for reviews of your self-published articles on other webmasters’ websites. Ask for reviews of your website, your products, your software, your services. These will usually include links to your articles.
  18. Write briefs.
    Write daily or weekly news briefs focusing in on your industry or specialty area. This keeps your site “fresh” in the eyes of the major search engines and helps you to spread a wide net when fishing for top search engine positions.
  19. Create a newsletter.
    Ask your visitors to sign up for your newsletter, and encourage them to send it along to people they know. Send a newsletter regularly with teasers or lead-ins to your in-depth new articles or with special offers and the latest products.
  20. Post in chat rooms.
    Become active in bulletin boards and chat rooms focusing on your industry. Leave insightful comments, and people will click on your profile, then visit your site.
  21. Give away free stuff.
    Offer something people want at your site. Give them a reason to come back and get more. Offer free downloads and update them regularly. Offer coupons or discounts. Content content content.
  22. Give awards for excellent sites in your niche.
    This builds more links back to your site and establishes you as a credible reviewer, an expert in your space.
  23. Run a contest and promote it.
    Photo contests, essay contests, goofy contests, random drawings, anything. Example: Messiest Garage in America contest on OfftheFloor.com.
  24. Join your local business organizations.
    Chambers of Commerce and other organizations will often add your site to their member directory. That’s an added advantage over the obvious business-building and networking opportunities.
  25. Create an RSS feed.
    Give people another way to interact with your content.
  26. Be accessible.
    Build your site so that it is accessible to all browsers and to PocketPC and Palm Pilot users. Don’t forget, people with disabilities buy things too. Make your site Section 508 compliant. Your competition probably hasn’t.

We really couldn’t stop at Z. This last suggestion is our most important one:

Be a good Internet citizen.
Provide useful resources on your website, resources that make people feel thankful that you put in the time and effort. Help every person who ever calls you on the telephone or emails you a question. When they ask “How can I ever thank you?” just say, “If you like my site and think it’s useful, why not link to it?”