Monday, March 22, 2010

Mobile Analytics: vertical-specific vs. traditional Web Analytics solutions

Toyota German mobile site(Updated April 19th 2010: following comments, minor updates have been made regarding links & notes)
Earlier this month, the company I worked for launched its first two European sites dedicated to mobile – the Toyota German mobile site and the new Lexus CT 200h pan-European site.

The Toyota German mobile site was specifically designed for high-end mobile devices such as iPhone and provides information on “hot” topics,  Toyota models (pictures, specifications, colours, prices…), a simple configurator and a retailer locator based on Google Maps services.

The Lexus European mobile site supports the launch of new Lexus C-premium hybrid car, providing pictures and information on the car features plus the possibility to register to the newsletter.

Lexus CT 200h minisite for mobile devices

Enough with the promotion… From my perspective, as a Web Analytics freak, this meant my first steps in mobile analytics! Hurray! (me jumping in the air, full of joice and happiness ;-))

Mobile vs. Web analytics
This is an exciting experience as it is opportunity to expand my expertise and learn new things. It also means new challenges to tackle as measuring mobile sites does not work the same way as measuring Websites. The differences come from the specific aspects of the mobile platforms and devices.

The biggest challenges with mobile analytics are
  • Identifying unique visitors because mobile devices do not support cookie and the changing of IP addresses
  • Collecting client information such as device model, manufacturer, screen resolution and others. Most common ways of collecting data for web analytics relies on the use of Javascript but not all mobile devices support execution of Javascript. Gasp!
  • And finally, retrieving geographic information (if important) can be difficult as well – again not all devices enable geographic detection.
This means that traditional “out-of-the box” Web analytics tagging method will not work (or with limitations). Oh damned! So what can we do?

Well there are other methods to collect data. Phew! We are saved. So what are these alternatives? Basically there a four main solution types:
  • Server log-based: process the raw data coming from you web server (My take is to forget about this one except if you are really a geek and that you have plenty of time to loose! :-))
Mobile analytics: log-server based solution
    • Packet sniffing: a hardware device or software is added between your server and the Web. It listens and analyses requests sent and received by the server. No need of having tags here but additional hardware or software is required (meaning you will need help from your IT best friends!)
    Mobile analytics: packet sniffing based solution
      • Image tag-based: A call to an image is added in the content with appropriate parameters & value in the querystring. Data are sent to a collector server by the client device each time a page is rendered. Parameters can be dynamically set by the server back-end when the content is generated. Easy but it has some limitations (see previously) and can not be used for event tracking.
      Mobile analytics: tag-based solution
        • Server-side script: A script is added on server side that sends data directly to collector server when requests are processed. It doesn’t rely on the device to get the data. Data are extracted from the received requests and set dynamically based on the request/content. This solution is getting more and more used by traditional Web Analytics vendors.

            Web Analytics solution or vertical-specific mobile one? 
            Less than a year ago, the best option would probably have been considering a specific mobile analytics solution such as AdMob(1), Bango, Percent Mobile (2), Amethon to name few of them. But mobile analytics has become almost as hot as social media monitoring and it only took a few months to see most Web Analytics vendors offering technical solutions for mobile site tracking whether this is Google Analytics, WebTrends, NedStat, Omniture, AT Internet… Just check with you nearest local vendor for more info.

            So which one should you choose? Before considering a tool, you must first need to clearly identify what are the business objectives of your mobile site and its strategic importance. This will help you defining what KPI’s, metrics & the required level of details you need (see here if you need a good methodology to define your online KPI's). For example, do you need to go as deep as identifying model of a specific device brand or knowing the platform is enough for you? Keep in mind that it is not the quantity of data you can get that matters, it is what you do with it!

            Think wisely!
            My personal opinion is that mobile specific vendors have lost a big part of the edge they had compared to traditional Web Analytics vendors. If possible, you should try first using your existing Web Analytics solution. Why? Here are some points to consider:
            • Tagging & data consistency: using same platform for both your Web and mobile sites means you can tag & measure content in the same way. If you need to compare web vs. mobile performances, at least you will be comparing apples with apples.
            • Web & Mobile data integration: By having both Web and mobile data on same platform – data can be aggregated and segmented at will. For example, what content is more efficient on mobile? It will give you a global view of your online ecosystem on one platform while being able to isolate each main segment.
            • Leverage existing knowledge & expertise: why learning a new tool when you can leverage years of expertise you already have? It can be fun of course to learn new tools but do you have the time? Can you or your business stakeholders afford the risk?
            • Reusability: If your mobile site is an extension of your website (or very similar), you may reuse existing tagging guidelines, mechanisms but also reports and indicators. No need to reinvent the wheel! In my case, for our mobile site, 80% of reports are existing ones (from main site) and 20% are mobile specific ones
            • Costs: If you go for another solution there may be additional costs involved either for the software/hardware or for the technical expertise and implementation.
            Of course, you must make sure that your most important needs are covered and if there are limitations, these are acceptable in your business context.

            Use a Kaizen approach
            If Mobile analytics is new to you (as it is for me), I also recommend a Kaizen approachstart small & simple, use first the tools and expertise that you have. It is a learning process. It is better to take the easy way and improve & develop your mobile analytics capabilities step by step rather than a big leap with the risk to make it more complex and more risky than necessary.

            If you find out it is not enough or too limited – think how you can enhance it easily. For example, you can use a image tag-based implementation using your existing Web Analytics tool and complement it with a free mobile specific solution to get missing information such as used devices & handsets, screen resolution…

            When you reach the limits of your framework then it will be time to consider moving to something else – plenty of choice there – by that time you should have gained enough experience and expertise to make the right choice and justify any additional investments in time, resources and money. Well, that’s what I think. Future will tell if I am right.

            So what do you think? Does it make sense? What are your thoughts on the different methods & solutions? Any other key aspects you would consider before making a choice? Any experience with mobile analytics you are willing to share? I would be curious to know.


            Related articles:
            (1) Note that in November 2009, Google acquired AdMob (more info here) but the deal is under investigation (maybe seen as "anti-competitive").
            (2) Former TigTags analytics solution has been "absorbed" by Percent Mobile.

            10 comments:

            1. Thanks for your article, it's very interesting. I have asked some webanalytics company to explain the difference between tracking a website and a mobile site and they were not able to tell...I'm not sure their employees are all used to tracking mobile content.

              ReplyDelete
            2. @Cookbook: I am really surprised by your comment. not really good for their image nor really pro (whoever they are). Some employees may be need to get updated - you can still direct them here :-)

              Michael

              ReplyDelete
            3. Remco van der BeekMarch 31, 2010 at 2:36 PM

              Hi Michael,

              From what I see around me in Belgium is that mobile analytics data today are an eye opener for site owners to see that their site is actually getting visited by mobile visitors in rapidly growing numbers. And that more and more site owners being to realise the need for a mobile site, especially media sites.

              As a former Nedstat employee I'd like to add that their product indeed is pretty powerful when it comes to mobile analytics. If you're building a mobile site you should certainly take a look at it.

              Kind regards,

              ReplyDelete
            4. Hi Remco,

              Eric T. Peterson did a white paper together with Nedstat on Mobile Analytics. I think that Web Analytics vendors are now, for most of them, providing reliable and powerful solution for mobile site measurement. Much better than a year ago.

              Regarding the "rise" of mobile internet, I think it is important to keep things in perspective. Yes, it is a platform that will rapidly grow (and probably already started) but honestly, most figures I got either from where I work or from other resources, shows that in a majority of cases, mobile traffic share remain very low (see example from Semetis in Belgium: overall mobile traffic share account for 0.45% in average). But it doesn't mean that you shouldn't consider mobile platform. It is time to get prepared to be there when it will "explode" (it will and probably sooner than most think). Some industries like News sites (as you mentioned) will evolve faster than others.

              Also it is a good way to reach a very specific audience segment - depending on your business area, it may be a very valuable one. First thing to do is to assess: does it worth it? What is the value for my business? And if you go for mobile, measure your business performances is vital, hence the need of a good and reliable mobile analytics implementation.

              Cheers,

              Michael

              ReplyDelete
            5. AT Internet InstituteApril 8, 2010 at 12:01 PM

              To complete your discussion about News websites and mobile traffic :

              AT Internet Institute (www.atinternet-institute.com) published a survey based on the analysis of the traffic of a cross-section of six big French news websites audited by AT Internet solutions.
              These websites provides content through both traditional website and an iPhone application.

              From 19 to 25 October 2009, more than 10% of visits to news websites come from their iPhone application, on average per website.

              As you said, News websites are among the industry where mobile sites are more and more presents. So, they can’t ignore this fact without risking to deprive themselves of traffic…

              You can read the survey in french on this link : http://www.atinternet-institute.com/fr-fr/comportement-internaute/mobiles-octobre-2009/index-1-1-2-182.html

              Sylvie Guéras

              ReplyDelete
            6. Hi Sylvie,

              Thank you very much for your very interesting contribution and links (I just shared this internally at work :-)).

              10% of traffic share is - in my opinion - very high and not something one can ignore (in the News industry at least).

              Cheers,

              Michael

              ReplyDelete
            7. Interesting article Michael, you touch on many important points and make some good suggestions.

              However I feel that your approach is very traditional and misses many of the complexities that mobile introduces. These are the same aspects that most of the traditional web analytics vendors also miss amd the reason why they are still lagging behind true mobile analytics solutions. I would recommend reading http://bango.com/bangowp for some further background on key complexities of mobile.

              In addition, don't think that mobile is just like the PC web but with a smaller screen. Mobile offers much improved measurement capabilities since each phone has an identity. If you know what you are doing and have the right relationships this gives a degree of accuracy that far exceeds traditional techniques.

              The main achievement that traditional analytics vendors have made in the last year is to no longer break websites visited by phones.

              Don't take my word for it, or anyone elses and certainly don't believe the marketing from the traditional vendors - go test a couple of mobile solutions alongside your traditional solution and see for yourself. You can grab a free trial of Bango Analytics from http://bango.com/analytics.

              Andy.

              P.S. regarding your notes - Mobilytics is no longer available and Google has not yet purchased AdMob as the deal is being investigated as anti-competitive.

              ReplyDelete
            8. Andy,

              First apologies for the late reply. And thank you very much for your very interesting contribution, sharing your view from the vertical-specific side.

              Yes agree that mobile analytics has many specific aspects (and probably also complex ones) compared to Web analytics. Vertical-specific solutions of course offer "niche" functionalities that WA vendors don't have.

              Now, as I mentioned in my post, one must first "need to clearly identify what are the business objectives of your mobile site and its strategic importance. This will help you defining what KPI’s, metrics & the required level of details you need." This will help identifying the sophistication level that is required. My approach is certainly "traditional" but it may fit for many businesses where mobile isn't their core business/source of revenue.

              My main point is to not discard automatically traditional WA solutions when it comes to mobile but evaluate both worlds and consider pro's and con's from each side.

              And thanks for the few clarifications - I have amended links & notes accordingly.

              Cheers,

              Michael

              ReplyDelete
            9. Hello,

              To analyse mobile or not. I would like to refer to Michael’s and Andy’s discussion

              I agree with Michael that mobile analytics is not necessary for all companies, but I believe that if you have mobile traffic or are planning a mobile site it is worth being analysed properly. Mobile internet today may be smaller than desktop internet, but take a look into the near future. According to a research from Morgan Stanley’s “Internet Trends” report (http://www.morganstanley.com/institutional/techresearch/pdfs/Internet_Trends_041210.pdf) mobile internet will surpass desktop internet within the next five years.

              I believe in a proactive business operations and believe that companies should prepare for the future. Whether or not a company’s mobile traffic is significant today, it would be best to know the tools, solutions, opportunities and benefits which a company could receive from the mobile analytics. As Andy mentioned before there are companies which offer free trials also QAim offers one (http://www.cem4mobile.com/). Give them a try and let us know what you think.

              Best Regards,

              Jeremy

              ReplyDelete
            10. Thanks for the comment and also for the very interesting link. I recently saw similar figures predicting that mobile will surpass desktop internet. And no doubt on that.

              Yes - companies should be prepared for the future and having a good knowledge is crucial as many alternatives exist with different levels of sophistication. It is important not to choose the most sophisticated solution but one that fit your needs - either on short-term or mid-term (who can say what will be long-term? ;-)).

              ReplyDelete

            Feedback Form