tag:blogger.com,1999:blog-6834107079726189381.post7189423164669210776..comments2023-10-11T09:42:45.509-04:00Comments on DIY Marketing: Testing for Marketing ROIMaryLou Robertshttp://www.blogger.com/profile/05609772860653270135noreply@blogger.comBlogger2125tag:blogger.com,1999:blog-6834107079726189381.post-61124163851222199912008-09-26T13:21:00.000-04:002008-09-26T13:21:00.000-04:00Great post, very informative. Thanks, Mary! We he...Great post, very informative. Thanks, Mary! <BR/><BR/>We here at SiteSpect view Google Website Optimizer as a good tool to get online marketers started in website testing. Because it's free, it’s limited in scope, but that's where companies such as SiteSpect and others can help.<BR/><BR/>You raise an excellent point about statistical significance and sample size. One of the errors we see online marketers make is running tests too long or too short. For those readers new to testing, consider running tests at least two weeks or 2,000 visits. <BR/><BR/>Hope that's helpful and keep up the great work.<BR/><BR/>Jason O’Keefe (www.sitespect.com)Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6834107079726189381.post-44781729970049792292008-09-23T14:53:00.000-04:002008-09-23T14:53:00.000-04:00At Widemile, we're addressing exactly what you're ...At Widemile, we're addressing exactly what you're talking about, reaching statistical significance in testing and making it easy for users to understand. We have a very strong and strict methodology and are building new tools everyday to help our partners and internal teams produce quality tests that create sustainable lifts.<BR/><BR/>I find that the test information provided by Google Website Optimizer to be misleading, and makes users feel comfortable with their data although it often has huge confidence intervals. This is something we want to prevent with our tool.<BR/><BR/>If you'd like to learn more about multivariate and a/b split testing in general, I talk about it exclusively on my blog. You can reach out to me directly from there as well.<BR/><BR/>Best,<BR/>Billy Shih<BR/>Optimization AnalystAnonymousnoreply@blogger.com