Testing For Dollars – How You Can Use Simple A/B Split Tests To Give Yourself a BIG Pay Raise!
The following video lesson shows you how and what to use to run your own profitable split tests on your own websites.
It covers what tools to use… which elements to test… gives you specific test results from my sites… and much, much more.
This is a must view video set!
Software and hosting used in my testing:
- http://www.Split-Analyzer.com – Split Testing software
- http://www.ebookfire.com/gator.html – Hosting
By the way, if you’re having trouble seeing the whole video in your browser, hit the F11 Key to maximize your window (then hit F11 again to put your browser window back to normal)
Video #1 – A/B Split Testing
Click Here To Watch Video
Time: 5:21
- What is A/B split Testing?
- What to test and why…
- The whole point of testing in the first place
- HUGE profit effects of TINY changes in conversion
- Effects of price & conversion on profitability
Video #2 – 7 Day eBook Test Results
Click Here To Watch Video
Time: 7:58
- http://www.Split-Analyzer.com software
- The software I’m using on my websites to track sales
- Test with and without ebook graphic
- Test with and without header graphic
- Test with and without "Order Now" link at the top
- Differences in conversion
Video #3 – "Turn Words Into Traffic" Test Results
Click Here To Watch Video
Time: 2:40
- Testing with and without header graphic
- What I’ll test next (changing headline color)
- What I need to add to the site
Video #4 – "Turn Words Into Traffic" Headline Test
Click Here To Watch Video
Time: 5:43
- Setting up a "control"
- Split testing headline
- Setting up a test in http://www.Split-Analyzer.com software
- Setting up the index.html page to do the split on your website
- Setting up the tracking tag code to generate sales info
- Testing to make sure it works
Video #5 – New Test on 7dayebook.com
Click Here To Watch Video
Time: 4:14
- Testing background color on 7 Day ebook website
- Creating the two version to test
- Setting up the test in the software
Video #6 – Split-Analyzer.com New Site Setup Overview
Click Here To Watch Video
Time 4:06
- Setting up the software on a new site
- Uploading the files
- Entering in the test files
Video #7 – A / B / C (3-way) Split Test on www.FSBOHelp.com
Click Here To Watch Video
Time: 4:08
- 3 way test
- "Control" headline
- "Conspiracy" Headline
- Move main headline up to "sub" headline and test new headline
- *** Upload the HTACCESS file to your hosting account
Video #8 – Conclusions about our testing results
Click Here To Watch Video
Time: 5:28
- What you SHOULD take a away from these tests
- "Myth busting" about certain things people take for granted
- How each website needs its own testing to get you the most money
- What you should not worry about testing
Previous Testing Videos and Information: http://www.thenetreporter.com/fullmembers/wp/?p=240
41 Responses
Thanks for this, Jim. I especially appreciate your sharing your proprietary information. Makes it Real. ;~)
Tell me, did you have a look at Jim Stone’s SplitTestAccelerator before deciding to go ahead with SplitAnalyzer?
Cheers from Beautiful British Columbia,
Sheila
Hi Ron,
We aim to please
Hi Sheila,
No, I did not look at that program… have you used it? Did you like it?
Jim  Â
Hi Jim,
Haven’t bought it yet, although I’m very intrigued by it. He uses Taguchi.
Offers an outstanding 10-part email course (free) on Split Testing. Plus a helpful forum. And makes his “Simple Split-Testing Software” available free (i.e. The “Simple” software is not multi-variable like his $495 “Accelerated” software)
Kinda like you … overdelivering, I mean. No doubt he has better taste in shirts.
Anyway, the course alone is very high value, and the Simple software could be a way for newcomers to testing to get their feet wet.
Cheers,
Sheila
Hi Sheila,
Taguchi is an advanced, more difficult to setup, way to split test several factors at the same time.
If you are just getting started, I would recommend to stick with regular a/b split testing first. Once you are comfortable doing that… you might consider moving on to taguchi testing.
Just my 10 cents worts.
Regards,
Frank Bauer
PS: On the 26th I will launch a new ad tracking / split testing servive myself. Please click on my name above for details.
How wierd. I know I left a comment earlier and it’s not there, so….
Thanks Jim!
I’ve been wanting to do split testing and just felt really overwhelmed by it.
From Jim:
The best thing to do is not to try to test multiple variables at a time… you should only test one variable at a time. (headline, price, etc.)
Trying to do more than one at a time is what makes things confusing
Here’s a link to the software I’m using - http://www.Split-Analyzer.comÂ
Jim
Â
You simplified it and gave me some great info. I really liked how you showed us how to come up with the percentages, and also how to look at the other info and see what was valuable about it.
I wanted to know if you can do multiple testing of multiple factors with that program.
Also, Is there a way I can get my hands on the program you were using to show the end results of the change in percentage?
The chart that you plug the numbers into to get how much income a year you would make.
Let me know.
And Thanks again!!!!
Great info, that I really wanted! I’m loving this membership.
Those of you that have purchased this software and have installed it and began to run tests:
Did you have an extremely difficult time getting it to work?
I’ve spent 4 hours straight trying to set up the first test, but even with following all instructions step by step (from both Jim’s videos and the software’s actual tutorial) when I upload the code as the “index” page, and update it on the FTP, when I go to my web browser to look at the page, I get nothing but a blank page.
I’ll look at the source code for the page, and it does indeed have the Split Analyzer code (letting me know the uploading worked), but again, a blank page is what comes up.
Also, this is probably why I can’t get my page to “initialize”.
In addition, if I hit the “preview” buttons on the program, again, a blank page comes up.
Has anyone ran into this same problem?
Hi Jonathan,
I’m sorry you’re having a problem.
Let me ask you a few questions:
1. Have you contacted tech support with Split Analyzer to see if they can help?
2. Which web host are you using?
It’s not my software, but it sounds to me that if you can see the split analyzer code on your website when you look at the source code for the page when it’s actually ON the web server, there might be something wrong. Because I’m running the software on my http://www.fsbohelp.com website, and when you view the source code, there’s no mention of split analyzer anywhere in the page code that I can find.
Because once you’ve uploaded it, you shouldn’t see the code when you view source… it should pull in the html code of the page(s) you are split testing.
Let us know what support tells you… and if you have a problem, let me know, and I’ll do my best to light a fire under their butts to make sure they help you get it squared away.
Jim
Thanks for the reply, Jim.
Yes, I’ve opened up a “ticket” via their tech support, explaining in detail what I’m coming across.
So, I’m waiting to see what they say could be the problem.
Second, the host I’m using is Host Gator (I believe the one you recommend, which is pure coincidence because that’s who I was using all along).
I’ll be sure to let you guys know what they tell me, just in case someone else happens to run into a similar obstacle.
Jonathan,
Thanks for the update.. and let me know if you have trouble getting a response.
Jim
Update on tech support issue with Split Analyzer:
I had to email the gentleman that sells this program directly, since it had been 3-4 days since opening up 2 tech support tickets with my problem without any response from them.
He emailed me back and said that “they are currently in the process of switching tech support companies” and to “in a couple of days, re-open another ticket”.
So, if anyone is having similar problems with this software, just hold off for a couple of days, perhaps even a week, and resubmit a new ticket.
We’ll see what happens then.
If he doesn’t get back to you in 2 days, you let me know… this doesn’t make me happy at all!
Jim
Update for anyone that has this software:
It’s approximately 5 days now since having opened up a 3rd ticket on their tech support, and no word yet from anyone of them.
(None of the tickets have been addressed)
How’s everyone else coming along with this software?
How have your testings come out?
Jonathan,
That’s not cool.
I am going to email him myself right now.
Also, not this coming week, but the week after, I will start investigating alternative testing software.
If anyone has a suggestion for A-B split testing software, I’m all ears
Jim
Jonathan,
I just emailed with Jared… he says he’s going to email you himself.
Let me know if he gets it fixed for you
Jim
Wow.
Jim, you didn’t have to do that for me.
You are way too busy to be emailing individuals on my behalf.
I can’t thank you enough.
Jared emailed me that very afternoon, telling me to send my tech support issue to a specific email address.
He even mentioned that you had gotten a hold of him (it sounded like you tightened the noose around him…..lol).
Jim, this was a very “stand up” favor you did for me.
I won’t forget it.
I’ll let everyone know what tech support tells me, in case someone runs into something similar.
Jonathan,
If I’m able, I’m always glad to help when people are actively trying to get things done
Jim
Jim,
Even with the sending 2 different emails to the address the owner of this software told me to (after you had personally spoken to him), after 4-5 days now, I still haven’t gotten any response from them.
What I wanted to ask you was if you would recommend that I pay someone from Elance to fix the problem I’m having with the software?
I truly believe that testing one’s sites is very important, as you can make more money from the same or less traffic by tweaking things like headlines, price, etc., as you instruct in the videos.
That’s why I’m really on top of getting this to work.
I’m curious to see what your response is.
P.S. Thanks for sending me a copy of the Online Show cd!
Jonathan,
The answer is two-fold
1. if you can get someone from elance to fix the problem for $20-30, then yes…
2. I need to find another script with better support… and will actively start doing that.
Rather than have my own script written, does anybody have a suggestion for a good A-B split testing script we can try out?
Jim
Well, I wasn’t able to get someone to bid less than $50 at Elance to figure out the problem with the Split Analyzer software.
And after a final attempt to reach someone in tech support, I have officially requested and received a full refund.
Jim, let us know if you come across another good A-B Testing software.
Jonathan,
I’m REALLY sorry that happened… that sucks
I am on it to find a replacement
Jim
Hi Jim,
> Rather than have my own script written, does anybody have a suggestion for a
> good A-B split testing script we can try out?
Yes, I’ve been using this for years and highly recommend it:
http://quickpaypro.com/x.php?3885_A92868_20232
You can split test and add many URLs to the split test. You can also do remote tracking, it works great.
-Brett
Hi Brett,
Thanks for the suggestion
Is there a way to use this to do A-B split tests of headlines on a web page without doing a redirect from the index.html page?
Jim
Hi Jim,
> Is there a way to use this to do A-B split tests of headlines on a web page
> without doing a redirect from the index.html page?
Hmmm, I’m not sure but there may be, you can use it as a ‘Rotator’, there are instructions on that on the help pages. You can have the home page rotate back/forth between different pages, but I’m not sure if the redirect is required, just a min. I’ll check it out…
Just had a look at the video on doing this. You can do a split test to your home page, but to do that you setup a cloak (redirect) to do it. Does this cause problems with SEO, or why do you ask?
Another way you could do this that I can think of is do a MOD REWRITE on the directory, that means that you force the directory path when pointing to your homesite to instead point somewhere else, and do your split testing there. But basically a MOD REWRITE is the same type of thing, it re-directs to another page, but I’m not sure how that looks to Search Engines?
-Brett
Brett,
>Just had a look at the video on doing this. You can do a
>split test to your home page, but to do that you setup a
>cloak (redirect) to do it. Does this cause problems with
>SEO, or why do you ask?
The biggest reason is that redirects can cause a problem with Google AdWords’ one click back rule (redirect on the index.html page can create 2 clicks to get back)
Jim
Hi,
> The biggest reason is that redirects can cause a problem with Google AdWords’ > one click back rule (redirect on the index.html page can create 2 clicks to get
> back)
Ok, that makes sense, does the software you use do it without re-directs, and if so, how? I’m a programmer and can’t think of any other way to do it, except for using MOD REWRITE?
Thanks,
-Brett
IT does it with a php script that pulls in the html code that is stored on the server… so it creates each version of the page dynamically each time the index.php file is pulled
Jim
Hi Jim,
> IT does it with a php script that pulls in the html code that is stored on the
> server… so it creates each version of the page dynamically each time the
> index.php file is pulled
Ok, but does IT work?
You said:
> If anyone has a suggestion for A-B split testing software, I’m all ears
I’m looking at the sales page and it looks pretty good, but not if it does not pull accurate stats! I’m curious what the problems are, since it appears that this thing could do quite a bit for the money, what part of it does not work?
Thanks,
-Brett
It works for me… but others have been unable to get support and have not been able to make it work on their websites.
HI Jim;
Thanks -this was another great session…..
Just curious…. are you still using Split-Analyzer.com?
I have just purchased it (then read the posts after!), so am a bit concerned…. I have not set it up and tested/used it yet….
I like that it looks easy to follow and understand… but tech support (any support) is soooo important nowadays (always)…
Anyone else have any probelms with it?
Thanks
Rea
PS – still loving the subsscription Jim – keep ‘em coming!!!
Hi Rea,
I’m still using it… however, I do know that some are having problems with it.
I’ve been evaluating an alternative here:
http://www.absplittesting.com/
It’s pretty simple… and they have an online wizard that sets up the files on your server for you.
One thing I don’t like is that your test screen is not password protected… so if someone knew you were using this software, they could view your results or maliciously reset your campaign.
Other than that, seems pretty reliable, but I’m still testing it…. soooooo, it gets a positive nod from me, but not my 110% personal endorsement (if that makes sense).
Jim
I’ll definitely hold off before purchasing this newer software.
I’m sure you’ll give it the thumbs up or down soon enough.
Thanks always.
I will keep you posted
Jim
Thanks Jim – will keep an ‘eye-out’ for any updates.
Another query – can you use Split-Analyzer.com for affiliate testing? ie If I sell an affiliate program – can I split my landing pages – if I don’t have the final sales page?
I guess I could test subscriptions (opt-ins)- even with affiliate programs as the confirmation page would be mind – is that right?
Thanks again
Rea
Rea,
You can use it to test offers… but your best measurement is optins to your own list where you control the confirmation page…
Jim
Hi Jim,
I’m going to use 1shoppingcart’s Split Testing to test two, possibly three landing pages on my site. I’ve also put ad trackers on all the internal links on the website. I thought this might give me an idea where I lose people and what propels people to buy. Is there any problem with using so many ad trackers? For example, will the search engine spiders not be able to follow the links and penalize me some way?
Also, with Google’s new rules for quality with landing pages, I was thinking of testing one landing page with internal links in the middle of the page that would lead to excerpts from the product and maybe sample newsletter issues. But the excerpts and newsletters would all be geared toward selling the product and have two links of their own: one back to the home page and one to order. Of course, the disclaimers and all that would be at the bottom.
I know the general consensus is to keep the landing page clean with no links until the bottom and I figured that would be part of the test, but do you know conclusively if it’s just a bad idea to put those internal links in the middle of the page?
I thought it was interesting that you debunked some of the myths about headers and such and I wondered if the same was true for internal links?
Finally, just a combo observation/question. Have you tested the audio on your Turn Words Into Traffic page? I went over there to look at the site just to play around with ideas for what might cause a better conversion (for my own education, not to presume to teach you–I’m not that silly). I wanted to figure out why your conversion rates for both tests were the same, but one group stayed on the site so much longer.
I wonder if the audio has anything to do with it. I played it and found myself looking around, but I couldn’t fully concentrate on the text or the audio. It was like when you watch the TV news and they have headlines scrolling across the bottom. You can’t give either your undivided attention. At least I can’t. I know that’s not what you were testing, but maybe the group that stayed longer got further down the page to the audio and stayed like I did, but then got distracted and didn’t buy.
Of course, that assumes you had audio on the page when you did the test. I could be completely off-base. Just wondered if you ever tested audio vs. no audio and what happened.
>I’m going to use 1shoppingcart’s Split Testing to test two,
>possibly three landing pages on my site. I’ve also put ad
>trackers on all the internal links on the website. I thought
>this might give me an idea where I lose people and what
>propels people to buy. Is there any problem with using so
>many ad trackers? For example, will the search engine
>spiders not be able to follow the links and penalize me some
>way?
Sounds like it could get confusing… but see how it goes… no clue how the spiders would react (I never worry about that)
>
>Also, with Google’s new rules for quality with landing
>pages, I was thinking of testing one landing page with
>internal links in the middle of the page that would lead to
>excerpts from the product and maybe sample newsletter
>issues. But the excerpts and newsletters would all be geared
>toward selling the product and have two links of their own:
>one back to the home page and one to order. Of course, the
>disclaimers and all that would be at the bottom.
Sounds like a plan
>
>I know the general consensus is to keep the landing page
>clean with no links until the bottom and I figured that
>would be part of the test, but do you know conclusively if
>it’s just a bad idea to put those internal links in the
>middle of the page?
Might distract from the sales message…
>I thought it was interesting that you debunked some of the
>myths about headers and such and I wondered if the same was
>true for internal links?
Once I get them to the middle of a page, I don’t want to distract them
>
>Finally, just a combo observation/question. Have you tested
>the audio on your Turn Words Into Traffic page? I went over
>there to look at the site just to play around with ideas for
>what might cause a better conversion (for my own education,
>not to presume to teach you–I’m not that silly). I wanted to
>figure out why your conversion rates for both tests were the
>same, but one group stayed on the site so much longer.
>
>I wonder if the audio has anything to do with it. I played
>it and found myself looking around, but I couldn’t fully
>concentrate on the text or the audio. It was like when you
>watch the TV news and they have headlines scrolling across
>the bottom. You can’t give either your undivided attention.
>At least I can’t. I know that’s not what you were testing,
>but maybe the group that stayed longer got further down the
>page to the audio and stayed like I did, but then got
>distracted and didn’t buy.
>
>Of course, that assumes you had audio on the page when you
>did the test. I could be completely off-base. Just wondered
>if you ever tested audio vs. no audio and what happened.
You should always test with and without audio… and test various audio lengths to see how it impacts conversion… one audio might work where another would not… or, a particular message needs to skip audio altogether.
It just depends… that’s why we test
Jim
Hi Jim,
I have a follow-up question. Do you use Split-Analyzer or a separate web analytics program to track visitor navigation through your sites? I know with the original minisites there really wasn’t anyplace to go except the order page after the sales page. But with the extra pages we now have to put up for Google, is there value in tracking visitor navigation through all pages (say if they hit a Resources link at the bottom) or is it best just to see who comes to the site and converts and leave it at that?
Also, I had asked Soosan about using ad trackers on articles. I wondered if you use them on your articles or if you find the data gets too messy since the articles can be posted on so many sites and for so long.
One final question (so much for one follow-up, huh): if you use print ads and want people to come to your website from them, do you just use a different subdirectory to see who’s responding from what ad–e.g., http://www.mysite.com/tribunereview?
Thanks again.
Debbie,
>I have a follow-up question. Do you use Split-Analyzer or a
>separate web analytics program to track visitor navigation
>through your sites? I know with the original minisites there
>really wasn’t anyplace to go except the order page after the
>sales page. But with the extra pages we now have to put up
>for Google, is there value in tracking visitor navigation
>through all pages (say if they hit a Resources link at the
>bottom) or is it best just to see who comes to the site and
>converts and leave it at that?
I don’t track navigation through the sites… I probably should… but I don’t.
I get to the point where I know it’s working and I don’t want to take the time to analyze further.
I just look at unique visitors and sales
>
>Also, I had asked Soosan about using ad trackers on
>articles. I wondered if you use them on your articles or if
>you find the data gets too messy since the articles can be
>posted on so many sites and for so long.
I used to… I don’t any more. You can look in your referror logs in your stats to see where visitors are coming from if you want to track back to individual articles.
>
>One final question (so much for one follow-up, huh): if you
>use print ads and want people to come to your website from
>them, do you just use a different subdirectory to see who’s
>responding from what ad–e.g., http://www.mysite.com/tribunereview?
NO – use a distinct URL (yourdomain.com) – DON”T use a subdomain… it doesn’t work nearly as well
Jim
Hi Jonothan – I feel your pain bro – I just went thru a similar thing with a membership site .php plugin – all to no avail, so thanks for sharing that unsupportted adventure with us on this software
.
Anyone else have any success with absplittesting.com?
What about you Big Jim any further words of wisdom on abspilttesting.com or any other testing software? I’m keen to legitimise myself in this way
Thanks for everything
Mike
Hi Guys,
Ok – absplittesting.com is worth using… it seems stable, and it’s relatively easy to use.
NOTE: The one downside of it is that your results page is NOT password protected. So if someone knows that you’re using it they could go in and look at your results… and if they are malicious, reset your campaign.
With that said, as long as you don’t advertise the fact that you’re using it, you should be okay.
I used the wizard they have on their site to set up the test on one of my sites and it worked well… so, for now, it’s the best option I know of… but we’ll keep looking
Jim
Hi Jim
I have actually gotten to see real life examples of A/B splits and how they are set up on different websites!!
I like the short and informative videos and actual examples of how its A/B splits are done in realtime. Cool!!
Keep Up The Good Work!!
I will be looking forward to future updates…