Welcome, Guest ( Customer Panel | Login )




 All Forums
 VPCart Forum
 General help me questions
 Multivariate and A/B testing
 New Topic  Reply to Topic
 Printer Friendly
Author Previous Topic Topic Next Topic  

Steve2507
VP-CART Expert

590 Posts

Posted - September 17 2008 :  17:58:46  Show Profile  Reply with Quote
Hi,

I'm looking at setting up either multivariate and/or A/B testing using the G optimiser service.

I was wondering if anyone had used it with VP and if so how did it go?. Also were there any problems with integrating it into VP?

Thanks in advance.



Steve
Sex toys from a UK sex shop

Renners
Starting Member

United Kingdom
46 Posts

Posted - August 03 2011 :  09:35:38  Show Profile  Visit Renners's Homepage  Reply with Quote
Hi Steve,

I've seen a few posts where you are doing this now, did you find an easy solution to doing A/B split testing without using Google's service?

Regards,
Phil.
Go to Top of Page

Steve2507
VP-CART Expert

590 Posts

Posted - August 04 2011 :  08:32:02  Show Profile  Reply with Quote
Hi Phil,

Unfortunately no, we are using Google. However as it is a client side service and we are soon going to reach a point where we need to test the product templates it soon won't be capable.

I've found a couple of potentials which I'm about to start testing. I did find one that would've been ideal, however the set up fee was a little high (£75,000).

I've also worked out a way of coding something up myself which I'm going to work on if the tests fail.


Steve
Sex toys from a UK sex shop including vibrators and dildos.
Go to Top of Page

Renners
Starting Member

United Kingdom
46 Posts

Posted - August 05 2011 :  10:05:56  Show Profile  Visit Renners's Homepage  Reply with Quote
Thanks Steve,

It is the Product page testing I am struggleing with as I send the majority of traffic direct to the site with no google involvement hence the question.

With regard to the coding are you thinking along the lines of an interception script of some descrip? I was thinking of maybe utilising something at the server level to redirect a page, not looked into it yet so don't know how difficult it would be, maybe find a load balancer that can handle traffic at page level and hack (just thinking outloud!)

Regards,
Phil.
Go to Top of Page

Steve2507
VP-CART Expert

590 Posts

Posted - August 05 2011 :  12:10:37  Show Profile  Reply with Quote
Hi Phil

Yep, that's my problem - the product page. Everything else (like the sidebars) is easy. But I'd love to test different buyu buttons, price wroding, rrp wording, layouts and even product names.

My idea is to set up a new table with 4 fields - the id, the test reference, the variable used in the test and then the result (conversion or no conversion). Then I'm going to set up a system where it checks if a cookie for the test is in place, if it isn't then it is created and a decision is made as to which variable is used. Every page where there is a potential for this variable would check this cookie first. Then code would change the element if needed.

For example if you want to test the buy button then you would place a call to the script around the function for the production of the add to cart button. The script would determine the variable to be used (from the cookie) and replace the normal button with another one.

To ensure the user keeps the same variable on a retrun visit you can put a decent expiry on the cookie and to ensure you have a fair spread amongst the users you can say all odd numbers in the table ID produce variable A and all evens variable B. For more complex sharing (like 75/25) you could use the mod calculation so if the ID is completely divisable by 4 then show variable B if it leaves a remainder use the standard variable A.

It sounds complex and to be honest I think it will be, so I'm still going to test a few more reasonably priced offerings. But I have a feeling I'm not going to find anything that does more than the basics in our budget range.


Steve
Sex toys from a UK sex shop including vibrators and dildos.
Go to Top of Page

Renners
Starting Member

United Kingdom
46 Posts

Posted - August 11 2011 :  12:14:41  Show Profile  Visit Renners's Homepage  Reply with Quote
Hi Steve,

Thanks for the explanation of your idea, it does sound like you are covering all the bases as the return visit was a sticking point I had.

I'm also still looking for a pre-built solution at the server level if I get any joy I'll let you know.

Regards
Phil.
Go to Top of Page

Steve2507
VP-CART Expert

590 Posts

Posted - August 11 2011 :  12:44:26  Show Profile  Reply with Quote
Hi Phil,

I trialled a few more and none of them do what I need, so today I started drawing up my flowcharts to get this thing moving.

Hit one problem and that was spiders and crawlers. A cookie covering a big portion of the site may block spiders (which obviously isn't good). There are ways to get round this with redirects but I don't really want to do that. So I've found a package that you install on the server and can do those sorts of checks easily. It's called BrowserHawk, expensive but I'm sure I'll get my money back on it with the testing.


Steve
Sex toys from a UK sex shop including vibrators and dildos.
Go to Top of Page

Steve2507
VP-CART Expert

590 Posts

Posted - August 24 2011 :  16:59:33  Show Profile  Reply with Quote

Shameless plug alert.

Think I've cracked this. I purchased a piece of software called BrowserHawk which gives details on the visitor before any rendering is done on their machine, so the cookie problem blocking spiders is fixed.

I've got a test going on now with one of our sites where the template for the product is changed both in product listing views and product expanded views, dependent on the variation given to the user.

I can also stop a variation immediately by changing a variable in the database.

At the moment I am one happy man (easily pleased ).


Steve
Sex toys from a UK sex shop including vibrators and dildos.
Go to Top of Page
  Previous Topic Topic Next Topic  
 New Topic  Reply to Topic
 Printer Friendly
Jump To:
Snitz Forums 2000
0 Item(s)
$0.00