assaf / vanity

Experiment Driven Development for Ruby
http://vanity.labnotes.org
MIT License
1.55k stars 269 forks source link

Dynamically set the variations when split testing emails #300

Open hraynaud opened 8 years ago

hraynaud commented 8 years ago

Is there a way to dynamically provide the "subject line" variations. My allows users to provide the variations at runtime.

phillbaker commented 8 years ago

@hraynaud can you give an example of what you're looking for? Not quite sure I understand.

An example of testing email subject lines is here: http://vanity.labnotes.org/email.html#subject.

hraynaud commented 8 years ago

@phillbaker Thanks for getting back to me. I believe this issue, #269 is more or less what I'm trying to achieve. My application allows an administrator to create emails on-the-fly( using a normal html form) that goes out to users associated with their account. I'd like to offer admins the ability to A/B test two subject lines when sending out emails.

As I understand the way vanity works I must hardcode the subject variations

ab_test "Invite subject" do
    description "Optimize invite subject line"
    alternatives "Join now!", "You're invited to an exclusive event."
    metrics :open
end

there is no way to do something like ...

ab_test "Invite subject" do
    description "Optimize invite subject line"
    alternatives AdminUser.find(1).subject_lines #pseudocode returning comma delim string.
    metrics :open
end

I hope this clarifies what I'm trying to do.

thanks