Variable content generation and engagement tracking

Abstract

A communication server supports automatic content receipt and distribution. The communication server receives a set of content objects, where a content object of the set is associated with a set of target group identifiers. A content object of the set may include different versions of content for ABn and/or multivariate testing. The communication server generates target segment identifier combinations and distributes versions of messages proportionally to each user identifier associated with the target segment combinations. The server generates engagement metrics corresponding to interaction by the user identifiers with the messages. The metrics may be generated for each message version, each group of users, and each group combination.

What is claimed is: 
     
       1. A method for content distribution, comprising:
 receiving an indication of one or more content objects, a collection of user identifiers, and a plurality of data attributes associated with the collection of user identifiers, the collection of user identifiers and the plurality of data attributes being stored in a datastore, wherein each user identifier of the collection of user identifiers is associated with a respective segment identifier combination of a plurality of segment identifier combinations based at least in part on the plurality of data attributes and wherein each segment identifier combination of the plurality of segment identifier combinations comprises at least one segment identifier per segment class of a set of segment classes; 
 splitting each segment identifier combination of the collection of user identifiers received from the datastore into a first distribution group and a second distribution group based at least in part on the plurality of data attributes; 
 generating a first version of the one or more content objects and a second version of the one or more content objects; 
 transmitting, in accordance with an email distribution schedule, a first set of emails comprising the first version of the one or more content objects to a first plurality of user identifiers across the plurality of segment identifier combinations and that are in the first distribution group; 
 transmitting, in accordance with the email distribution schedule, a second set of emails comprising the second version of the one or more content objects to a second plurality of user identifiers across the plurality of segment identifier combinations and that are in the second distribution group; and 
 generating a first set of engagement metrics based at least in part on user interactions, by users in each segment identifier combination, with the first version of the one or more content objects and a second set of engagement metrics based at least in part on user interactions, by users in each segment identifier combination, with the second version of the one or more content objects. 
 
     
     
       2. The method of  claim 1 , further comprising:
 receiving an indication of one or more target group identifiers that are associated with a group class of a set of group classes; and 
 determining a set of target group identifier combinations for the one or more target group identifiers using a rule indicating that a target group identifier combination is to have one target group identifier per group class of the set of group classes, wherein the first distribution group and the second distribution group are identified according to the set of target group identifier combinations. 
 
     
     
       3. The method of  claim 1 , wherein receiving the indication of the one or more content objects comprises:
 receiving an indication of a first content item and a second content item for a first content object of the one or more content objects, wherein the first version includes the first content item for the first content object and the second version includes the second content item for the first content object. 
 
     
     
       4. The method of  claim 1 , wherein receiving the indication of the one or more content objects comprises:
 receiving an indication of at least two content items for the one or more content objects. 
 
     
     
       5. The method of  claim 4 , further comprising:
 determining a number of messages to generate based at least in part on a number of possible combinations of content items for the one or more content objects. 
 
     
     
       6. The method of  claim 4 , further comprising:
 determining a number of user identifiers for each distribution group for transmission of a number of messages based at least in part on a number of possible combinations of content items for the one or more content objects. 
 
     
     
       7. The method of  claim 1 , wherein a number of user identifiers in the first plurality of user identifiers and a number of user identifiers in the second plurality of user identifiers is proportional. 
     
     
       8. The method of  claim 1 , wherein the first set of engagement metrics and the second set of engagement metrics comprise an open rate, a click rate, or a combination thereof. 
     
     
       9. The method of  claim 1 , wherein the first version, the second version, or both comprise an email. 
     
     
       10. An apparatus for content distribution, comprising:
 one or more processors; 
 one or more memories coupled with the one or more processors; and 
 instructions stored in the one or more memories and executable by the one or more processors to cause the apparatus to: 
 receive an indication of one or more content objects, a collection of user identifiers, and a plurality of data attributes associated with the collection of user identifiers, the collection of user identifiers and the plurality of data attributes being stored in a datastore, wherein each user identifier of the collection of user identifiers is associated with a respective segment identifier combination of a plurality of segment identifier combinations based at least in part on the plurality of data attributes and wherein each segment identifier combination of the plurality of segment identifier combinations comprises at least one segment identifier per segment class of a set of segment classes; 
 split each segment identifier combination of the collection of user identifiers received from the datastore into a first distribution group and a second distribution group based at least in part on the plurality of data attributes; 
 generate a first version of the one or more content objects and a second version of the one or more content objects; 
 transmit, in accordance with an email distribution schedule, a first set of emails comprising the first version of the one or more content objects to a first plurality of user identifiers across the plurality of segment identifier combinations and that are in the first distribution group; 
 transmit, in accordance with the email distribution schedule, a second set of emails comprising the second version of the one or more content objects to a second plurality of user identifiers across the plurality of segment identifier combinations and that are in the second distribution group; and 
 generate a first set of engagement metrics based at least in part on user interactions, by users in each segment identifier combination, with the first version of the one or more content objects and a second set of engagement metrics based at least in part on user interactions, by users in each segment identifier combination, with the second version of the one or more content objects. 
 
     
     
       11. The apparatus of  claim 10 , wherein the instructions are further executable by the one or more processors to cause the apparatus to:
 receive an indication of one or more target group identifiers that are associated with a group class of a set of group classes; and 
 determine a set of target group identifier combinations for the one or more target group identifiers using a rule indicating that a target group identifier combination is to have one target group identifier per group class of the set of group classes, wherein the first distribution group and the second distribution group are identified according to the set of target group identifier combinations. 
 
     
     
       12. The apparatus of  claim 10 , wherein the instructions to receive the indication of the one or more content objects are executable by the one or more processors to cause the apparatus to:
 receive an indication of a first content item and a second content item for a first content object of the one or more content objects, wherein the first version includes the first content item for the first content object and the second version includes the second content item for the first content object. 
 
     
     
       13. The apparatus of  claim 10 , wherein the instructions to receive the indication of the one or more content objects are executable by the one or more processors to cause the apparatus to:
 receive an indication of at least two content items for the one or more content objects. 
 
     
     
       14. The apparatus of  claim 13 , wherein the instructions are further executable by the one or more processors to cause the apparatus to:
 determine a number of messages to generate based at least in part on a number of possible combinations of content items for the one or more content objects. 
 
     
     
       15. The apparatus of  claim 13 , wherein the instructions are further executable by the one or more processors to cause the apparatus to:
 determine a number of user identifiers for each distribution group for transmission of a number of messages based at least in part on a number of possible combinations of content items for the one or more content objects. 
 
     
     
       16. A non-transitory computer-readable medium storing code for content distribution, the code comprising instructions executable by a one or more processors to:
 receive an indication of one or more content objects, a collection of user identifiers, and a plurality of data attributes associated with the collection of user identifiers, the collection of user identifiers and the plurality of data attributes being stored in a datastore, wherein each user identifier of the collection of user identifiers is associated with a respective segment identifier combination of a plurality of segment identifier combinations based at least in part on the plurality of data attributes and wherein each segment identifier combination of the plurality of segment identifier combinations comprises at least one segment identifier per segment class of a set of segment classes; 
 split each segment identifier combination of the collection of user identifiers received from the datastore into a first distribution group and a second distribution group based at least in part on the plurality of data attributes; 
 generate a first version of the one or more content objects and a second version of the one or more content objects; 
 transmit, in accordance with an email distribution schedule, a first set of emails comprising the first version of the one or more content objects to a first plurality of user identifiers across the plurality of segment identifier combinations and that are in the first distribution group and a second plurality of user identifiers in the second distribution group; 
 transmit, in accordance with the email distribution schedule, a second set of emails comprising the second version of the one or more content objects to a second plurality of user identifiers across the plurality of segment identifier combinations and that are in the second distribution group; and 
 generate a first set of engagement metrics based at least in part on user interactions, by users in each segment identifier combination, with the first version of the one or more content objects and a second set of engagement metrics based at least in part on user interactions, by users in each segment identifier combination, with the second version of the one or more content objects. 
 
     
     
       17. The non-transitory computer-readable medium of  claim 16 , wherein the instructions are further executable by the one or more processors to:
 receive an indication of one or more target group identifiers that are associated with a group class of a set of group classes; and 
 determine a set of target group identifier combinations for the one or more target group identifiers using a rule indicating that a target group identifier combination is to have one target group identifier per group class of the set of group classes, wherein the first distribution group and the second distribution group are identified according to the set of target group identifier combinations. 
 
     
     
       18. The non-transitory computer-readable medium of  claim 16 , wherein the instructions to receive the indication of the one or more content objects are executable by the one or more processors to:
 receive an indication of a first content item and a second content item for a first content object of the one or more content objects, wherein the first version includes the first content item for the first content object and the second version includes the second content item for the first content object. 
 
     
     
       19. The non-transitory computer-readable medium of  claim 16 , wherein the instructions to receive the indication of the one or more content objects are executable by the one or more processors to:
 receive an indication of at least two content items for the one or more content objects. 
 
     
     
       20. The non-transitory computer-readable medium of  claim 19 , wherein the instructions are further executable by the one or more processors to:
 determine a number of messages to generate based at least in part on a number of possible combinations of content items for the one or more content objects.