{"id":22239,"date":"2021-07-12T09:17:07","date_gmt":"2021-07-12T02:17:07","guid":{"rendered":"https:\/\/gudjob.net\/?p=22239"},"modified":"2021-07-12T09:17:07","modified_gmt":"2021-07-12T02:17:07","slug":"khi-a-b-testing-khong-cho-ban-biet-toan-bo-cau-chuyen","status":"publish","type":"post","link":"https:\/\/gudjob.net\/en\/blog\/khi-a-b-testing-khong-cho-ban-biet-toan-bo-cau-chuyen\/","title":{"rendered":"When A\/B testing doesn't tell you the whole story"},"content":{"rendered":"<p>Each year, marketers spend billions of dollars on campaigns to attract, retain, and sell more products to customers.<\/p>\n<p>To understand the shortcomings of how A\/B testing is commonly used, let's take a look at the following hypothetical example:<\/p>\n<p>Imagine you work for a large arts organization that is concerned about declining membership retention rates.<\/p>\n<p>Now, let's say you don't find any difference in retention between members who received the giveaway and those who didn't.<\/p>\n<h2 id=\"t%E1%BB%91i-%C6%B0u-h%C3%B3a-chi%E1%BA%BFn-d%E1%BB%8Bch-ph%C3%B2ng-ch%E1%BB%91ng-%E2%80%9Cchurn%E2%80%9D\">Optimizing the \u201cChurn\u201d Prevention Campaign<\/h2>\n<blockquote><p><em><strong>Churn rate \u2013 Churn rate<\/strong> (sometimes called attrition rate): in the broadest sense, a measure of the number of individuals or items moving out of the collective pool during a specific period of time.<\/em><\/p><\/blockquote>\n<p>This isn't just hypothetical \u2013 in fact, this example is based on a real organization I worked with during my research. When it comes to increasing retention, companies often identify \u201chigh-risk\u201d customers \u2013 that is, customers whose recent behavior or other characteristics indicate they are particularly likely to unsubscribe or stop purchasing the company's products \u2013 and then run A\/B testing to determine whether their retention campaigns are effective with this group. While this is an understandable strategy, my research shows that it can be seriously counterproductive, as it can cause marketers to make poor decisions that actually reduce overall retention and ROI on marketing spend.<\/p>\n<p>Specifically, I conducted field tests with two large companies implementing user retention campaigns.<\/p>\n<p>Across both companies, I found that customers identified as at highest risk of churn were not necessarily the best targets for retention programs \u2013 in fact, there was little correlation between a customer's level of churn risk and their susceptibility to interventions.<\/p>\n<p>Of course, the specific factors that make customers more likely to be receptive to a retention campaign will vary from organization to organization and even from campaign to campaign, but running an experiment as described above can help you identify the characteristics that will best predict customer susceptibility to a particular campaign.<\/p>\n<p>For example, one of the organizations in my study was a telecommunications company that had access to detailed data on behavioral metrics such as the number of calls customers made in the previous month, the number of messages they sent, gigabytes of data downloaded, and more.<\/p>\n<h2 id=\"chuy%E1%BB%83n-t%E1%BB%AB-d%E1%BB%B1-%C4%91o%C3%A1n-sang-k%C3%AA-%C4%91%C6%A1n\">Moving from Prediction to Prescription<\/h2>\n<p>So what does this mean for marketers?<\/p>\n<p>Instead of trying to predict what customers will do (i.e. trying to determine their risk of churn), marketers should focus on how different types of customers will respond to specific campaigns and then design the campaigns that are most likely to be effective in reducing churn among a given group of customers.<\/p>\n<p>\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2013<\/p>\n<p>The concept of targeted marketing campaigns is nothing new \u2013 but it's important to think carefully about how you make those targeting decisions. Instead of simply guessing at what factors might indicate that someone is a strong target or focusing on groups considered high priority (such as customers at high churn risk), companies should target customers who are most susceptible to specific interventions. they are implementing. To maximize ROI, marketers need to stop asking, \u201cIs this intervention effective?\u201d and start asking, \u201cFor whom is this intervention most effective?\u201d \u2013 and then target their campaigns accordingly.<\/p>\n<p><strong><em>Eva Ascarza<\/em><\/strong><em> is Associate Professor of Business Administration at Harvard Business School.<\/em><\/p>","protected":false},"excerpt":{"rendered":"<p>M\u1ed7i n\u0103m, c\u00e1c marketer chi h\u00e0ng t\u1ef7 \u0111\u00f4 la cho c\u00e1c chi\u1ebfn d\u1ecbch nh\u1eb1m thu h\u00fat, gi\u1eef ch\u00e2n v\u00e0 b\u00e1n th\u00eam s\u1ea3n ph\u1ea9m cho kh\u00e1ch h\u00e0ng. Tuy nhi\u00ean, b\u1ea5t ch\u1ea5p s\u1ef1 \u0111\u1ea7u t\u01b0 l\u1edbn n\u00e0y, vi\u1ec7c x\u00e1c \u0111\u1ecbnh m\u1ee9c \u0111\u1ed9 hi\u1ec7u qu\u1ea3 c\u1ee7a nh\u1eefng s\u00e1ng ki\u1ebfn n\u00e0y th\u1ef1c s\u1ef1 l\u00e0 r\u1ea5t kh\u00f3 kh\u0103n v\u00e0 ch\u00fang [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":22356,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"wpai_generated_summary":"","footnotes":""},"categories":[177],"tags":[192,197],"class_list":["post-22239","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-marketing-quang-cao","tag-kinh-doanh","tag-mang-xa-hoi"],"acf":[],"_links":{"self":[{"href":"https:\/\/gudjob.net\/en\/wp-json\/wp\/v2\/posts\/22239","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gudjob.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gudjob.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gudjob.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/gudjob.net\/en\/wp-json\/wp\/v2\/comments?post=22239"}],"version-history":[{"count":0,"href":"https:\/\/gudjob.net\/en\/wp-json\/wp\/v2\/posts\/22239\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/gudjob.net\/en\/wp-json\/wp\/v2\/media\/22356"}],"wp:attachment":[{"href":"https:\/\/gudjob.net\/en\/wp-json\/wp\/v2\/media?parent=22239"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gudjob.net\/en\/wp-json\/wp\/v2\/categories?post=22239"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gudjob.net\/en\/wp-json\/wp\/v2\/tags?post=22239"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}