Companies rely on different types of statistical analyses to extract information from their Customer experience management (CEM) data. For example, segmentation analysis (using analysis of variance) is used to understand differences across key customer groups. Driver analysis (using correlational analysis) is conducted to help identify the business areas responsible for customer dis/loyalty. These types of analyses are so commonplace that some Enterprise Feedback Management (EFM) vendors include these sorts of analyses in their automated online reporting tools. While these analyses provide good insight, there is still much more you can learn about your customers as well as your CEM program with a different look at your data. We will take a look at reliability analysis.
How Free Bets Became a Standard Feature of Australian Bookmakers According FreeBets
The Australian sports betting market has undergone a dramatic transformation over the past two decades, shifting from a landscape dominated by on-course bookmakers and TAB outlets to a fiercely competitive online environment where promotional offers have become central to how operators attract and retain customers. Among the most visible of these promotions is the free bet — a mechanism that allows new or existing customers to place wagers without risking their own funds. What began as an occasional marketing experiment in the early 2000s has since evolved into an industry standard, deeply embedded in the commercial logic of every licensed bookmaker operating in Australia. Understanding how this happened requires looking at the regulatory environment, the technology that enabled it, and the economic pressures that made free bets not just attractive but effectively mandatory for any operator hoping to compete.
The Regulatory and Market Conditions That Created Space for Free Bets
Australia’s betting industry is governed at the state and territory level, with each jurisdiction maintaining its own licensing framework. This fragmented structure, while often criticised for creating inconsistencies, had an unintended consequence in the late 1990s and early 2000s: it allowed the Northern Territory to position itself as a low-tax, permissive licensing hub that attracted a wave of corporate bookmakers. Entities such as Centrebet and Sportsbet established operations in Darwin and took advantage of the NT’s comparatively light-touch regulatory environment to offer services nationally via telephone and, eventually, the internet. The Interactive Gambling Act of 2001 was introduced at the federal level to restrict online casino-style gaming, but it explicitly carved out sports betting and racing, leaving the pathway open for online bookmakers to expand aggressively.
The arrival of major British operators changed the competitive dynamic significantly. Bet365 entered the Australian market around 2011, bringing with it a promotional culture that had been refined over years of intense competition in the UK market, where free bets had been commonplace since at least the late 1990s. William Hill followed, as did Betfair, which had already established an Australian exchange licence. These operators arrived with substantial capital reserves and a willingness to spend heavily on customer acquisition. Australian-founded bookmakers quickly recognised that matching these promotional offers was not optional — it was a condition of survival. By 2013 and 2014, free bet offers had become a standard feature of the sign-up process for virtually every licensed operator in the country.
The point of consumption tax reforms that began rolling out from 2017 onwards, starting with South Australia’s 15% POC tax, added further pressure. As operators faced higher tax burdens on revenue generated from Australian customers regardless of where the bookmaker was licensed, margins tightened. Paradoxically, this did not reduce the prevalence of free bets. Instead, operators became more sophisticated about how they structured these offers, tying them to minimum odds requirements, wagering turnover conditions, and specific product types to ensure that the cost of each promotion was offset by the long-term value of the customer being acquired.
How Free Bet Mechanics Evolved to Reflect Australian Betting Habits
Early free bet offers in Australia were relatively blunt instruments. A new customer would deposit a minimum amount, place a qualifying bet, and receive a free bet token of equivalent or fixed value. The structure borrowed heavily from what British operators had developed, but it did not always translate cleanly to Australian preferences. Australian bettors have historically shown a strong preference for racing — thoroughbred, harness, and greyhound — alongside AFL, NRL, and cricket. The free bet products that gained the most traction were those tailored to these sports, offering same-race multi options, first-goal scorer markets, and money-back specials on specific racing events.
The mechanics became considerably more nuanced over time. Operators introduced concepts such as the “bonus bet” — a term used more commonly in Australia than “free bet” — which functioned similarly but often returned only the winnings rather than the full stake plus winnings. This distinction matters enormously to bettors calculating the real value of an offer, and it became a point of differentiation that comparison platforms began addressing in earnest. Resources that aggregate and explain these offers, such as those indexed at https://www.free-bets-online.com, reflect how the market for information around betting promotions has grown in parallel with the promotions themselves, giving bettors tools to evaluate what is actually being offered rather than simply accepting the headline figure.
The introduction of multi-bet insurance offers, odds boost promotions, and cash-back deals further expanded the promotional ecosystem beyond the original free bet concept. By 2018 and 2019, Australian bookmakers were running weekly promotions tied to specific sporting events — a free bet for every goal scored in a particular NRL match, a money-back offer if a horse finished second, a profit boost on accumulator bets during the AFL finals series. These event-linked promotions required sophisticated CRM systems to manage at scale and represented a significant operational investment, but they also generated measurable spikes in betting activity that justified the cost from a commercial perspective.
Wagering requirements attached to free bets also became more standardised during this period. Most operators settled on a single-turnover requirement for bonus bets — meaning the customer needed to place the bonus bet once before any winnings could be withdrawn — which was considerably more generous than the multi-rollover requirements common in online casino promotions. This relative simplicity made free bets genuinely attractive to recreational bettors and helped cement their reputation as a legitimate entry point into a new bookmaker’s platform rather than a cynical retention trap.
The Role of Responsible Gambling Legislation in Shaping Promotional Practices
The relationship between free bets and responsible gambling has been a source of ongoing tension in Australian policy discussions. The 2017 Review of Illegal Offshore Wagering, conducted by former New South Wales Premier Barry O’Farrell, made several recommendations that touched on promotional practices, though its primary focus was on reducing the flow of Australian betting activity to unlicensed offshore operators. The review acknowledged that competitive domestic promotions, including free bets, played a role in keeping bettors within the licensed, regulated environment rather than seeking out offshore alternatives that operated with no consumer protections whatsoever.
However, subsequent legislative changes introduced restrictions that directly affected how free bets could be marketed. The Broadcasting Services Amendment (Online Gambling) Act 2018 tightened restrictions on gambling advertising during live sports broadcasts, limiting the windows in which operators could promote their services to television audiences. The restrictions on in-play commentary and live odds promotion were extended, and while free bet offers were not banned outright, the channels through which they could be communicated to potential customers were significantly narrowed. This pushed operators toward digital marketing, email campaigns, and affiliate partnerships as the primary means of distributing promotional offers.
State-level initiatives added further complexity. New South Wales introduced a mandatory pre-commitment framework for online betting accounts, and operators were required to implement deposit limits and loss limit tools across their platforms. Victoria’s gambling regulator, the Victorian Gambling and Casino Control Commission, increased scrutiny of promotional communications to ensure that free bet offers were not being directed at customers who had self-excluded or who had set responsible gambling limits that would make the offer inappropriate. These requirements placed additional compliance burdens on operators but also forced a degree of professionalisation in how promotions were designed and targeted.
The National Consumer Protection Framework for Online Wagering, agreed upon by all Australian states and territories in 2018 and progressively implemented through 2019 and 2020, introduced a prohibition on the use of credit for gambling and established the National Self-Exclusion Register, known as BetStop, which launched fully in August 2023. These measures did not eliminate free bets, but they fundamentally changed the context in which they operated. Operators were now required to check customers against the exclusion register before allowing them to access promotional offers, adding a layer of verification that had not previously existed. The practical effect was to make free bets a feature of the regulated, compliant betting experience rather than a tool that could be used indiscriminately.
The Economics of Free Bets and Their Long-Term Market Impact
From a purely economic standpoint, free bets represent a customer acquisition cost that operators calculate against the projected lifetime value of the customer being acquired. The mathematics are well understood within the industry: if a bookmaker offers a $200 free bet to a new customer, the actual cost to the operator depends on the odds at which the bet is placed and the house margin embedded in those odds. At a typical 5% margin, a $200 free bet placed on a market with standard pricing costs the operator approximately $190 in expected value terms, accounting for the probability that the bet wins. This is a substantial upfront investment, but it is justified if the customer goes on to bet regularly over months or years.
The data that Australian operators have accumulated over more than a decade of running these promotions has allowed them to refine their targeting significantly. Early free bet campaigns were broad — any adult who opened an account received the offer regardless of their likely betting behaviour. By the mid-2010s, operators were using behavioural data to identify which acquisition channels produced the most valuable long-term customers. Customers acquired through sports content partnerships, for example, tended to bet more regularly and on a wider range of markets than those acquired through pure price comparison channels. This insight drove changes in how free bet budgets were allocated, with operators directing more spend toward contextual placements alongside sporting content and less toward generic display advertising.
The competitive pressure created by free bets has also had structural effects on the market. Smaller operators without the capital to sustain large promotional budgets have found it increasingly difficult to compete. The Australian market consolidated significantly between 2015 and 2023, with Sportsbet (owned by Flutter Entertainment) and TAB (under various ownership structures, most recently Entain) emerging as the dominant players by market share. Mid-tier operators such as Unibet and PointsBet have maintained meaningful market positions but have done so by differentiating on product quality and niche market depth rather than attempting to outspend the market leaders on promotional offers. This pattern mirrors what occurred in the UK market a decade earlier, suggesting that free bets, while initially a tool of market disruption, ultimately accelerate consolidation by favouring operators with the deepest pockets.
FreeBets, as an organisation that tracks and analyses betting promotions across multiple markets including Australia, has documented how the structure of offers has changed in response to these economic pressures. The trend toward more conditional free bets — those tied to specific events, minimum odds, or product types — reflects operators’ attempts to reduce the cost of each promotion while maintaining its perceived value to the customer. A free bet that can only be used on a same-game multi with minimum odds of 3.00 is considerably cheaper for the operator to fund than an unrestricted free bet of the same face value, because the conditions attached reduce the probability of the customer extracting full value from the offer.
The integration of free bets into loyalty and rewards programs represents the most recent evolution of this promotional model. Rather than offering free bets exclusively as a sign-up incentive, operators including Sportsbet and TAB have embedded them into ongoing loyalty schemes that reward consistent betting activity with periodic bonus credits. This approach reduces the sharp spike in cost associated with mass acquisition campaigns and distributes the promotional expense more evenly across the customer lifecycle. It also creates a stronger retention incentive, since customers who are accumulating loyalty points toward a free bet reward have a reason to continue using the same platform rather than switching to a competitor.
The trajectory of free bets in the Australian market illustrates a broader truth about competitive online industries: what begins as a differentiating feature rapidly becomes a baseline expectation. Australian bettors in 2024 approach a new bookmaker with the assumption that a sign-up offer will be available, and the absence of such an offer is itself a competitive disadvantage. The specific form that free bets take will continue to evolve in response to regulatory changes, technological developments, and shifting consumer preferences, but their position as a structural feature of the Australian betting market appears secure for the foreseeable future. The challenge for regulators and operators alike is ensuring that this remains a feature of a responsible, transparent industry rather than a mechanism that undermines the consumer protections that have been painstakingly built up over the past decade.
Reliability Analysis
To understand reliability analysis, you need to need to look at your customer feedback data through the eyes of a psychometrician, a professional who practices psychometrics. Psychometrics is the science of educational and psychological measurement and is primarily concerned with the development and validation of measurement instruments like questionnaires. Psychometricians apply scientifically accepted standards when developing/evaluating their questionnaires (please see Standards for Educational and Psychological Testing). One important area of focus for psychometricians relates to reliability.
Figure 1. Data model for inter-rater reliability analysis
Reliability
Reliability refers to the consistency/precision of a set of measurements. There are four different types of reliability: 1) inter-rater reliability, 2) test-retest reliability, 3) parallel-forms reliability and 4) internal consistency reliability. Each type of reliability is focused on a different type of consistency/precision of measurement. Each type of reliability is indexed on a 0 (no reliability) to 1.0 (perfect reliability) scale. The higher the reliability index (closer to 1.0) , the greater the consistency/precision in measurement.
Inter-rater Reliability
Inter-rater reliability reflects the extent to which Contacts within an Account give similar ratings. Typically applied in a B2B setting, inter-rater reliability is indexed by a correlation coefficient between different Contacts within each Account across all Accounts (see Figure 1 for the data model to conduct this analysis). We do expect the ratings from different Contacts from the same Account to be somewhat similar; they are from the same Account after all.
A low inter-rater reliability could reflect a poor implementation of the CEM program across different Contacts within a given Account. However, a low inter-rater reliability is not necessarily a bad outcome; a low inter-rater reliability could simply indicate: 1) little or no communication between Contacts within a given Account, 2) different Contacts (Business-focus vs. IT-focus) have different expectations regarding your company/brand or 3) different Contacts have different experiences with your company/brand.
Figure 2. Data model for test-retest reliability analysis
Test-retest Reliability
Test-retest reliability reflects the extent to which customers give similar ratings over a non-trivial time period. Test-retest reliability is typically indexed by a correlation coefficient between the same raters (customers) across two different time periods (See Figure 2 for the data model to conduct this analysis). This reliability index is used as a measure of how stable customers’ attitudes are over time. In my experience analyzing customer relationship surveys, I have found that customers’ attitudes tend to be somewhat stable over time. That is, customers who are satisfied at Time 1 tend to be satisfied at Time 2; customers who are dissatisfied at Time 1 tend to be dissatisfied at Time 2.
A high test-retest reliability could be a function of the dispositional tendency of your customers. Research finds that some people are just more negative than others (see negative affectivity). This negative-dispositional tendency impacts all aspects of these people’s lives. Some customers are just positive people and will tend to rate things positively (including survey questions); others, who are more negative, will tend to rate things negatively. However, a high test-retest reliability could indicate that customers are simply receiving the same customer experience over time. A low test-retest reliability could reflect an inconsistent service delivery process over time.
Parallel-forms Reliability
Parallel-forms reliability reflects the extent to which customers give similar ratings across two different measures that assess the same thing. For practical reasons, this form of reliability is not typically examined for CEM programs as companies have only one customer survey they administer to a particular customer. Parallel-forms reliability is typically indexed by a correlation coefficient between the same raters (customers) completing two different measures (given at the same time).
Figure 3. Data model for internal consistency reliability analysis
Internal Consistency Reliability
Internal consistency reliability reflects the extent to which customers are consistent in their ratings over different questions. This type of reliability is used when examining a composite score that is made up of several questions. This type of reliability tells us if each question that makes up the composite score measures the same thing. Internal consistency reliability is typically indexed by Cronbach’s alpha.
We expect a relatively high degree of internal consistency reliability for our composite scores (above .80 is a good standard). A low internal consistency reliability indicates that our composite score is likely made up of items that should not be combined together. We always strive to have a high internal consistency reliability for our composite customer metrics. Customer metrics with high internal consistency reliability are better at distinguishing people on the continuum of whatever it is you are measuring (e.g., customer loyalty, customer satisfaction). When a relationship between two variables (say, customer experience and customer loyalty) exists in our population of customers, we are more likely to find a statistically significant result using reliable customer metrics compared to unreliable customer metrics.
Applications of Reliability Analysis
Companies conduct reliability analysis on their CEM-generated data for several reasons. These include:
- Validate the customer feedback process: When CEM data are used for important business decision (e.g., resource allocation, incentive compensation), you need to demonstrate that the data reflect real customer perceptions about important areas.
- Improve account management: Reliability analysis can help you understand the extent of agreement between different Contacts within the same Account. Your account management strategy will likely be different depending on the agreement between Contacts within Accounts. Should each relationship be managed separately? Should you approach the Accounts with a strong business or IT focus?
- Create/Evaluate customer metrics: Oftentimes, companies use composite scores (average over several questions) as a key customer metric. Reliability analysis will help you understand which questions can/should be combined together for your customer metric.
- Modify surveys: Reliability analysis can help you identify which survey questions can be removed without loss of information; Additionally, reliability can help you group questions together that make the survey more meaningful to the respondent.
- Test popular theories: Reliability analysis has helped me show that the likelihood to recommend question (NPS) measures the same thing as overall satisfaction and likelihood to buy again. – see True Test of Loyalty. That is why the NPS is not better than overall satisfaction or continue to buy in predicting business growth.
- Evaluate newly introduced concepts into the field: One of my biggest pet peeves in the CEM space is the introduction of new metrics/measures without any critical thinking behind the metric and what it really measures. For example, I have looked into the measurement of customer engagement via surveys and found that these measures literally have the exact same questions as our traditional measures of customer loyalty (e.g., recommend, buy again, overall satisfaction (please see Gallup’s Customer Engagement Overview Brochure for an example). Simply giving a different name to a set of questions does not make it a new variable. In fact, Gallup says nothing about the reliability of their Customer Engagement instrument.
Summary
Establishing the quality of CEM data requires specialized statistical analysis. Reliability reflects the degree to which your CEM program generates consistent results. Assessing different types of reliability provide different types of insight about the quality of your CEM program. Inter-rater reliability indicates whether different Contacts within Accounts give similar feedback. Test-retest reliability indicates whether customers (Contacts) give similar ratings over time. Internal consistency reliability indicates whether your aggregated score (averaged over different questions) makes statistical sense. Assessing the reliability of the data generated from your CEM program needs to be an essential part of your program to ensure your program delivers reliable information to help senior executives make better, customer-centric business decisions.
Companies rely on different types of statistical analyses to extract information from their Customer experience management (CEM) data. For example, segmentation analysis (using analysis of variance) is used to understand differences across key customer groups. Driver analysis (using correlational analysis) is conducted to help identify the business areas responsible for customer dis/loyalty. These types of analyses are so commonplace that some Enterprise Feedback Management (EFM) vendors include these sorts of analyses in their automated online reporting tools. While these analyses provide good insight, there is still much more you can learn about your customers as well as your CEM program with a different look at your data. We will take a look at reliability analysis.
Beyond the Ultimate Question
Measuring Customer Satisfaction and Loyalty (3rd Ed.)
[…] recently wrote about assessing the reliability of customer experience management (CEM) programs. Reliability refers to the degree to which your CEM program delivers consistent results. There are […]
[…] data, you are able to evaluate customer metrics along two criteria: 1) Reliability and 2) Validity. Reliability refers to measurement precision/consistency. Validity is concerned with what is being measured. […]
[…] data, you are able to evaluate customer metrics along two criteria: 1) Reliability and 2) Validity. Reliability refers to measurement precision/consistency. Validity is concerned with what is being measured. […]