How We Review Pokies — Our Testing Methodology Explained
Transparency matters. When we recommend a pokie or a casino, we want you to know exactly how we arrived at that recommendation. This page details our complete review methodology — the specific steps, criteria, and standards we apply to every pokie and every casino before it appears on BarberBoats.
Our approach is built on first-hand experience, verifiable data, and a commitment to honesty. We deposit real money, play real games, and process real withdrawals. No casino can pay for a positive review or a higher ranking.
Our Pokie Review Process
Step 1: RTP Verification
Before we play a single spin, we verify the pokie's Return to Player (RTP). We check the RTP displayed in the game's information menu at the casino where we are testing, then cross-reference this with the provider's officially published RTP on their corporate website. Any discrepancy between in-game RTP and published RTP is flagged in our review and investigated with the casino.
This step catches casinos that use lower RTP configurations without clear disclosure — a practice that disadvantages players without their knowledge. We also note which RTP configuration a casino uses when multiple are available (common with Pragmatic Play and some other providers).
Step 2: Minimum 200-Spin Test Sessions
Every pokie we review receives a minimum of 200 spins during our testing session. For high-profile games, new releases, or pokies with complex bonus mechanics, we extend to 500+ spins. During each session, we record:
- Total spins completed
- Total wagered
- Total returned (wins)
- Number of winning spins (for hit frequency calculation)
- Number of bonus triggers
- Largest single win
- Longest dry spell (consecutive losing spins)
- Session duration
- Bet level used
We use consistent bet levels across reviews to enable fair comparison. Our standard test bet is NZ$1 per spin, with adjustments for extreme volatility games where smaller bets are more appropriate.
Step 3: Volatility Assessment
While providers often state volatility ratings, we independently verify this through our test sessions. We compare the observed hit frequency, win distribution, and maximum win achieved against the provider's claims. If our experience significantly deviates from the stated volatility, we note this in the review.
We also assess how the volatility feels in practice. A pokie rated "medium" by the provider that plays like high volatility during testing gets flagged. Subjective feel matters to players as much as mathematical classification.
Step 4: Bonus Feature Testing
Every bonus feature in the pokie is triggered and documented during our review. This includes:
- Free spins rounds — Trigger conditions, number of spins, multiplier behaviour, retrigger possibility
- Bonus games — Mechanics, potential payouts, randomness verification
- Special features — Buy-bonus options, gamble features, mystery symbols, cascading/tumbling reels
- Feature frequency — How often we triggered each feature in our test sessions (noting that this is an observed sample, not a guarantee)
If a bonus feature does not trigger naturally during our test session, we either extend the session or use the buy-bonus feature (if available) to experience and document the mechanics. We disclose which method was used.
Step 5: Visual and Audio Quality Assessment
We evaluate the production quality of each pokie:
- Graphics quality — Resolution, animation smoothness, symbol clarity, overall art direction
- Sound design — Soundtrack quality, win celebration sounds, ambient audio, mute option availability
- Theme execution — How well the visual and audio elements support the pokie's theme
- User interface — Clarity of bet controls, paytable accessibility, autoplay options, spin speed settings
Step 6: Mobile Testing
Every pokie is tested on both iOS (iPhone 15) and Android (Samsung Galaxy S24) devices. We assess:
- Load time — Measured in seconds from tap to playable state
- Touch responsiveness — Spin button, bet adjustments, menu navigation
- Screen layout — Symbol visibility, button sizing, information accessibility in both portrait and landscape modes
- Performance — Frame rate during animations, battery drain during extended play
- Feature parity — Whether all desktop features are available on mobile
Step 7: Casino Availability Check
We verify which NZ-friendly casinos offer the pokie, and we check whether the RTP configuration differs between casinos. This information helps NZ players find the best place to play each game.
Step 8: Responsible Gambling Features
We check whether each pokie includes built-in responsible gambling features:
- Does the game display session time?
- Does it show total wagered/won/lost?
- Can autoplay be limited by spins, loss, or win thresholds?
- Is the RTP clearly displayed in the game information?
- Does the paytable clearly explain the game's mechanics?
Step 9: Documentation and Scoring
We take screenshots throughout our testing to document our findings. Every reviewed pokie receives scores across six categories:
| Category | Weight | What We Assess |
|---|---|---|
| RTP/Value | 25% | RTP rating, house edge, RTP transparency |
| Gameplay | 25% | Volatility accuracy, hit frequency, bonus feature quality |
| Design | 15% | Graphics, sound, theme execution, UI |
| Mobile | 15% | Mobile performance, layout, touch controls |
| Max Win Potential | 10% | Maximum win multiplier, jackpot availability |
| Availability | 10% | Number of NZ casinos offering the game |
The weighted scores combine to produce our overall rating out of 10. Each review publishes the "last played" date, confirming when our most recent test session occurred.
Our Casino Review Process
Casino reviews follow an equally rigorous process:
Licence Verification
We verify the casino's licence number directly with the issuing authority (MGA, UKGC, DIA, or Curaçao eGaming). We do not rely on the casino's own claims — we check the regulator's public register. Any casino whose licence cannot be independently verified is not reviewed.
Real Money Testing
We make genuine deposits using our own funds (not casino-provided test accounts). We play across multiple game types, process real withdrawals, and time the entire experience. Our standard test involves:
- NZ$100 initial deposit
- Playing 200+ spins across at least 5 different pokies
- Requesting a withdrawal and timing the process to receipt
- Contacting customer support with a genuine query
- Testing the casino on both desktop and mobile
Bonus Term Analysis
We read every line of the bonus terms and conditions. We calculate the real-world value of each bonus based on wagering requirements, time limits, game contributions, and maximum bet restrictions. Our bonus ratings reflect actual value to players, not headline numbers.
Quarterly Re-Testing
Every recommended casino is re-tested quarterly. We make a fresh deposit, play, and withdraw to ensure standards are maintained. Any casino that shows declining quality — slower payouts, changed bonus terms, reduced game selection, or customer support issues — is downgraded or removed from our recommendations.
What We Will Not Do
- Accept payment for reviews: No casino can buy a review, influence a rating, or pay for a higher ranking position
- Use casino-provided test accounts: We deposit our own money to ensure we experience the same process as real players
- Recommend unlicensed casinos: No licence, no review. Period.
- Hide affiliate relationships: Every page that links to casinos includes an affiliate disclosure
- Guarantee outcomes: We never imply that any pokie or casino guarantees wins. All gambling involves risk of loss.
Our Team
Reviews are conducted by James Mitchell, Senior Casino Analyst, with over 8 years of experience in the NZ online gambling industry. James is a former compliance officer at a licensed NZ gambling operator, bringing first-hand regulatory knowledge to every review. He holds certifications in responsible gambling advocacy and maintains active accounts at every casino we recommend for ongoing monitoring.
Frequently Asked Questions
How many spins do you play when testing a pokie?
Minimum 200 spins per review. High-profile games receive 500+ spins. Every session is documented with complete win/loss data.
Do you use real money when testing?
Yes. Every casino review involves real money deposits, play, and withdrawals using our own funds.
How do you verify RTP?
We cross-reference in-game RTP with provider-published data. Any discrepancy is flagged and investigated.
Do you test on mobile?
Yes — iPhone (iOS) and Android testing for every pokie and casino review.
How often do you update reviews?
Casino reviews are re-tested quarterly. Pokie reviews are updated when providers release game updates. Every review displays its last updated date.
Are your reviews independent?
Yes. Affiliate commissions do not influence rankings. Casinos cannot pay for positive reviews or higher placement.
Contact Us
If you have questions about our methodology, want to report an issue with a casino or pokie we have reviewed, or believe we have published inaccurate information, please contact us. We investigate every report and update our content accordingly.