Testing & Methodology
Testing isn't just unboxing and writing opinions. Every product goes through 20+ hours of hands-on testing, 60-90 days of long-term evaluation, and rigorous measurement protocols before we publish a review.
1Our Testing Philosophy
The Core Principle
We test products the way you'll actually use them — not in idealized conditions, but in real kitchens, with realistic water quality, using standard coffee beans, and dealing with the same frustrations and learning curves you will.
What Makes Our Testing Different
- ✓We buy every product — ensuring zero manufacturer bias
- ✓Minimum 20 hours hands-on — not quick unboxing reviews
- ✓60-90 day long-term testing — catching issues that only appear after weeks of use
- ✓Laboratory-grade measurements — temperature accuracy to ±0.1°C, TDS consistency testing
- ✓Blind comparison tests — eliminating brand bias
- ✓Multiple reviewer verification — consensus-based scoring
2The 100-Point Scoring System
Every product is evaluated using our standardized 100-point system, broken into six weighted categories:
| Category | Weight | What We Measure |
|---|---|---|
| Brew Quality | 30 pts | Temperature stability, extraction consistency, taste results |
| Consistency | 20 pts | Repeatability, shot-to-shot variance, reliability over time |
| Ease of Use | 20 pts | Learning curve, workflow efficiency, cleaning requirements |
| Build Quality | 15 pts | Materials, construction, durability, component quality |
| Value | 10 pts | Price-to-performance ratio, long-term ownership costs |
| Features | 5 pts | Innovation, programmability, versatility |
Total: 100 points → Converted to our 5-star rating (0.1-star precision)
90-100 pts = 5.0★ (Exceptional) | 80-89 pts = 4.0-4.9★ (Excellent) | 70-79 pts = 3.0-3.9★ (Good)
3Espresso Machine Testing Protocol
Performance Testing (30 points)
Temperature Stability
- Install K-Type thermocouples at group head
- Measure temperature across 50 consecutive shots
- Record variance from target (typically 200°F / 93°C)
- Target: ±1°F (±0.5°C) variance maximum
Extraction Consistency
- Pull 50 espresso shots with identical parameters (18g dose, 36g yield, 25-30 seconds)
- Measure TDS (total dissolved solids) for each shot
- Calculate coefficient of variation
- Target: <5% TDS variance
Pressure Profiling & Steam Performance
- Install pressure gauge at group head
- Verify advertised pressure specifications (Target: 9 bars ±0.5 bars)
- Time to steam 150ml of milk to 140°F (Target: <60 seconds)
- Microfoam quality assessment
Consistency Testing (20 points)
- •Shot-to-Shot Repeatability: Pull 20 shots across 5 days, measure extraction time and yield variance
- •Warm-Up Consistency: Test first shot vs. 10th shot performance
- •Long-Term Reliability: 60-90 day daily use tracking, performance degradation measurement
Ease of Use & Build Quality (35 points)
Ease of Use (20 pts)
- • Learning curve timing
- • Workflow efficiency tests
- • Daily cleaning time
- • Backflushing complexity
Build Quality (15 pts)
- • Boiler material assessment
- • Body construction quality
- • Portafilter quality
- • Durability testing
4Coffee Grinder Testing Protocol
Grind Quality Testing (30 points)
Particle Size Distribution
- Sieve testing with multiple mesh sizes (400μm, 500μm, 600μm, etc.)
- Measure fines production (<200μm particles)
- Assess boulder production (>1000μm particles)
- Target: Unimodal distribution, minimal fines/boulders
Grind Consistency & Range
- Grind 20 identical 18g doses, measure weight accuracy
- Visual inspection of particle uniformity
- Test grind range from espresso (fine) to French press (coarse)
- Measure grind chamber temperature before/after (Target: <10°F increase)
Retention & Build Quality
- Measure coffee retained in grinder after grinding
- Burr quality assessment (ceramic, steel, titanium-coated)
- Motor power, noise and vibration levels
- Body construction and stability
5Testing Equipment & Tools
Laboratory Equipment
Temperature Measurement
- • Fluke digital thermometers (±0.1°C accuracy)
- • K-Type thermocouples for continuous monitoring
- • Infrared thermometers for surface temperatures
Extraction Analysis
- • VST LAB Coffee III Refractometer (espresso)
- • Atago PAL-COFFEE TDS refractometer
- • Precision scales (0.1g resolution)
Pressure & Flow
- • Scace 2 pressure profiler
- • Digital pressure gauges
- • Flow rate measurement tools
Grind Analysis
- • Kruve coffee sifter system
- • Digital microscope (particle imaging)
- • Retention measurement protocols
6Long-Term Testing (60-90 Days)
Why Long-Term Matters
Many issues only emerge after weeks of use: component wear and failure, gasket degradation, performance drift, long-term cleaning impacts, and real-world durability.
Testing Protocol
- ✓Daily use tracking: Performance metrics logged daily, maintenance documented
- ✓30-Day re-test: Repeat initial tests, compare against baseline
- ✓60-90 Day re-test: Final performance verification, rating adjustment if needed
Real Example: We've downgraded products from 4.5 to 3.8 stars after long-term testing revealed persistent pressure consistency issues after 60 days of daily use.
7Review Update Policy
Scheduled Updates
- ✓Quarterly reviews of all active products
- ✓Annual comprehensive re-testing of flagship products
Triggered Updates
- ✓New competitor launches in category
- ✓Price changes >10%
- ✓Widespread quality control issues reported
8Limitations & Disclosures
What We Can't Test
- ✗20-year durability — We assess build quality and research long-term user experiences
- ✗Every unit variation — We test individual units, noting when QC variance is reported
- ✗Every coffee type — We use standardized samples but note performance characteristics
We address these by: Researching user reports for QC issues, testing with multiple coffee styles when relevant, clearly noting our testing context, and incorporating reader feedback into updates.
Learn More About Our Process
Last Updated: January 2026
We review and update our testing methodology annually to incorporate new equipment and refine protocols based on reader feedback.
Questions About Our Methodology?
We're transparent about our process because trust requires understanding. Want more details on a specific testing protocol or have suggestions for improvement?
Contact: Get in Touch
Response Time: Typical response within 24–48 business hours.