Beta Testing Research Methodology
Complete transparency about how we measure what works.
The Simple Version
We're testing The Burnout Edit with real users over 6 months total and tracking what actually changes in their lives.
What We Studied
Key Findings
76% Recovery Success Rate
76% of beta participants met pre-defined criteria for meaningful recovery (significant improvement in burnout AND better daily functioning).
Compared to: 31% recovery rate in published studies of generic wellness apps
68% Sustained Improvement
Of those who recovered by month 4, 68% still showed maintained improvements 2 months later.
Why this matters: Many interventions show short-term effects that fade. Sustained improvement suggests real skill-building.
64% Energy Increase
On average, participants reported 64% increase in daily energy levels from baseline to 6 months.
Example: Energy rating improving from 30/100 (exhausted) to 49/100 (moderate-good energy)
58% Relationship Improvement
58% improvement in relationship quality - feeling more connected, less strained, more able to be present with loved ones.
Why this matters: Burnout often destroys relationships. Recovery that includes relational healing is more comprehensive.
How We Measured "Recovery"
We didn't just ask if people "felt better" - we used composite measures requiring multiple criteria
Recovery Success Criteria
Participants must meet at least 3 of 4 criteria:
Why this approach: Single measures can be misleading. Someone might feel slightly better but still be unable to function. Our composite ensures "recovery" means real, multi-dimensional improvement.
What We Used to Measure
Burnout Assessment Tool (BAT-12)
Validated 12-item scale used in research across 7 countries. Measures exhaustion, mental distance, and impairment.
Energy Levels
Weekly 0-100 visual scale tracking morning, afternoon, and evening energy patterns.
Relationship Quality Index
6-item validated scale measuring support, connection, and satisfaction across relationships.
Work Functioning
6-item questionnaire assessing work capacity, performance, and satisfaction.
Strengths & Limitations
Scientific honesty means acknowledging what we did well AND where we have constraints
Strengths
Prospective Design
Followed people forward over time (not just a one-time survey)
Validated Measures
Used peer-reviewed, scientifically validated assessment tools
Follow-up Tracking
Tracked people 2 months after the 4-month program to see if changes lasted
Composite Outcomes
Measured real functional improvement, not just feelings
Pre-specified Criteria
Defined "success" before analyzing data (no cherry-picking)
Limitations
Not a Randomized Controlled Trial
No random assignment to different groups - participants self-selected
Historical Comparison
Compared to published data, not a concurrent control group
Self-selection Bias
Beta participants may be more motivated than general population
Self-reported Outcomes
All measures are participant self-report (no objective biomarkers yet)
Preliminary Findings
Results should be considered initial evidence, not definitive proof
What We're Doing About Limitations
- ✓ Full transparency about methodology and constraints
- ✓ Clear acknowledgment of what we can and can't claim
- ✓ Planning for future randomized controlled trial
- ✓ Considering independent replication
- ✓ Adding objective measures (heart rate variability, cortisol) in future studies
What You Should (and Shouldn't) Conclude
Reasonable Conclusions
You can reasonably conclude:
- ✓ The Burnout Edit shows promising preliminary results
- ✓ Personalized, nervous system-based approaches may be more effective than generic wellness apps
- ✓ Many participants experienced meaningful, sustained improvement
- ✓ The approach appears to work across multiple life domains (energy, relationships, work)
Claims We're NOT Making
We are NOT claiming:
- ✗ This "proves" the approach works (need RCT for that)
- ✗ Everyone will get these results (24% didn't meet recovery criteria)
- ✗ This cures burnout permanently (ongoing practice needed)
- ✗ This replaces therapy or medical treatment
- ✗ Results are guaranteed
The Scientific Reality
Science is progressive: It builds over time through multiple studies and replication.
This beta study is: One step in an ongoing research program, preliminary evidence supporting the approach, transparent about strengths and limitations, and a foundation for future rigorous testing.
Our commitment: We will continue to increase research rigor, seek independent validation, and update our understanding as new data emerges.
What's Next in Our Research
Ongoing Analysis
- • Continue tracking beta participant outcomes
- • Analyze subgroup differences (who benefits most?)
- • Gather qualitative feedback for improvements
Enhanced Studies
- • Conduct larger-scale study with control group
- • Add objective measures (heart rate variability, cortisol)
- • Validate custom assessment tools
- • Seek independent replication
Rigorous Validation
- • Randomized controlled trial with academic partnership
- • Peer-reviewed publication in scientific journal
- • Expand to diverse populations
- • Understand mechanisms of change better
Questions or Want More Details?
Our Commitment to Research Integrity
We pledge transparency, honesty, rigor, ethics, and humility in all our research. We will publish full methodology (not just positive findings), report negative and null findings, use validated measures, prioritize participant welfare, acknowledge limitations, and update understanding as new data emerges.