The Mismatch Between Clinical Trials and Psychological Care
The prevailing architecture of medical validation relies on the Randomized Controlled Trial (RCT) as the gold standard for determining efficacy. While this model is indispensable for pharmacology and medical devices, its application to psychotherapy has created a systemic misalignment. In the effort to quantify the success of “talking therapies” using the same metrics as pharmaceutical interventions, the healthcare system has prioritized standardization over the fluid, relational nature of psychological treatment.
This approach treats therapy as a static delivery of a product rather than a dynamic process shaped by context, culture, and individual history. By forcing psychotherapy into the rigid structure of a pill-based trial, the industry risks validating a version of treatment that exists only in a controlled laboratory setting, rather than one that functions in the complex environment of a clinic, a community mental health service, or a primary-care referral pathway.
For policymakers and regulators, this matters because funding formulas, national clinical guidelines, and insurance reimbursement schedules are increasingly built on RCT hierarchies of evidence. When the underlying model does not match the reality of care, the risk is not just academic distortion; it is systematic under-serving of the very populations mental health systems claim to prioritise.
The Conflict of Manualization and Real-World Practice
To satisfy the requirements of an RCT, therapists must often follow a strict manual-a step-by-step guide that ensures every participant receives the exact same intervention. This process of manualization strips therapy of its inherent flexibility, which is often the primary driver of patient improvement, particularly for people whose difficulties are entwined with trauma, poverty, discrimination, or chronic illness.
In actual clinical settings, the vast majority of practitioners do not adhere to a single, rigid protocol. Instead, they employ an eclectic or integrative approach, blending various theoretical frameworks to meet the specific needs of the individual and to respond to events in patients’ lives as they occur. Supervisors, clinical leads and service managers typically assess therapists on their capacity to formulate cases, to adjust pace and method, and to work safely with risk-not on their ability to recite a manual.
| Trial-Based Therapy (RCT) | Real-World Practice (“In the Wild”) |
|---|---|
| Strict adherence to a predetermined manual | Eclectic, formulation-driven integration of multiple therapeutic schools |
| Highly controlled, homogeneous patient groups | Patients with complex, overlapping comorbidities and shifting life circumstances |
| Standardized dosage and duration of sessions | Flexible pacing, intensity, and duration based on risk, response, and preference |
| Focus on a single, isolated symptom | Holistic focus on life context, relationships, and systemic stressors |
The tension between these two models is profound. The discrepancy is similar to a different drug being prescribed by pharmacies than the drug tested during RCTs-but with far less visibility, because “the product” in psychotherapy is the relationship, not a molecule. When health systems mandate that only “evidence-based” treatments-those proven in RCTs-be reimbursed or provided, they are often prescribing a sanitized version of therapy that differs fundamentally from how skilled clinicians operate, while still holding those clinicians accountable for outcomes in the real world.
Institutional Pressure and the Diversity Gap
The reliance on RCTs has significant implications for public health policy and healthcare access. In systems such as the UK’s National Health Service (NHS) or Medicare in Australia, the push toward “evidence-based” care has led to the dominance of a few highly manualized therapies, most notably Cognitive Behavioural Therapy (CBT). These approaches are then embedded in national pathways, waiting-time targets and commissioning contracts, giving them a structural advantage over equally credible but less easily manualized therapies.
This institutional preference creates a narrow funnel of care. Because RCTs require strict inclusion and exclusion criteria to minimize “noise” in the data, they frequently exclude individuals who do not fit a neat clinical profile. Many of those excluded-people with substance use, personality disorder diagnoses, severe social adversity, or ongoing safety concerns-are the very patients who appear most frequently in public systems.
This leads to several systemic failures in population-level mental health care:
- Exclusion of Complexity: Patients with multiple diagnoses or severe comorbidities are often left out of trials, meaning the “proven” treatments may not be effective for the most vulnerable populations, yet these same treatments are written into contracts and guidelines as default care.
- Cultural Erasure: Strict protocols often fail to account for cultural nuances in how distress is expressed and processed, limiting the diversity of validated treatments and, in practice, narrowing what counts as “legitimate” suffering in multicultural societies.
- Rigid Access: Patients are often steered toward a specific therapy because it is the only one the system recognizes as “proven,” regardless of whether that therapy aligns with the patient’s personal goals, history, language, or experience of discrimination.
This systemic bias suggests that RCTs, as currently deployed, do not truly test whether therapy works in the environments where most people seek help. Instead, they test whether something that has been heavily altered to fit the shape of RCTs works under narrow conditions-and then allow that result to cascade into funding, commissioning and workforce training decisions.
Regulatory Implications for Healthcare Systems
The drive for quantifiable evidence is understandable from a regulatory and economic standpoint. Payers and government health bodies require predictable outcomes to manage budgets and ensure a baseline of quality. In many jurisdictions, mental health benefits are anchored in statutory or regulatory frameworks-such as the mental health parity rules embedded in the United States’ Social Security Act-that require public justification for what is, and is not, funded.
However, when the tool used for measurement (the RCT) is ill-suited for the subject (psychotherapy), the resulting policy can be counterproductive. An over-reliance on “manualised or nothing” evidence risks turning flexible, person-centred services into narrow delivery platforms for a small set of branded protocols, even when front-line data from clinics suggest that blended or adapted approaches work better for certain groups.
The current regulatory environment often mistakes efficacy-the performance of a treatment under ideal, controlled conditions-for effectiveness, which is how a treatment performs in the real world. By prioritizing efficacy, health systems may be inadvertently reducing the quality of care by discouraging clinicians from using their professional judgment in favor of a manual, and by disincentivizing services from investing in locally adapted models that do not easily translate into RCTs but do produce measurable improvements in employment, housing stability, or reduced hospitalisation.
To bridge this gap, there is a growing need for a diversified evidence framework. Moving toward public health standards that incorporate real-world evidence, patient-reported outcome measures, and longitudinal observational studies would allow for a more inclusive and accurate understanding of what constitutes effective mental health care. A number of national quality bodies and health technology assessment agencies are already experimenting with such approaches in other areas of medicine; extending that thinking to psychotherapy would mean evaluating not only symptom reduction but also functioning, safety, equity and patient choice.
Without this shift, the gap between clinical research and clinical reality will continue to leave many patients underserved by the very systems designed to heal them-and will leave policymakers making high-stakes decisions about mental health budgets, workforce planning and digital care on the basis of evidence that only partially reflects how therapy actually works.
