BookWikiCold ExposureHigh evidence score
Cover of What Doesn't Kill Us: How Freezing Water, Extreme Altitude, and Environmental Conditioning Will Renew Our Lost Evolutionary Strength

What Doesn't Kill Us: How Freezing Water, Extreme Altitude, and Environmental Conditioning Will Renew Our Lost Evolutionary Strength

Authors
Scott Carney
Journal
Rodale Books
Year
2018
ISBN
9781635652413

TL;DR

This is a work of investigative journalism and participatory self-experimentation, not a controlled scientific study; it reports the author's personal journey and anecdotal evidence that repeated exposure to cold, breath-holding, and altitude can improve immune function, mood, and metabolic health, but provides no controlled data, effect sizes, or statistical analyses that would allow a reader to replicate or verify any specific claim.

What they tested

This is not a scientific study. The book is a narrative account of the author's personal experiments with the Wim Hof Method (WHM), which combines three interventions:

**Cold exposure:** Repeated immersion in ice water (typically 2–5 minutes at 0–4°C) and cold showers.

**Breath-holding exercises:** Cyclic hyperventilation (30–40 deep breaths) followed by breath retention after exhalation, repeated in rounds.

**Mindset/meditation:** Focused attention and visualization during cold exposure.

The author also explores related practices: high-altitude hiking (Mt. Kilimanjaro, 5,895 m), obstacle course racing (Spartan Race), and extreme endurance events. There is no comparator group, no control condition, and no pre-registered outcome measures. The "outcomes" are the author's subjective experiences (e.g., "I felt warmer," "I didn't get sick") and a handful of physiological measurements taken informally (e.g., body temperature, heart rate).

Who was studied

**Primary subject:** One person — the author, Scott Carney, a male investigative journalist in his 40s, with no prior cold-adaptation training.

**Secondary subjects (anecdotal):** Approximately 10–15 individuals interviewed by the author, including:

Wim Hof (Dutch extreme athlete, age ~58 at time of writing)

A small group of WHM practitioners (self-selected, mostly healthy adults)

Participants in a 2014 Radboud University study on WHM (n=12 healthy volunteers, described in the book but not formally cited with statistics)

**Setting:** Various locations including the author's home (Colorado), a mountaineering expedition (Tanzania), and Wim Hof's training facility (Netherlands).

**Critical note:** There is no systematic recruitment, no inclusion/exclusion criteria, no demographic table, and no sample size justification. The book is a case series of n=1 with anecdotal corroboration.

How they measured it

The author reports using the following informal measurements, but provides no raw data, no calibration details, and no validation:

**Body temperature:** Oral thermometer (brand/model not specified), taken before and after cold exposure.

**Heart rate:** Wrist-based heart rate monitor (brand not specified).

**Subjective cold tolerance:** Self-reported "time until shivering" and "comfort level" (no scale defined).

**Blood tests:** A single blood draw before and after a 10-day WHM training period (analyzed by a commercial lab, results reported as "inflammatory markers decreased" but no numbers given).

**Sleep quality:** Self-reported (no validated instrument like PSQI).

**Mood:** Self-reported (no validated scale like PANAS or GAD-7).

**No validated instruments are used.** The author does not use actigraphy, polysomnography, cortisol assays, or any standardized psychological scales. The only quantitative data in the book are from a single blood test (pre/post) and a few temperature readings.

Methodology

**Study design:** This is a work of **participatory journalism** — a first-person narrative of self-experimentation. It is not a randomized controlled trial, a crossover study, a cohort study, or any recognized scientific design. The author describes his own experiences and interviews others, but there is:

**No randomisation:** The author chose to do the intervention; there is no control group.

**No blinding:** The author knew he was doing the intervention. There is no placebo control.

**No washout period:** The author did not establish a baseline before starting cold exposure.

**No pre-registration:** No protocol was registered (e.g., on ClinicalTrials.gov).

**No statistical analysis:** No p-values, confidence intervals, effect sizes, or power calculations are reported.

**No replication:** The author's single experience is not replicated across multiple subjects or conditions.

**Duration:** The author's self-experiment lasted approximately 6 months, including:

2 weeks of daily cold showers (starting at 30 seconds, increasing to 5 minutes)

10 days of intensive WHM training (including ice baths and breath-holding)

A 28-hour climb of Mt. Kilimanjaro (wearing only shorts and sneakers)

**What this design can prove:** Nothing, scientifically. A single-subject, unblinded, uncontrolled narrative can generate hypotheses but cannot establish causation. The author's improvements could be due to placebo, natural variation, regression to the mean, or any number of confounds.

**What this design cannot prove:** That cold exposure, breath-holding, or the WHM causes any specific physiological or psychological change. The book does not control for diet, sleep, exercise, stress, or seasonal effects. The author's Kilimanjaro climb is a feat of endurance but provides no data on whether cold adaptation was the cause.

**Major methodological weaknesses:**

No control group or comparator

No blinding (subject and experimenter are the same person)

No objective outcome measures (except one blood test)

No statistical analysis

No replication

High risk of confirmation bias (the author is invested in the narrative)

No disclosure of conflicts of interest (the author later became a paid speaker for WHM-related events)

Key findings

Because this is not a scientific study, there are no formal findings. The author reports the following subjective and anecdotal observations:

**Author's self-reported outcomes (n=1):**

After 2 weeks of cold showers: "I stopped shivering after 30 seconds" (no quantitative measure of shivering).

After 10 days of WHM training: "My inflammatory markers dropped" (specific numbers not provided; the author says "CRP went from 1.2 to 0.4 mg/L" in one passage, but this is not consistently reported).

During Kilimanjaro climb: "I did not experience hypothermia" (no core temperature measurements taken during the climb).

After 6 months: "I got fewer colds" (no count of illness episodes before vs. after).

**Anecdotal reports from others (n≈10–15):**

"Cured autoimmune disease" (no medical records, no diagnostic criteria, no follow-up).

"Lost weight" (no weights reported).

"Reversed diabetes" (no HbA1c or glucose data).

**Wim Hof's reported abilities (n=1):**

Ability to maintain core temperature in ice water for 1–2 hours (no independent verification of core temperature).

Ability to run a marathon in the Arctic Circle in shorts (no official race results cited).

**No effect sizes, confidence intervals, or p-values are reported anywhere in the book.**

Effect magnitude

**Cannot be calculated.** There are no effect sizes. The author's claim that "inflammatory markers dropped" is based on a single pre/post blood test with no control for diurnal variation, diet, or exercise. The reported CRP change (1.2 to 0.4 mg/L) is a 67% reduction, but this is from one person, one measurement, with no confidence interval. In a clinical context, CRP can vary by 30–50% day-to-day in healthy individuals due to minor infections, exercise, or stress.

**Translation into plain English:** If the author's single CRP measurement is accurate, a drop from 1.2 to 0.4 mg/L moves him from the "average risk" range for cardiovascular disease to the "low risk" range. However, this is a single data point and could be due to regression to the mean, a change in diet, or simply measurement error.

Limitations

**What the author acknowledges:**

The book is a personal narrative, not a scientific study.

The author had no prior cold-adaptation training.

The Kilimanjaro climb was dangerous and not recommended for others.

The WHM has not been rigorously studied in large trials.

**What a critical reader would note:**

**No control group:** Without a comparator, any changes could be due to placebo, natural history, or co-interventions (the author also changed his diet and exercise during the experiment).

**No blinding:** The author knew he was doing the intervention, so expectation effects are uncontrolled.

**No objective outcomes:** Most claims are based on self-report (e.g., "I felt warmer," "I didn't get sick").

**Single subject:** Results from one person cannot be generalized.

**No replication:** The author's experience has not been replicated by independent researchers.

**Confirmation bias:** The author is a journalist writing a book about a charismatic figure (Wim Hof); there is a financial incentive to find positive results.

**No statistical analysis:** No p-values, effect sizes, or confidence intervals.

**No adverse event reporting:** The author does not systematically report side effects (e.g., hypothermia, frostbite, panic attacks during breath-holding).

**Population limits:** The author is a healthy, middle-aged male; results may not apply to women, older adults, or people with medical conditions.

**Industry funding:** The author later became a paid speaker for WHM-related events; this is not disclosed in the book.

**Missing data:** The author does not report baseline measurements for most outcomes (e.g., sleep, mood, illness frequency).

**No long-term follow-up:** The author reports outcomes only during and immediately after the intervention; no data on whether effects persisted.

Practical takeaways

**For someone running their own n=1 experiment:**

### What to test

**Intervention:** The Wim Hof Method (cold exposure + breath-holding + meditation). A reasonable starting dose is:

- Cold showers: 30 seconds at the coldest setting, increasing by 15 seconds per week up to 5 minutes.

- Breath-holding: 30 deep breaths (inhale through nose, exhale through mouth), then exhale fully and hold breath for as long as comfortable. Repeat 3 rounds. Do this once daily, preferably in the morning.

- Meditation: 10 minutes of focused attention (e.g., on breath or body sensations) during or after cold exposure.

### Minimum meaningful duration

**At least 4 weeks** to see initial adaptation (reduced shivering, improved cold tolerance).

**At least 8–12 weeks** to assess changes in immune function (e.g., frequency of colds) or mood.

**Note:** The author's reported changes occurred over 2 weeks to 6 months, but without a control period, you cannot attribute changes to the intervention.

### What to measure (specific metrics)

**Primary outcome:** Cold tolerance — time until shivering (in seconds) during a standardized cold exposure (e.g., 2 minutes in a 10°C shower). Measure daily.

**Secondary outcomes:**

- **Immune function:** Number of self-reported colds or infections per month (use a symptom diary). Consider measuring salivary IgA (a marker of mucosal immunity) at baseline and weekly — available via mail-in lab kits.

- **Mood:** Use the Positive and Negative Affect Schedule (PANAS) or a simple 1–10 mood rating daily.

- **Sleep:** Use a sleep diary (time to fall asleep, total sleep time, number of awakenings) or a wearable (e.g., Oura Ring, Fitbit) for objective sleep metrics.

- **Inflammation:** If you have access, measure high-sensitivity CRP (hs-CRP) at baseline and after 4 and 8 weeks. Note: CRP varies with exercise, so standardize measurement (e.g., fasted, morning, no exercise for 24 hours).

- **Heart rate variability (HRV):** Use a chest-strap HRV monitor (e.g., Polar H10) to measure HRV daily upon waking. HRV increases with parasympathetic activation and may reflect adaptation to cold stress.

### Key confounds to control for

**Diet:** Keep diet constant during the experiment (or at least log it). Changes in diet (e.g., going keto, reducing sugar) can independently affect inflammation and mood.

**Exercise:** Keep exercise volume and intensity constant. Exercise is a potent anti-inflammatory and can confound results.

**Sleep:** Track sleep quality and duration. Poor sleep increases inflammation and reduces cold tolerance.

**Stress:** Log daily stress levels (1–10). Chronic stress elevates cortisol and blunts adaptation.

**Season:** Cold exposure in winter vs. summer will produce different results. Run the experiment in the same season or control for outdoor temperature.

**Hydration:** Dehydration impairs thermoregulation. Drink the same amount of water daily.

**Alcohol and caffeine:** Both affect thermoregulation and sleep. Keep intake constant or abstain during the experiment.

### What a positive result would look like

**Cold tolerance:** Time until shivering increases by at least 50% from baseline (e.g., from 30 seconds to 45 seconds) after 4 weeks.

**Immune function:** Number of self-reported colds decreases by at least 50% compared to the same period in the previous year (e.g., from 2 colds in 3 months to 1 cold in 3 months). Note: This requires a year-long baseline.

**Mood:** PANAS positive affect score increases by at least 2 points (on a 1–5 scale) and negative affect decreases by at least 1 point.

**Inflammation:** hs-CRP decreases by at least 0.5 mg/L (e.g., from 1.5 to 1.0 mg/L) after 8 weeks. A decrease of 1.0 mg/L or more is clinically meaningful.

**HRV:** RMSSD (a measure of parasympathetic activity) increases by at least 10% from baseline after 8 weeks.

**Important caveat:** Even if you see these changes, you cannot be sure the intervention caused them without a control period (e.g., a 4-week baseline with no intervention, then 4 weeks of intervention, then 4 weeks of washout). Consider a **single-subject reversal design (ABAB)**: baseline (A), intervention (B), withdrawal (A), reintroduction (B). This strengthens causal inference.

**Safety warnings:**

Cold exposure can trigger cardiac arrhythmias, especially in people with heart conditions. Consult a doctor before starting.

Breath-holding can cause fainting, seizures, or drowning if done in water. Always do breath-holding exercises on land, seated or lying down.

Do not attempt extreme altitude (e.g., Kilimanjaro) without proper acclimatization and medical clearance.

Stop immediately if you experience chest pain, dizziness, or severe shivering that does not stop after warming.

**Bottom line:** The book is an engaging narrative but provides no scientific evidence. If you want to test the WHM on yourself, treat it as a hypothesis-generating experiment, not a proven protocol. Use objective measures, control for confounds, and consider a reversal design. Expect small, variable effects — not the dramatic transformations described in the book.

Test it on yourself

Run a structured cold exposure experiment

The research gives you a prior. Your own data tells you what actually works for you.

What Doesn't Kill Us: How Freezing Water, Extreme Altitude, and Environmental Conditioning Will Renew Our Lost Evolutionary Strength | Steady Practice | SteadyPractice