Qualitative study: burden of menopause-associated vasomotor symptoms (VMS) and validation of PROMIS Sleep Disturbance and Sleep-Related Impairment measures for assessment of VMS impact on sleep

This was not an intervention study testing a treatment. Instead, the researchers tested two things:

**Concept elicitation:** They conducted open-ended interviews to understand exactly how menopause-related hot flashes and night sweats (vasomotor symptoms, or VMS) affect sleep and daily functioning. They wanted to know what women experience, in their own words.

**Content validity testing:** They then asked women to complete two standardized sleep questionnaires—the PROMIS Sleep Disturbance short form and the PROMIS Sleep-Related Impairment short form—and interviewed them about whether the questions made sense, covered their experience, and were easy to answer.

The goal was to determine whether these existing sleep questionnaires are appropriate tools for measuring sleep problems specifically caused by menopause-related VMS, rather than sleep problems from other causes like insomnia, pain, or anxiety.

**Total sample:** 32 postmenopausal women

**US subsample:** 16 women recruited from Texas and Illinois

**EU subsample:** 16 women recruited from the United Kingdom and France

**Age range:** 40–64 years (all postmenopausal)

**Inclusion criteria:** Experiencing moderate to severe VMS, defined as ≥35 hot flashes or night sweats per week (that is, at least 5 per day on average)

**Exclusion criteria:** Women with other known causes of sleep disruption (e.g., diagnosed sleep apnea, chronic pain conditions, psychiatric disorders) were not explicitly excluded, but the screening focused on women whose primary complaint was VMS

**Setting:** In-person qualitative interviews conducted at clinical research sites

The study used qualitative methods, not quantitative scales with numerical scores. The measurement tools were:

**Semi-structured interview guide (concept elicitation):** Open-ended questions such as "Tell me about your hot flashes" and "How do your hot flashes affect your sleep?" Follow-up probes asked about frequency, severity, duration, and impact on daily life.

**PROMIS Sleep Disturbance short form (8 items):** Measures perceived sleep quality, depth, and restoration over the past 7 days. Items include "My sleep was restless" and "I had difficulty falling asleep." Responses use a 5-point Likert scale (1 = Not at all, 5 = Very much).

**PROMIS Sleep-Related Impairment short form (8 items):** Measures daytime sleepiness and functional impairment due to poor sleep over the past 7 days. Items include "I had trouble staying awake during the day" and "I felt sleepy during the daytime." Same 5-point response scale.

**Cognitive debriefing interview:** After completing each questionnaire, women were asked: "Was this question easy or hard to answer?" "Did the 7-day recall period work for you?" "Were the response options clear and distinct?" "Did this questionnaire capture your experience with VMS-related sleep problems?"

**Study design:** Cross-sectional, qualitative interview study. This is an observational design, not an experiment. There was no intervention, no control group, no randomization, and no blinding.

**Why this design matters:** The researchers chose qualitative interviews because they were trying to understand the *lived experience* of VMS-related sleep disruption and to validate whether existing questionnaires capture that experience. You cannot determine whether a questionnaire is asking the right questions by running a randomized trial—you need to talk to people and hear their perspectives. This is called "content validity" and is a required step before a questionnaire can be used as a primary outcome measure in clinical trials.

**What the design can prove:**

It can establish that VMS-related sleep disruption is a real, bothersome phenomenon experienced by most women with frequent hot flashes.

It can identify the specific ways VMS disrupts sleep (e.g., waking from sweating, difficulty returning to sleep, next-day fatigue).

It can demonstrate that the PROMIS sleep measures are understandable, relevant, and acceptable to this population.

**What the design cannot prove:**

It cannot prove that VMS *causes* sleep disruption in a causal sense (though the temporal relationship is strongly suggestive—women report waking up during a hot flash).

It cannot quantify the magnitude of sleep disruption (e.g., how many minutes of sleep are lost per night).

It cannot compare VMS-related sleep disruption to sleep disruption from other causes.

It cannot test whether any treatment improves VMS-related sleep.

It cannot generalize to women with mild VMS (fewer than 35 per week) or to women who are perimenopausal rather than postmenopausal.

**Duration:** Each interview was a single session, lasting approximately 60–90 minutes. There was no follow-up, no longitudinal tracking, and no repeated measures.

**Statistical approach:** None. This is a purely qualitative study. Data were analyzed using thematic analysis—transcripts were coded for recurring themes, and the frequency of each theme was reported as percentages (e.g., "75% of US women said sleep disturbance was the most bothersome aspect of VMS"). No p-values, confidence intervals, or effect sizes were calculated.

**Major methodological weaknesses:**

**Small sample size:** 32 women total, split across two geographic regions. This limits the range of experiences captured.

**No quantitative sleep measurement:** The study relied entirely on self-report. No actigraphy, no polysomnography, no sleep diaries. Women's reports of "difficulty returning to sleep" could not be verified objectively.

**Recall bias:** Women were asked to remember their experiences over the past 7 days. Memory is imperfect, especially for sleep quality.

**Selection bias:** Women who agreed to participate in a 90-minute interview about their hot flashes may be those with the most severe symptoms or the strongest opinions.

**No comparison group:** Without a group of women without VMS, we cannot know whether the sleep problems reported are unique to VMS or common to all postmenopausal women.

**Impact of VMS on sleep (concept elicitation):**

**94% of women (30 out of 32)** reported that VMS affected their sleep. This was consistent across both US (93.8%) and EU (93.8%) samples.

**Sleep disturbance was the most bothersome aspect of VMS** for 75% of US women and 50% of EU women. This means that for the majority of women, the sleep disruption from night sweats was worse than the hot flashes themselves.

**Specific sleep disruptions reported:**

- Waking from sleep due to sweating or overheating (reported by nearly all women who said VMS affected sleep)

- Difficulty returning to sleep after a night sweat episode (reported by the majority)

- Needing to change clothes or bedding during the night (common theme)

- Feeling "drenched" or "soaked" upon waking

- Sleep becoming lighter and more fragmented over the course of the night

**Next-day consequences of VMS-related sleep disruption:**

- Reduced work productivity (reported by most employed women)

- Impaired mood (irritability, frustration, low mood)

- Strained relationships (with partners, family, coworkers)

- Difficulty concentrating and making decisions

- Reduced participation in social activities (due to fatigue)

- Negative impact on physical health (feeling "run down," more susceptible to illness)

**Content validity of PROMIS sleep measures (cognitive debriefing):**

**Relevance:** All 32 women found both PROMIS sleep measures relevant to their experience. The Sleep Disturbance measure was rated as "most relevant" by the majority.

**Comprehensibility:** All items were rated as easy to understand. No women reported confusion about wording or meaning.

**Recall period:** Women had no difficulty remembering their sleep experiences over the past 7 days. The 7-day window was considered appropriate—long enough to capture typical patterns, short enough to avoid forgetting.

**Response options:** Women found the 5-point scale (Not at all, A little bit, Somewhat, Quite a bit, Very much) to have distinct, meaningful categories. No one reported wanting more or fewer options.

**Missing content:** A few women noted that the questionnaires did not specifically ask about night sweats or hot flashes. However, they felt the general sleep questions (e.g., "My sleep was restless") adequately captured the VMS-related sleep disruption they experienced.

Because this is a qualitative study, there are no numerical effect sizes (no Cohen's d, no mean differences, no odds ratios). The "effect" here is the prevalence and perceived severity of VMS-related sleep disruption:

**94% of women with ≥35 VMS per week report sleep disruption.** This is an extraordinarily high prevalence. For context, in the general population of postmenopausal women, about 40–60% report some sleep problems. In this sample of women with frequent VMS, the rate is nearly double that.

**75% of US women and 50% of EU women say sleep disruption is the *most* bothersome aspect of their menopause.** This means that for a majority, the night sweats are worse than the daytime hot flashes. This is a clinically important finding because it suggests that treatments for VMS should be evaluated primarily on their ability to improve sleep, not just reduce hot flash frequency.

**The PROMIS Sleep Disturbance measure was rated as "most relevant"** by the majority. This suggests that the experience of VMS-related sleep disruption is better captured by questions about sleep quality (restlessness, difficulty falling/staying asleep) than by questions about daytime sleepiness (trouble staying awake, feeling sleepy during the day).

**Acknowledged by authors:**

Small sample size (n=32) limits generalizability

Cross-sectional design cannot establish causality

Qualitative data cannot be quantified for statistical comparison

Findings may not apply to women with mild VMS (fewer than 35 per week)

Findings may not apply to perimenopausal women (only postmenopausal women were included)

**Additional critical limitations:**

**No objective sleep measurement:** The study relied entirely on self-report. Women may overestimate or underestimate their sleep disruption. Without actigraphy or polysomnography, we cannot know how many minutes of sleep are actually lost per night.

**No comparison group:** Without a control group of postmenopausal women without VMS, we cannot determine whether the sleep problems reported are specific to VMS or are part of normal age-related sleep changes.

**Recall bias:** The 7-day recall period, while deemed appropriate by participants, is still subject to memory errors. Women may remember their worst nights more vividly than their average nights.

**Selection bias:** Women who volunteer for a 90-minute interview about hot flashes may have more severe symptoms or stronger opinions than the average woman with VMS.

**Cultural limitations:** The study included only US and EU women (all Western, likely predominantly white). Findings may not generalize to women from other cultural backgrounds who may experience or report VMS differently.

**Industry funding:** The study was funded by a pharmaceutical company (the authors are employees of Astellas Pharma, which develops VMS treatments). While the qualitative methods are robust, industry funding can introduce subtle bias in study design, interpretation, or reporting.

**No assessment of comorbidities:** The study did not systematically assess or exclude women with other sleep disorders (sleep apnea, restless legs syndrome), depression, anxiety, or chronic pain—all of which can independently disrupt sleep.

For someone running their own n=1 experiment to understand or improve VMS-related sleep:

**What to test:**

Test any intervention that claims to reduce hot flash frequency or severity: hormone therapy (estrogen, progesterone), non-hormonal medications (gabapentin, pregabalin, SSRIs/SNRIs), lifestyle changes (cooling sheets, layered bedding, dietary changes, exercise), or supplements (black cohosh, soy isoflavones, vitamin E).

Specifically test the intervention's effect on *night sweats* and *sleep quality*, not just daytime hot flashes.

**Minimum meaningful duration:**

Run the experiment for at least 2–4 weeks. VMS frequency can vary day-to-day and week-to-week. A shorter duration may capture random variation rather than a true effect.

If testing a medication, follow the prescribing guidelines (some medications take 2–4 weeks to reach steady-state levels).

**What to measure (specific metrics):**

**Primary outcome:** Night sweat frequency per night (count each episode where you wake up sweating or feeling overheated). Record this immediately upon waking.

**Secondary outcomes:**

- Time to return to sleep after a night sweat episode (minutes)

- Total sleep time (hours per night)

- Sleep quality rating each morning (1–10 scale, 10 = best)

- Daytime sleepiness (Epworth Sleepiness Scale, or a simple 1–10 rating each evening)

- Hot flash frequency during the day (to compare with night sweat frequency)

**Use the PROMIS Sleep Disturbance short form** (available free online at healthmeasures.net) at baseline and at the end of each week. This is the measure validated in this study and is sensitive to VMS-related sleep disruption.

**Use the PROMIS Sleep-Related Impairment short form** to track daytime consequences.

**Key confounds to control for:**

**Room temperature:** Keep your bedroom temperature consistent throughout the experiment. A difference of even 2–3°F can affect night sweat frequency. Use a thermometer and log the temperature each night.

**Bedding and sleepwear:** Use the same bedding and sleepwear throughout the experiment. Switching from flannel to cotton sheets could confound results.

**Alcohol and caffeine:** Both can trigger hot flashes and disrupt sleep. Keep intake consistent, or better yet, eliminate both during the experiment.

**Stress:** Stress increases hot flash frequency. Log your daily stress level (1–10) and note any major stressful events.

**Time of year:** Seasonal temperature changes affect night sweats. Run the experiment during a single season if possible.

**Other medications:** Any new medications, supplements, or herbal remedies could affect VMS or sleep. Keep everything constant.

**Menstrual cycle (if still cycling):** If you are perimenopausal and still having periods, track cycle phase. Hot flashes can vary with estrogen fluctuations across the cycle.

**What a positive result would look like:**

A reduction in night sweat frequency of at least 30–50% (e.g., from 5 per night to 2–3 per night). This is the threshold used in clinical trials for VMS treatments.

A reduction in the time to return to sleep after a night sweat (e.g., from 30 minutes to 10 minutes).

An increase in total sleep time of at least 30–60 minutes per night.

An improvement in PROMIS Sleep Disturbance score of at least 3–5 points (on the T-score metric, where 50 is the population average and 10 points = 1 standard deviation).

A consistent pattern over at least 2 weeks, not just a few good nights.

**Important caveat:** This study did not test any treatment. It only validated that sleep disruption is a major problem for women with VMS and that the PROMIS sleep measures are appropriate tools to measure it. If you are considering hormone therapy or other medications, consult a healthcare provider. Self-experimentation with hormones carries risks that are beyond the scope of this wiki page.