Home »
Archives
A Q&A with Leonard Jason on case definition
By David Tuller, DrPH
Leonard Jason is a professor of psychology at DePaul University in Chicago. He has served as vice president of the International American Association of CFS/ME and as chairperson of the Research Subcommittee of the U.S. Chronic Fatigue Syndrome Advisory Committee. Professor Jason began investigating chronic fatigue syndrome almost 30 years ago. Much of his work has focused on the epidemiology and prevalence of the illness and on the impact of using various case definitions. He has long been concerned that the lack of a uniform set of criteria for identifying study participants has hindered progress in the science.
Dr. Jason recently shared his thoughts about these issues. (This Q-and-A has been edited for clarity and length.)
How common is fatigue?
If you were to ask people right now if they are “fatigued,” which means feeling weak, tired, or lacking energy, about 25% of the population would say yes, so this symptom is very common. In contrast, “chronic fatigue” means that a person has had fatigue for 6 or more months. Only about 4-5% of the population has chronic fatigue.
There are multiple reasons for people to be fatigued–for example depression, anxiety, over-exertion, people working three jobs, medications, sleep deprivation, weight problems, poor diet, inactivity, and deconditioning. These are just a few of the many causes of fatigue and chronic fatigue.
Physicians see lots of people coming into their practices, where the patients are seeking help for their fatigue, and in fact it is one of the most common reasons for seeing a doctor. But it’s very hard for many physicians to differentiate complaints of general or chronic fatigue versus the illness known as ME [myalgic encephalomyelitis]. Yet it is of critical importance to make a differential diagnosis between those with purely chronic fatigue versus those who have ME. In fact, it is this failure to differentiate these two conditions that has caused so many problems, and the culprit is a flawed and imprecise case definitions as well as failures to gain an international consensus for one research case definition.
So what is a case definition, and why are there different research and clinical definitions?
A case definition is a set of rules that helps a researcher or a clinician make a decision about whether someone has a particular illness or does not have the illness. It’s that simple. A good case definition is critical for the assessment process, to identify those people who actually have an illness or disease. It is the cornerstone of medicine.
A research case definition tries to identify a homogeneous group of people who have the illness and can be recruited for research purposes. In contrast, a clinical case definition is used to identify or diagnose a broader group of patients for treatment purposes, and many of these wouldn’t qualify for research studies. For example, if someone is very obese, a research case definition might exclude that person because the weight issue could be causing the person’s problems. In other words, for research purposes, we want to select only patients who do not have other psychological or medical conditions that could be causing the illness we are studying.
For science to progress, the research case definition is critical, as it can standardize the selection of patient samples so that research groups around the world are all studying the patients with the same disease. So gaining consensus among international scientists for a research case definition is a most critical task, and one that unfortunately has still not been accomplished for our field.
One of the parameters that’s important for a research case definition for this illness, in your view, is that psychiatric co-morbidities should be excluded. Can you explain the reason for that?
Yes, and let me give an example that illustrates this issue. A patient with a major depressive disorder with melancholic features would probably have fatigue, aches and pains, as well as sleep and cognitive problems. Yet these are also symptoms of ME, so some clinicians and researchers could easily confuse these two conditions. But they are very different illnesses, as people with a major depressive disorder feel self-reproach, whereas those with ME do not. If you ask people with a major depressive disorder what they would do tomorrow if they were well, they would not be sure. In contrast, if you asked people with ME what they would do if they were well, they’d give you a long list of all the things they have wanted to do but been unable due to their illness.
If you are studying ME, you need to exclude people who have a primary psychiatric disorder from your study. If researchers misclassify people with a major depressive disorder as having ME, this will have serious negative consequences for identifying biomarkers, estimating prevalence rates, and determining outcomes of treatment trials. The issue of selecting patients who really have ME is the most important issue facing our field. In a sense, the lack of a consensus on a ME research case definition is like building a pyramid of playing cards with a very shaky bottom, and then everything built on top of this foundation is vulnerable to collapsing.
Let’s start with what is the broadest case definition that has been used, the so-called Oxford criteria for CFS. Can you describe that and explain why it presents a problem?
If you have six or more months of fatigue, then you meet this case definition, so it’s a very broad category. Clearly, as I mentioned earlier, a lot of people who meet this criteria have medical or lifestyle reasons causing their fatigue. One of my students, Madison Sunnquist, just published her master’s thesis that indicated how the CBT theoretical model only works if you identify people with a very wide case definition, but when you have a better and more restricted case definition that requires core symptoms of ME, then the CBT model no longer works. In contrast to the CBT approach, my research group for the past 20 years has been doing research on what we call the energy envelope. But this pacing approach is not a cure, just a strategy to help better cope with ME. Our approach involves helping patients to better monitor their energy levels, learn how to stay within their energy envelope, and sustain lifestyle changes that involve reprioritizing activities.
So how did the CDC come up with the Holmes and then the Fukuda case definitions?
The Holmes case definition came out in 1988. The CDC investigators had gone to Incline Village and ultimately named this illness CFS. Their first case definition included too many symptoms. In fact, to meet their case definition, a patient would have needed to have eight or more symptoms out of a list of 11. But here is the problem that soon emerged–if you develop a case definition that requires so many unexplained somatic symptoms, you have a very high probability of unwittingly selecting people who have a somatoform disorder. And you don’t want to select people who have a purely psychiatric condition.
So in 1994, the Fukuda case definition was developed to replace the Holmes definition. For the 1994 case definition, the authors selected eight of the symptoms that had been listed in the Holmes criteria, and a patient needed to have any four of those eight symptoms to meet the new Fukuda case definition.
But here is the problem with the Fukuda CFS case definition–patients are not required to have post-exertional malaise, cognitive problems and unrefreshing sleep, and as we know, these are core symptoms of ME. So, a person could have four of the eight Fukuda symptoms and be diagnosed with CFS, and not have any of the three critical symptoms. In that case, you would be including in your sample a person who does not have the core elements of the illness.
From 1994 and on, I have been doing research that shows some of the diagnostic problems with the Fukuda case definition. And remember, the Fukuda case definition is the research case definition that has been used throughout the world for the past 25 years. But this Fukuda case definition identifies a heterogenous group of patients, because core symptoms are not required of all patients. So, as a consequence, samples of patients with CFS based on Fukuda case definition vary widely in different research groups and labs.
What is the impact of the case definitions on prevalence rates?
In the late 1980s and early 1990s, the CDC conducted a prevalence study where they started by asking physicians in four cities to identify patients they thought had CFS. At that time, a lot of physicians didn’t believe CFS existed, so putting physicians as gatekeepers in the selection of patients for this study resulted in a prevalence rate that was very low. Also, many people in the US do not have the financial resources to have a physician, so relying on primary care doctors to identify patients was another reason for low prevalence rates. The study suggested that CFS was a rare disease that affected fewer than 20,000 people in the US.
At that point, a group of researchers in Chicago began working on a study that involved finding patients from a random community sample, rather than a sample referred from physicians. In 1995, with NIH funding, our Chicago research team conducted a community-based prevalence study, which found that about a million people in the US had CFS. We also found that CFS affected all ethnic and socioeconomic groups, and thus we helped shatter the myth that CFS was a “Yuppie Flu” disease.
What did William Reeves [then-head of the CDC division in charge of the illness] do with the so-called “empiric” criteria? And why did this increase the CDC’s estimate of disease prevalence by a factor of 10?
In the early 2000s, Bill Reeves felt there was a need to operationalize the Fukuda case definition. For example, he tried to standardize the way we measure a patient’s disability or a substantial reduction in functioning. He used one instrument that has been referred to as the SF-36. According to Reeves, if a patient met criteria for one of several sub-scales within the SF-36, the patient would meet the disability criteria for having CFS.
But one of these domains was “role emotional” functioning. It turns out that every person with a major depressive disorder meets the criteria for “role emotional” functioning. So you can’t just specify instruments such as the SF-36; you have to specify which sub-scales of the instruments you are going to use, and what are the cut-off points. And if any of these choices are wrong, you will identify people who have another illness. My team gathered data on this point, and we conducted a study that assessed people with major depressive disorder, and found that over one-third of them could be inappropriately classified as having CFS under the so-called Reeves empiric criteria.
So, I think in the attempt to operationalize the Fukuda criteria, Reeves made mistakes, and I believe that is one of the reasons the estimated CDC prevalence estimates increased ten-fold, from .24% in a 2003 sample to 2.54% in 2007. They operationalized the Fukuda criteria in a way that classified many people as having CFS when they really had other illnesses.
At that time, many thought this increase in prevalence figures that Reeves proposed was constructive as it suggested that far more people had the illness, and thus these findings could be used to argue for more attention and funding due to this illness being so widespread. But if you use a very broad criteria, and bring into the illness case definition people who don’t have the disease, then the entire research effort is seriously compromised. Fortunately, over the past decade, few researchers have used the Reeves way of operationalizing CFS.
What about the CCC and ICC criteria?
The CCC case definition for ME/CFS in 2003 was better because it specified key symptoms such as PEM. It was developed as a clinical case definition, and now it’s being used by several teams as a research case definition. With the 2011 ME-ICC, I have noticed problems, and in part this is due to them once again requiring too many symptoms that could, as with the Holmes criteria of 1988, bring into the ME category some individuals who have a primary psychiatric disorder. In addition, the ME-ICC criteria is complicated to use, and many clinicians and scientists will have a difficult time reliably using it with patients.
What is the problem you see with the IOM case definition, apart from the name?
Well, it is true that Systemic Exertion Intolerance Disease (SEID) is a name most patients dislike. However, the IOM report was correct in requiring several core symptoms, such as PEM. But I believe these authors made a mistake in indicating that a patient could have either cognitive impairment or orthostatic intolerance—one or the other. Cognitive impairment should have been required for all patients to have. But a more serious problem is that they inadvertently expanded the case definition by having just about no exclusionary illnesses, such as primary psychiatric disorders. My team recently conducted a study where about half the people with a variety of medical and psychiatric illnesses met the IOM criteria.
Now the IOM criteria was developed as a clinical case definition, but there was no federal effort to develop a research criteria that selects a more homogenous group of patients. The failure to develop an international consensus on a research case definition means that many researchers will continue to use the problematic Fukuda case definition, or they might use the IOM clinical criteria to select patients for research purposes, and this process has already begun.
To summarize, for research purposes, if a person has the core symptoms of the IOM definition, it would be important to exclude those with a primary medical or psychiatric condition, but this is not what the IOM authors recommended. So, the clinical IOM case definition once again over-identifies people as having the illness. That means what occurred with the Reeves criteria of a decade ago has once again occurred with the IOM, as these criteria broaden the types of patients identified as having the illness.
What is at stake in this debate?
The stakes are high, for if you have an inappropriately wide case definition for research purposes, you will bring into your studies many fatigued people with a variety of conditions. In other words, if you identify the wrong patients, then your study will make conclusions about people who do not have ME, and you will have significant barriers to engaging in critical scientific activities such as estimating accurate prevalence rates or identifying biological markers. Also, if you bring in lots of people who don’t have this illness but lifestyle issues and/or a solely depressive disorder, a good percentage of them will respond favorably to psychogenically oriented treatments. As I have been writing about for many years, this will ultimately lead to some researchers making conclusions about CBT and GET that are not true for patients with ME.
My case is simple. You need to have one research case definition that is used by scientists throughout the world. The clinical case definition can be broader, but the research case definition has to be tightly focused on those with the illness so that results can be replicated in different laboratories. This scientific achievement has been accomplished with every illness or disease except for ME.
We can do better. After working in this area for almost three decades, I am confident that we have the tools and methods to use psychometrically sound procedures to develop a consensus on one research case definition. I am optimistic that one day this will occur, and for me, there is literally nothing as important for our scientific field.
Click here to visit the virology blog
Leonard A. Jason is a professor of clinical and community psychology at DePaul University, director of the Center for Community Research, and the author of Principles of Social Change and co-editor of the Handbook of Methodological Approaches to Community-Based Research: Qualitative, Quantitative, and Mixed Methods.
When sickness interrupts science
2018 (Jan. 10). Nature. Emily Sohn. When sickness interrupts science. How to balance a long-term illness and a research career.
Click here to read this article on Nature.com
FOCUS ON THE ESSENTIALS
Navigating a research career along with a chronic illness, say many researchers, requires zeroing in on what is most essential. Leonard Jason, a psychologist who was diagnosed in 1989 with myalgic encephalopathy/chronic fatigue syndrome (ME/CFS), realized that he needed to be strategic about his work and careful not to overtax himself. His approach has led to recognition, including awards for excellence in research and, at one point, a position on a US federal panel advising about research on ME/CFS. He recommends that scientists pursue the work that matters most to them. “The reality is that you can’t do it all,” says Jason, of DePaul University in Chicago, Illinois. “Prioritization is absolutely critical when one is in a diminished state. If it’s trivial and you don’t care about it, let it go.”
Leonard A. Jason is a professor of clinical and community psychology at DePaul University, director of the Center for Community Research, and the author of Principles of Social Change and co-editor of the Handbook of Methodological Approaches to Community-Based Research: Qualitative, Quantitative, and Mixed Methods.
A reboot for chronic fatigue syndrome research
2018 (Jan. 3). Nature. Amy Maxmen. A reboot for chronic fatigue syndrome research.
Click here to read this article on Nature.com
Research into this debilitating disease has a rocky past. Now scientists may finally be finding their footing.
In the 1990s, Leonard Jason, a psychology researcher at DePaul University in Chicago, Illinois, started questioning basic epidemiological information on ME/CFS. For one thing, the CDC described the syndrome as rare and predominantly affecting white women. But Jason reasoned that clinicians could be missing many cases. Those who were diagnosed were the ones most likely to return for a second, third or fourth medical opinion. And people who felt stigmatized, were confined to bed, were poor or had little social support might not go to such lengths to get a diagnosis.
So, Jason’s team called almost 30,000 random Chicago phone numbers to ask whether someone in the household had symptoms of the disorder. If they did, the team brought them into clinics for evaluation. As a result of the findings from this4 and other studies, the CDC removed the word ‘rare’ from its description of the syndrome. In 2015, a report5 from the US Institute of Medicine (IOM) estimated that 836,000 to 2.5 million Americans have the disorder. Another study6 estimated that more than 125,000 people in the United Kingdom are living with ME/CFS. And a report7 from Nigeria suggests that the prevalence of the disease might be even higher there, perhaps exacerbated by other infectious diseases and poor nutrition. But these tallies are fraught, owing to the different ways in which doctors diagnose the condition.
In many ways, people with ME/CFS remain invisible. Most have been dismissed by at least one physician. And society often ignores them, too. In the United States, financial pressures are common because health insurers might consider experimental treatments unnecessary, and employers might not feel that disability payments are justified. Even in countries where health care is a right, the situation has been dire. Many patient advocates say that UK government agencies have essentially treated ME/CFS as if it were a strictly psychological condition, a conclusion that they argue was bolstered by the PACE trial’s findings that exercise and cognitive behavioural therapy relieve symptoms. The National Health Service (NHS) recommended these interventions, even after many patients complained that exercise dramatically worsens their condition.
Epidemiologists have suggested that the anguish of contending with the disorder and society’s general dismissal of it contribute to an up to sevenfold increase in the rate of suicide for people with ME/CFS.
Leonard A. Jason is a professor of clinical and community psychology at DePaul University, director of the Center for Community Research, and the author of Principles of Social Change and co-editor of the Handbook of Methodological Approaches to Community-Based Research: Qualitative, Quantitative, and Mixed Methods.
Scientific progress stumbles without a case definition
Click here to read this article on the Oxford University Press Blog
“Current estimates from the Centers for Disease Control and Prevention (CDC) of the number of people in the United States with chronic fatigue syndrome (CFS) increased from about 20,000 to as many as four million within a ten-year period. If this were true, we would be amidst an epidemic of unprecedented proportions. I believe that these increases in prevalence rates can be explained by unreliable case definitions. For example, in 1994, the CDC’s case definition did not require patients to have core symptoms of the CFS. Making matters worse, in 2005, in an effort to operationalize their inadequate case definition, the CDC broadened the case definition so that ten times as many patients would be identified. Even though these estimates were challenged as bringing into the CFS case definition many who did not have this illness such as Major Depressive Disorder, as late as 2016, the CDC re-affirmed the merit in this broader case definition.
Another misguided effort occurred in 2015, when the Institute of Medicine (IOM) developed a revised clinical case definition that at least did specify core symptoms, but unfortunately also eliminated almost all exclusionary conditions, so those who had had previously been diagnosed with other illnesses such as Melancholic Depressive Disorders, could now be classified as meeting the new IOM criteria. This case definition has the unfortunate consequence of again broadening the types of patients that will now be identified, thus their effort also will inappropriately select many patients with other diseases as meeting the new IOM criteria. Making matters even worse, the clinical case definition was not designed to be used for research purposes, but it is clearly being used in this way, and one group of researchers has already inaccurately reported that the new clinical case definition is as effective at selecting patients as research case definitions.
This comedy of errors becomes even more tragic with the recent development of a new pediatric case definition. As with past efforts, data were not collected to field test this new set of criteria. Even worse, medical personnel are asked to make decisions regarding symptoms without being providing any validated questionnaires, and this has the effect of introducing unacceptable levels of diagnostic unreliability. Scoring rules are so poorly developed that guidelines indicate that a child needs to have most symptoms at a moderate or severe level, but in reality, according to the flawed scoring rules of this case definition, youth can be classified as having the illness even if they report all symptoms as mild. These criteria further suggest that “personality disorders” should be assessed in children, as these disorders are listed as psychiatric exclusionary conditions; however, personality disorders cannot be diagnosed (or reliably assessed) prior to the age of 18, as personality characteristics are not fully developed until adulthood. Finally, these authors also require the youth to have at least six months of illness duration, whereas the Canadian criteria and others suggest that children with three months duration can be diagnosed with the illness. Other significant limitation of this primer have been mentioned by others. In summary, these authors failed to incorporate standard psychometric procedures that include first specifying symptoms and logical scoring rules, developing consistent ways to reliably assess these symptoms, and then collecting data to ensure that the proposed criteria are reliable and valid.
When a field of inquiry is either unable or unwilling to develop a valid case definition, as has occurred with CFS, the repercussions are catastrophic for the research and patient community. In a sense like a house of cards, if the bottom level is not established with a sturdy foundation, all upper levels of cards are vulnerable to collapse. Science is based on having sound case definitions that allow investigators to determine who has and does not have an illness. Having porous and invalid case definitions, whether clinical or research, affects not only prevalence estimates of CFS, but also has dire consequences for treatment approaches, as when individuals who have solely affective disorders are misclassified as having CFS, and when they improve from psychological interventions, it is easy to erroneously conclude that CFS is a psychiatric illness, which further stigmatizes patients.”
Featured image credit: Guy by marusya21111999. CC0 public domain via Pixabay.
Affordable solutions to a health problem
Click here to see Leonard Jason’s Oxford University Press Blog titled: Comprehensive affordable solutions to a major health problem. The first paragraph of the blog is below:
Alcohol and drug abuse costs Americans approximately $428 billion annually. Despite this enormous cost—which, we must remember, is just the economic face of a community, family, and individually life-shattering problem—the vast majority of those with an alcohol or substance use problem do not receive treatment, and even fewer are likely to achieve long-term sobriety. In short, the existing system is characterized by inadequate access, high recidivism, and recurring treatment—at best, an ineffective and expensive revolving door. It has become increasingly clear that detoxification and treatment programs are insufficient to ensure abstinence from drugs and alcohol; for most people with substance use disorders, continued longer-term support following treatment is necessary.