
Clinical diagnosis of Graves' or non-Graves' hyperthyroidism compared to TSH receptor antibody test

Lauren Bell, Ann Louise Hunter, Angelos Kyriacou, Annice Mukherjee, Akheel A Syed
Abstract
Background: TSH receptor antibody (TRAb) is considered the gold standard diagnostic test for the autoimmunity of Graves' disease (GD), which is commonly diagnosed clinically.
Aim: To evaluate the true positive (sensitivity) and true negative (specificity) rates of clinical diagnosis of GD or non-GD hyperthyroidism compared to the TRAb test.
Setting: University teaching hospital in North West England.
Participants: Patients in the Endocrinology service who had a TRAb measurement between December 2009 and October 2015.
Methods: Electronic patient records were studied retrospectively for a pre-TRAb clinical diagnosis of GD or non-GD hyperthyroidism. We examined descriptive statistics and binary classification tests; Fisher exact test was used to analyse contingency tables.
Results: We identified 316 patients with a mean age of 45 (range, 17-89) years; 247 (78%) were women. Compared to the TRAb result, clinical diagnosis had a sensitivity of 88%, specificity 66%, positive predictive value 72%, negative predictive value 84%, false negative rate 12%, false positive rate 34%, positive likelihood ratio 2.6 and negative likelihood ratio 0.2 (P < 0.0001).
Conclusions: Clinicians were liable to both over- and under-diagnose GD. The TRAb test can help reduce the number of incorrect or unknown diagnoses in the initial clinical assessment of patients presenting with hyperthyroidism.
Keywords: Graves’ disease; hyperthyroidism; sensitivity; specificity; thyroid-stimulating immunoglobulins.
Introduction
Thyrotoxicosis, a clinical state resulting from inappropriately high thyroid hormone levels, is a condition with multiple aetiologies (1). It is commonly caused by Graves’ disease (GD), toxic multinodular goitre (TMNG) or toxic adenoma and less commonly by thyroiditis, administration of iodinated contrast (2), immune checkpoint inhibitors (3), and extra-thyroidal causes such as struma ovarii, factitious thyrotoxicosis, trophoblastic tumours producing human chorionic gonadotrophin (hCG) (4), and TSH-producing pituitary adenomas.
Graves’ disease, the commonest cause of hyperthyroidism, has an annual incidence of 20–50 per 100,000 population, a peak incidence between 30 and 50 years of age, and a lifetime risk of 3% for women and 0.5% for men (5). The diagnosis of GD is made on the basis of typical clinical features of hyperthyroidism such as weight loss, fatigue, heat intolerance, tremor, palpitations and diffuse thyroid enlargement, plus specific clinical features of GD including orbitopathy, thyroid dermopathy (pretibial myxoedema) and thyroid acropachy. Serum analyses typically show suppressed thyroid-stimulating hormone (TSH; thyrotropin) and elevated thyroid hormones, tetraiodothyronine (T4; thyroxine) and triiodothyronine (T3) (6). Additional diagnostic tests can include imaging (commonly ultrasound and radioisotope uptake study) and thyroid autoantibodies, which can help to distinguish GD from other causes of thyrotoxicosis.
The autoimmune production of TSH receptor antibodies (TRAbs) is central to the pathogenesis of GD. TRAbs are heterogeneous and may either have a stimulating effect (TSH receptor stimulating antibody, TSAb) or an inhibitory effect (TSH receptor blocking antibody, TBAb) or rarely a neutral effect on the TSH receptor. TSAbs dominate in GD hyperthyroidism (7). TRAbs can be measured using two different molecular techniques: thyrotropin-binding inhibiting immunoglobulin (TBII) assays and bioassays. In clinical practice, TRAb is measured using third-generation TBII assays, which detect TRAb inhibition of TSH binding to its receptor, and are non-invasive, inexpensive and commercially available. The 3rd generation TBII assays have been found to have a sensitivity of over 97.2% and a specificity of over 98.3% (8). They are unable to distinguish between stimulatory or inhibitory TRAb; however, this information can usually be deduced from clinical and biochemical tests (7, 9). Furthermore, the first immunoassay method declared to measure serum TSAb concentration has recently been successfully developed in an automated commercial platform with a sensitivity of 100% and specificity of 99% (10).
UK guidelines, which are over 10 years old, recommend the use of the TRAb test to determine the aetiology of clinically ambiguous cases of hyperthyroidism (6). More recent American Thyroid Association (ATA) guidelines place greater emphasis on the use of TRAb, particularly in monitoring the course of Graves’ disease, but similarly recommend that its place is in the diagnosis of GD in those patients whose aetiology of hyperthyroidism is unclear from their presentation and biochemistry (1). The value of TRAb measurement in the initial clinical assessment of all patients presenting with thyrotoxicosis remains a subject of debate (9). Thus, much reliance is placed on clinical judgement for making a diagnosis of GD; however, there is a dearth of data examining the accuracy of clinical diagnosis compared to objective tests.
The aim of our study was to assess the accuracy of the clinical diagnosis of Graves’ or non-Graves’ hyperthyroidism, made by a UK secondary care service, compared to TRAb measurement as the gold standard investigation.
Subjects and methods
We undertook a retrospective analysis of patients with a diagnosis of thyrotoxicosis to evaluate the accuracy of clinical diagnosis of GD and non-GD hyperthyroidism compared to TRAb results.
Setting and patients
We studied patients who presented with thyrotoxicosis to the Endocrinology outpatient department of a university teaching hospital in North West England between December 2009 and October 2015. The department was staffed by 10 consultants, two endocrine nurse specialists and three annually rotating specialist trainees, comprising a total of 30 individual specialists over the course of the study period. A total of 512 individual patients with TRAb measurements were identified from lab records in the study period, of which 316 (62%) were included in the study (Fig. 1), after excluding tests requested by departments outwith Endocrinology, tests performed at other laboratories, and patients with insufficient clinical information recorded. The project was approved by the Clinical Audit department of our institution and electronic patient records (EPR) were reviewed for demographic data and the pre-test clinical diagnosis of GD or non-GD hyperthyroidism. The latter included TMNG, thyroiditis, solitary toxic nodule, amiodarone-induced thyrotoxicosis, hyperemesis gravidarum and alemtuzumab-associated thyrotoxicosis. A post-test diagnosis, if applicable, was also recorded. Data on thyroid peroxidase (TPOAb) titres, where available, were also recorded.

TRAb assay
The TRAb assay used in the study period was a commercial third-generation TSH receptor autoantibody enzyme linked immunosorbent assay (ELISA) kit supplied by Thermo Scientific B.R.A.H.M.S (Hennigsdorf, Germany) and performed by the Department of Clinical Immunology, Northern General Hospital, Sheffield, UK, as per the manufacturer’s instructions (personal communication). The presence of TRAb was detected based on the inhibition of binding of the biotin-labelled human monoclonal antibody M22 with immobilised TSH receptors in ELISA plates. Streptavidin peroxidase and tetramethylbenzidine were added to determine the amount of M22 bound to the plate. The absorbance of the mixture at 450 nm was read using an ELISA plate reader. The intra-assay coefficient of variation (CV) was 13.57% at 2.28 IU/L and 8.35% at 35.8 IU/L. The manufacturer’s lower boundary for a positive sample was ≥1.5 IU/L. The units per litre corresponded to the international standard for TRAb (90/672 from the National Institute for Biological Standardisation and Control, Potters Bar, UK). The manufacturer-reported sensitivity and specificity were 98.8% and 99.6%, respectively (personal communication, Thermo Fisher Scientific).
Statistical analysis
We performed descriptive statistics of demographic characteristics with parametric tests (or non-parametric tests for non-normative data), with measures of dispersion as appropriate. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), false positive rate (FPR), false negative rate (FNR) and likelihood ratio of clinical diagnosis were computed against a TRAb-positive or TRAb-negative result after excluding TRAb-borderline results. The Fisher exact test was used to analyse contingency tables of categorical variables. A two-sided P < 0.05 was considered statistically significant and 95% confidence intervals (95% CI) were reported as a measure of precision. Data were analysed with GraphPad Prism, version 7.00 (GraphPad Software) and IBM SPSS Statistics, version 23.0.0 (IBM).
Results
We studied 316 patients with a pre-TRAb test clinical diagnosis of GD or non-GD hyperthyroidism.
Patient demographics
The age of the patients at the time of the TRAb measurement was a mean ± standard error of 45.2 ± 0.9 (range, 17–89) years; 247 (78%) were women; 279 (88%) patients were white, 16 (5%) Asian, 13 (4%) were black and the remaining eight (3%) were of other ethnicity.
Clinical diagnosis of GD or non-GD hyperthyroidism compared to TRAb result
A clear pre-test clinical diagnosis as made by the clinician was identified in 160 patients, which included GD in 98 (61.25%) and non-GD hyperthyroidism in 62 (38.75%) patients. The overall prevalence of TRAb-positive results was 50.62% (95% CI, 42.62–58.61%). Of the 98 patients with a pre-test clinical diagnosis of GD, 71 (72.45%) had a TRAb-positive result and 27 (27.55%) had a TRAb-negative result. Of the 62 patients with a pre-test clinical diagnosis of non-GD hyperthyroidism, 52 (83.87%) had a TRAb-negative result and 10 (16.13%) had a TRAb-positive result. Compared to the TRAb result, clinical diagnosis of GD had a sensitivity of 87.65% (78.74–93.15%) (Fig. 2), specificity of 65.82% (54.85–75.33%), PPV of 72.45% (62.88–80.32%), NPV of 83.87% (72.79–91.00%), FNR of 12.35% (6.85–21.26%), FPR of 34.18% (24.67–45.15%), a positive likelihood ratio of 2.57 (1.87–3.52) and a negative likelihood ratio of 0.19 (0.10–0.34) (P < 0.0001 for all). Given that the lifetime risk of GD is higher in females, sub-group analyses categorised by sex showed no statistically significant difference in sensitivity, specificity, PPV and NPV of clinical diagnosis in men compared to women (Table 1). As the incidence of GD is lower in patients over the age of 50 years, sub-group analyses by age showed that clinical diagnosis had significantly greater specificity and NPV in older patients, but no significant difference in sensitivity or PPV.

Sensitivity (A) and specificity (B) of pre-test clinical diagnosis of Graves’ disease compared to TSH receptor antibody (TRAb) result.
Sensitivity and specificity of the clinical diagnosis of Graves’ or non-Graves’ hyperthyroidism compared to TSH receptor antibody result in all patients and in subgroups.
All (N = 160) | Female (N = 131) | Male (N = 29) | P | Age ≤ 50 (N = 109) | Age > 50 (N = 51) | P | |
Sensitivity (%) | 87.65 | 86.76 | 92.31 | ns | 88.71 | 84.21 | ns |
Specificity (%) | 65.82 | 63.49 | 75.00 | ns | 53.19 | 84.38 | <0.0001 |
PPV (%) | 72.45 | 71.95 | 75.00 | ns | 71.43 | 76.19 | ns |
NPV (%) | 83.87 | 81.63 | 92.31 | ns | 78.13 | 90.00 | 0.0327 |
NPV, negative predictive value; ns, non-significant; PPV, positive predictive value.
Post-TRAb test clinical diagnosis
A false positive clinical diagnosis of GD was recorded in 27 patients, of which five (18.5%) patients’ diagnoses were subsequently amended by clinicians in follow-up appointments. Of the remaining patients, three (11.1%) kept their diagnosis of GD at the clinician’s discretion. Additionally, 14 (51.9%) patients kept their diagnosis of GD as the clinician had requested the TRAb measurement to monitor disease relapse or (in pregnant patients), to predict risk to the foetus of developing thyroid dysfunction. Three (11.1%) patients did not have their TRAb result acknowledged by the clinician and of the remaining two (7.4%), one had a corrected diagnosis to thyrotoxicosis of an indeterminate cause and one was lost to follow-up. Ten patients with an incorrect pre-test clinical diagnosis of non-GD were recorded, of which the diagnosis of nine (90.0%) were subsequently corrected by clinicians in follow-up appointments to GD hyperthyroidism; one (10.0%) patient did not have the TRAb result acknowledged by the clinician.
Indeterminate/unspecified pre-test clinical diagnosis compared to TRAb result
Of 156 patients with a differential/indeterminate/unspecified pre-test clinical diagnosis of thyrotoxicosis, the TRAb test was positive in 72 (46.2%) and negative in 84 (53.8%) patients. Consequently, 128 (82.1%) patients were given a diagnosis by a clinician in follow-up appointments. Of the remaining 28 patients, 14 (9.0%) did not have their TRAb test acknowledged and 14 (9.0%) kept their diagnosis of thyrotoxicosis of an indeterminate cause.
TRAb titres in patients with true positive vs false negative (or absent) pre-test clinical diagnosis of GD
In patients with a pre-test clinical diagnosis of GD who had confirmatory raised TRAb titres (true positive group, n = 71), the mean ± s.e.m. TRAb titre was 11.48 ± 1.46 (range, 1.9–68.7) IU/L. In patients with a pre-test clinical diagnosis of non-GD who had raised TRAb titres (false negative group, n = 10), the mean ± s.e.m. TRAb titre was 6.43 ± 1.85 (range, 1.8–21.7) IU/L. There was no statistical difference in TRAb titres between the true positive vs false negative groups (P > 0.99).
In patients with absent (indeterminate/unspecified) pre-test clinical diagnosis but a subsequent positive TRAb result and subsequent post-test diagnosis of GD (undiagnosed group, n
