Guideline:
Bibliographic Source(s)
- Singapore Ministry of Health. Dementia. Singapore: Singapore Ministry of Health; 2007 Mar. 80 p. [162 references]
Guideline Status
This is the current release of the guideline.
This guideline updates a previous version: Singapore Ministry of Health. Dementia. Singapore: Singapore Ministry of Health; 2001 Sep. 21 p.
The workgroup advises that these guidelines be scheduled for review 5 years after publication or if new evidence appears that requires substantive changes to the recommendations.
Guideline Category
Diagnosis
Evaluation
Management
Intended Users
Advanced Practice Nurses
Hospitals
Nurses
Physician Assistants
Physicians
Psychologists/Non-physician Behavioral Health Clinicians
Guideline Objective(s)
To provide an approach for healthcare professionals to assess evaluate and manage dementia (using local evidence where possible)
Target Population
Adults with progressive cognitive or behavioural complaints suggestive of dementia as well as patients who arouse the physician's or caregiver's suspicion of cognitive impairment despite absence of complaints
Interventions and Practices Considered
Evaluation/Diagnosis
- Identification of individuals with progressive cognitive or behavioural complaints suggestive of dementia as well as those who arouse the physician's or caregiver's suspicion of cognitive impairment despite absence of complaints
- Comprehensive evaluation including the Diagnostic and Statistical Manual of Mental Disorders – IV (DSM-IV) supplemented by an objective approach with cognitive tests; assessing the complications of dementia (behavioural and psychological symptoms functional problems and social problems); and determining the aetiology of dementia
- Physical examination with emphasis on detecting depression and neurological signs
- Diagnostic tests including full blood count urea and serum electrolytes serum calcium serum glucose thyroid function tests vitamin B12 levels and neuroimaging (computed tomography [CT] magnetic resonance imaging [MRI] positron emission tomography or single-photon emission tomography)
- Clinical diagnosis criteria
Management/Evaluation
- Pharmacological management including acetylcholinesterase inhibitors (AchEI) vitamin E and N-methyl D-aspartate (NMDA) antagonists; behavioral management (antidepressants antipsychotics trazodone) and follow-up assessment of response to medication and adverse events
Note: The following medications were considered but not recommended due to lack of efficacy or insufficient data: anti-inflammatory agents prednisolone oestrogen omega 3 fatty acid folate supplementation (with or without B12) ginkgo selegiline routine use of mood stabilizers benzodiazepines
- Non-pharmacological therapies such as environmental interventions; social contact; timalation (e.g. music aromatherapy massage); standard psychological therapies
- Caregiver management including referral for educational programmes for caregivers individual and family counseling family support groups respite care technology-based interventions and referral to community resources
Major Outcomes Considered
- Utility of genetic tests
- Effectiveness of treatment:
- Cognitive performance
- Global function
- Psychiatric symptoms
Methods Used to Collect/Select Evidence
Searches of Electronic Databases
Description of Methods used to Collect/Select the Evidence
Not stated
Number of Source Documents
Not stated
Methods Used to Assess the Quality and Strength of the Evidence
Weighting According to a Rating Scheme (Scheme Given)
Rating Scheme for the Strength of the Evidence
Levels of Evidence
1++ High quality meta-analyses systematic reviews of randomized controlled trials (RCTs) or RCTs with a very low risk of bias
1+ Well conducted meta-analyses systematic reviews or RCTs with a low risk of bias
1- Meta-analyses systematic reviews or RCTs with a high risk of bias
2++ High quality systematic reviews of case-control or cohort or studies
High quality case-control or cohort studies with a very low risk of confounding or bias and a high probability that the relationship is causal
2+ Well conducted case-control or cohort studies with a low risk of confounding or bias and a moderate probability that the relationship is causal
2- Case-control or cohort studies with a high risk of confounding or bias and a significant risk that the relationship is not causal
3 Non-analytic studies e.g. case reports case series
4 Expert opinion
Methods Used to Analyze the Evidence
Review of Published Meta-Analyses
Systematic Review
Description of the Methods Used to Analyze the Evidence
Not stated
Methods Used to Formulate the Recommendations
Expert Consensus
Description of Methods Used to Formulate the Recommendations
The guidelines have been produced by a committee of psychiatrists neurologists geriatricians and primary care physicians appointed by the Ministry of Health. They were developed by the adaptation of existing guidelines by the review of relevant literature and by expert clinical consensus with consideration of local practice.
Rating Scheme for the Strength of the Recommendations
Grades of Recommendation
A. At least one meta-analysis systematic review or randomized controlled trial (RCT) rated as 1++ and directly applicable to the target population; or
A body of evidence consisting principally of studies rated as 1+ directly applicable to the target population and demonstrating overall consistency of results
B. A body of evidence including studies rated as 2++ directly applicable to the target population and demonstrating overall consistency of results; or
Extrapolated evidence from studies rated as 1++ or 1+
C. A body of evidence including studies rated as 2+ directly applicable to the target population and demonstrating overall consistency of results; or
Extrapolated evidence from studies rated as 2++
D. Evidence level 3 or 4; or
Extrapolated evidence from studies rated as 2+
GPP (good practice points) Recommended best practice based on the clinical experience of the guideline development group.
Cost Analysis
A formal cost analysis was not performed and published cost analyses were not reviewed.
Method of Guideline Validation
Not stated
Description of Method of Guideline Validation
Not stated
Major Recommendations
Each recommendation is rated based on the level of the evidence and the grades of recommendation. Definitions of the grades of the recommendations (A B C D Good Practice Points [GPP]) and level of the evidence (1++ – 4) are presented at the end of the "Major Recommendations" field.
Screening and Assessment of Dementia
C - There is currently insufficient evidence for routine screening for dementia in older adults. Individuals who should be evaluated for dementia include those with progressive cognitive or behavioural complaints suggestive of dementia as well as patients who arouse the physician's or caregiver's suspicion of cognitive impairment despite absence of complaints. (Grade C Level 2+)
GPP - Assessment of dementia should be done via a comprehensive evaluation. This approach will aim to diagnose dementia early assess for complications of dementia and establish the cause of the dementia. (GPP)
B - In individuals with suspected cognitive impairment diagnosis can be made using the Diagnostic and Statistical Manual of Mental Disorders-IV (DSM-IV) criteria for dementia with history from a reliable informant. This can be supplemented by an objective approach with cognitive tests (Elderly Cognitive Assessment Questionnaire/Abbreviated Mental Test/Chinese Mini Mental State Examination [ECAQ/AMT/CMMSE]) and/or neuropsychological assessment. (Grade B Level 2++)
B - The complications of dementia can be broadly divided into behavioural and psychological symptoms functional problems and social problems. These should be evaluated in all patients with dementia as these issues are the major causes of stress on the caregiver and assessment would enable the clinician to target subsequent management effectively. (Grade B Level 2++)
D - The aim of determining dementia aetiology is to rule out potentially reversible causes of dementia and selecting appropriate treatment strategies for the irreversible dementias. This is done via clinical history and physical examination followed by laboratory investigations and neuroimaging (Larson et al. 1986; Clarfield 1988; Walstra et al. 1997; Siu 1991). (Grade D Level 4)
B - A number of well-validated clinical criteria for the two most common types of dementia (Alzheimer's disease and Vascular dementia) have been developed over the years. These can be used in the specialized dementia clinics for the definition of Alzheimer's disease and vascular dementia. (Grade B Level 2++)
Pharmacological Management of Dementia
GPP - Pharmacotherapy should be part of a multi-pronged strategy to dementia management that encompasses a well-established diagnosis education of patient and caregiver non-pharmacological measures and comprehensive caregiver psychosocial intervention. (GPP)
B - Although high dose vitamin E (2000 IU per day) may have a modest effect in delaying disease progression in moderately severe Alzheimer's disease doses of vitamin E in excess of 400 IU a day should be avoided for the treatment of Alzheimer's disease until there is further data on its safety especially in patients with cardiovascular disease. (Grade B Level 1+)
A - Anti-inflammatory agents (such as non-steroidal anti-inflammatory agents and cyclo-oxygenase 2 inhibitors) are not recommended for the prevention of cognitive decline in Alzheimer's disease (Aisen et al. 2003; Reines et al. 2004). (Grade A Level 1++)
B - Prednisolone is not recommended for the prevention of cognitive decline in Alzheimer's disease (Aisen et al. 2000). (Grade B Level 1+)
A - Oestrogen is not recommended for the prevention of cognitive decline in women with dementia. (Grade A Level 1++)
A - Acetylcholinesterase inhibitors should be considered for the management of all patients with mild to moderate Alzheimer's disease. (Grade A Level 1++)
B - Acetylcholinesterase inhibitors can be considered for the management of moderate to severe Alzheimer's disease. (Grade B Level 1+)
A - Acetylcholinesterase inhibitors have been shown to be of clinical benefit and may be considered for use in the management of mild to moderate vascular dementia. (Grade A Level 1+)
B - Acetylcholinesterase inhibitors can be considered for the management of dementia with Lewy bodies and Parkinson's disease dementia. (Grade B Level 1+)
B - All three available acetylcholinesterase inhibitors (donepezil rivastigmine and galantamine) can be considered for the pharmacological management of dementia since there is no definite evidence to support a difference in clinical efficacy between them. (Grade B Level 1+)
A - Where tolerated acetylcholinesterase inhibitors should be titrated to recommended doses (5 to 10 mg/day donepezil; 6 to 12 mg/day rivastigmine; 16 to 24 mg/day galantamine) which have been shown to confer greater benefit compared with lower doses. (Grade A Level 1++)
B - N-methyl D-aspartate (NMDA) antagonists such as memantine can be considered for the management of moderate to severe Alzheimer's disease either alone or in combination with acetylcholinesterase inhibitors. (Grade B Level 1+)
B - N-methyl D-aspartate antagonists such as memantine may be a treatment option for mild to moderate Alzheimer's disease if acetylcholinesterase inhibitor therapy is contra-indicated not tolerated or if there is disease progression despite an adequate trial of acetylcholinesterase inhibitor. (Grade B Level 1+)
A - N-methyl D-aspartate antagonists have been shown to be of clinical benefit and may be considered for use in the management of mild to moderate vascular dementia. (Grade A Level 1+)
B - Practitioners who prescribe ginkgo for the treatment of dementia should be aware of the unestablished benefit variability of active ingredient among preparations and potential for drug interactions. (Grade B Level 1+)
A - Selegiline is not recommended for the treatment of core or associated symptoms in Alzheimer's disease. (Birks & Flicker 2003) (Grade A Level 1++)
GPP - Appropriate treatment of vascular risk factors is recommended for all patients. However it should be noted that whilst promising observational data exists it remains to be shown in a randomised controlled clinical trial if any prevention strategy such as blood pressure reduction or antiplatelet treatment for the secondary prevention of stroke will reduce the incidence of vascular dementia. (GPP)
GPP - The decision to initiate costly symptomatic dementia treatment such as acetylcholinesterase inhibitors or N-methyl D-aspartate antagonists should always be made in consultation with the patient and family after careful consideration of the expected magnitude of benefit side effects comorbidities and costs of treatment. (GPP)
GPP - Patients who are started on acetylcholinesterase inhibitors or N-methyl D-aspartate antagonists should be carefully monitored for side effects and response to treatment. (GPP)
Management of Behavioural and Psychological Symptoms of Dementia (BPSD)
GPP - Non-pharmacological methods to manage behavioural and psychological symptoms of dementia should be instituted prior to consideration of pharmacological measures. (GPP)
GPP - Antidepressants may be used for the treatment of comorbid depression in dementia provided their use has been evaluated carefully for each patient. (GPP)
A - Conventional and atypical antipsychotics may be used with caution given their side effect profile to treat neuropsychiatric symptoms of dementia. (Grade A Level 1+)
B - Trazodone may be considered for patients with depressive symptoms and dementia associated agitation. (Grade B Level 1+)
A - Routine use of mood stabilizers such as carbamazepine and sodium valproate is not recommended for treatment of behavioural symptoms associated with dementia. (Grade A Level 1+)
GPP - An individualized approach to managing behavioural problems in dementia patients is required. (GPP)
GPP - Cholinesterase inhibitor therapy may be considered in treatment of patients with behavioural problems if antipsychotics are inappropriate. (GPP)
GPP - The decision to start antipsychotic therapy to control behavioural problems in dementia patients should be made in consultation with the patient and family after careful consideration of the benefit adverse-effects and co-morbidities. (GPP)
B - For patients with dementia with Lewy Body and behavioural problems acetylcholinesterase inhibitors should be considered first for management of the behavioural problems. (Grade B Level 1+)
GPP - In all patients started on antipsychotic medication they should be monitored carefully for side effects and response to treatment. In patients who are stable antipsychotic withdrawal should be considered. (GPP)
Social and Caregiver Management of Dementia and Community Resources
A - Caregiver interventions via a multifaceted approach should be considered in the total management of the person with dementia. (Grade A Level 1+)
GPP - Where appropriate respite care can be offered to relieve the burden of caregiving on the family caregiver. (GPP)
GPP - Referral to community resources to meet the care needs of the person with dementia and his/her carer should always be considered. (GPP)
Definitions:
Levels of Evidence
1++ High quality meta-analyses systematic reviews of randomized controlled trials (RCTs) or RCTs with a very low risk of bias.
1+ Well conducted meta-analyses systematic reviews or RCTs with a low risk of bias.
1- Meta-analyses systematic reviews or RCTs with a high risk of bias.
2++ High quality systematic reviews of case-control or cohort or studies.
High quality case-control or cohort studies with a very low risk of confounding or bias and a high probability that the relationship is causal.
2+ Well conducted case-control or cohort studies with a low risk of confounding or bias and a moderate probability that the relationship is causal.
2- Case-control or cohort studies with a high risk of confounding or bias and a significant risk that the relationship is not causal.
3 Non-analytic studies (e.g. case reports case series)
4 Expert opinion.
Grades of Recommendation
A. At least one meta-analysis systematic review or randomized controlled trial (RCT) rated as 1++ and directly applicable to the target population; or
A body of evidence consisting principally of studies rated as 1+ directly applicable to the target population and demonstrating overall consistency of results
B. A body of evidence including studies rated as 2++ directly applicable to the target population and demonstrating overall consistency of results; or
Extrapolated evidence from studies rated as 1++ or 1+
C. A body of evidence including studies rated as 2+ directly applicable to the target population and demonstrating overall consistency of results; or
Extrapolated evidence from studies rated as 2++
D. Evidence level 3 or 4; or
Extrapolated evidence from studies rated as 2+
GPP (good practice points) Recommended best practice based on the clinical experience of the guideline development group.
Clinical Algorithm(s)
The original guideline document contains a clinical algorithm for the Management of Neuropsychiatric Symptoms of Dementia.
References Supporting the Recommendations
- Aisen PS Davis KL Berg JD Schafer K Campbell K Thomas RG Weiner MF Farlow MR Sano M Grundman M Thal LJ. A randomized controlled trial of prednisone in Alzheimer's disease. Alzheimer's Disease Cooperative Study. Neurology 2000 Feb 8;54(3):588-93. PubMed
- Aisen PS Schafer KA Grundman M Pfeiffer E Sano M Davis KL Farlow MR Jin S Thomas RG Thal LJ Alzheimer's Disease Cooperative Study. Effects of rofecoxib or naproxen vs placebo on Alzheimer disease progression: a randomized controlled trial. JAMA 2003 Jun 4;289(21):2819-26. PubMed
- Birks J Flicker L. Selegiline for Alzheimer's disease (Cochrane Review). In: The Cochrane Library [database online]. Issue 1. Oxford: Update Software; 2003
- Clarfield AM. The reversible dementias: do they reverse. Ann Intern Med 1988 Sep 15;109(6):476-86. [103 references] PubMed
- Larson EB Reifler BV Sumi SM Canfield CG Chinn NM. Diagnostic tests in the evaluation of dementia. A prospective study of 200 elderly outpatients. Arch Intern Med 1986 Oct;146(10):1917-22. PubMed
- Reines SA Block GA Morris JC Liu G Nessly ML Lines CR Norman BA Baranak CC Rofecoxib Protocol 091 Study Group. Rofecoxib: no effect on Alzheimer's disease in a 1-year randomized blinded controlled study. Neurology 2004 Jan 13;62(1):66-71. PubMed
- Siu AL. Screening for dementia and investigating its causes. Ann Intern Med 1991 Jul 15;115(2):122-32. [105 references] PubMed
- Walstra GJ Teunisse S van Gool WA van Crevel H. Reversible dementia in elderly patients referred to a memory clinic. J Neurol 1997 Jan;244(1):17-22. PubMed
Type of Evidence supporting the Recommendations
The type of supporting evidence is identified and graded for each recommendation (see "Major Recommendations").
Potential Benefits
Appropriate assessment evaluation and management of patients with dementia
Potential Harms
Adverse Effects of Medications
- Although generally well tolerated dose-related gastrointestinal side effects (nausea vomiting diarrhea anorexia) are common with acetylcholinesterase inhibitors (AchEI) use. These are transient and often circumvented to a large extent by a slower titration and taking the medication with food. Great caution should be exercised in those with bradycardia sick sinus syndrome or cardiac conduction disturbances in view of possible adverse effects of symptomatic bradycardia and syncope. Other less common side effects that have been reported include muscle cramps insomnia vivid dreams and weight loss. Dementia with Lewy bodies (DLB) and Parkinson's disease dementia (PDD) patients commenced on AchEI should be carefully monitored for worsening of motor symptoms.
- Compared with AchEI gastrointestinal-related side effects are uncommon with memantine use. Common adverse events of memantine include dizziness headache fatigue hallucinations and confusion but these tend to be transient. Memantine should be used with caution in patients with epilepsy and renal impairment and the clinician should be aware of interactions involving commonly prescribed medications such as dextromethorphan and L-dopa.
- Doses of vitamin E in excess of 400 IU a day should be avoided for the treatment of Alzheimer's disease until there is further data on its safety especially in patients with cardiovascular disease.
- Conventional antipsychotics are associated with extrapyramidal side effects and somnolence
- Atypical antipsychotics are associated with somnolence and gait disturbance. These adverse effects are 7.5 to 11 times more common in olanzepine-treated group compared to placebo. Serious adverse events occurred in 16.8% of risperidone versus 8.8% of placebo group including 5 strokes and 1 transient ischaemic attacks all in risperidone group. Meta-analysis of adverse events performed showed 3-fold statistically increased risk of cerebrovascular adverse events with risperidone and olanzepine (no statistically significant increase in mortality) while another meta-analysis comparing risk of death with atypical antipsychotics (Aripiprazole Olanzepine Risperidone and Quetiapine) with placebo showed increased risk of death. Other serious adverse events reported included somnolence and metabolic complications of hyperglycemia and weight gain.
- A recent retrospective cohort study had shown increased mortality among subjects using conventional antipsychotics compared to atypical antipsychotics. Antipsychotic medication should be used cautiously in patients suspected to have dementia with Lewy Body as these patients have marked sensitivity to neuroleptic agents including life-threatening neuroleptic malignant syndrome.
Qualifying Statements
- These guidelines are not intended to serve as a standard of medical care. Standards of medical care are determined on the basis of all clinical data available for an individual case and are subject to change as scientific knowledge advances and patterns of care evolve.
- The contents of the guideline document are guidelines to clinical practice based on the best available evidence at the time of development. Adherence to these guidelines may not ensure a successful outcome in every case nor should they be construed as including all proper methods of care or excluding other acceptable methods of care. Each physician is ultimately responsible for the management of his/her unique patient in the light of the clinical data presented by the patient and the diagnostic and treatment options available.
- Evidence-based clinical practice guidelines are only as current as the evidence that supports them. Users must keep in mind that new evidence could supersede recommendations in these guidelines.
Description of Implementation Strategy
The following clinical audit parameters based on recommendations in these guidelines are proposed:
- Percentage of patients whose caregiver report subjective memory complaints underwent cognitive evaluation with subsequent appropriate management.
- Percentage of patients newly diagnosed with dementia who had subsequent multi-pronged strategy to dementia management that encompasses education of patient and caregiver nonpharmacological measures and comprehensive caregiver psychosocial intervention.
- Percentage of patients newly diagnosed with dementia institution of cognitive enhancers such as acetylcholinesterase inhibitors or N-methyl D-aspartate antagonists was made in consultation with the patient and family after careful consideration of the expected magnitude of benefit side effects co-morbidities and costs of treatment.
- Percentage of patients newly diagnosed with dementia with significant behavioural problems appropriate non-pharmacological management was instituted prior to consideration of pharmacological agents.
- Percentage of patients newly diagnosed with dementia with significant behavioural problems despite non-pharmacological management institution of antipsychotic therapy was made in consultation with the patient and family after careful consideration of the benefit adverse-effects and co-morbidities.
- Percentage of patients newly diagnosed with dementia who had a referral to community resources to meet the care needs of the person with dementia and his caregivers.
Implementation Tools
Clinical Algorithm
Personal Digital Assistant (PDA) Downloads
For information about availability see the "Availability of Companion Documents" and "Patient Resources" fields below.
IOM Care Need
Living with Illness
IOM Domain
Effectiveness
Patient-centeredness
Bibliographic Source(s)
- Singapore Ministry of Health. Dementia. Singapore: Singapore Ministry of Health; 2007 Mar. 80 p. [162 references]
Adaptation
Not applicable: The guideline was not adapted from another source.
Source(s) of Funding
Singapore Ministry of Health
Guideline Committee
Workgroup on Dementia
Composition of Group that Authored the Guideline
Workgroup Members: Dr Chong Mei Sian (Chairperson) Consultant Department of Geriatric Medicine TTSH; Dr Christopher Chen Li-Hsian Senior Consultant Dept of Neurology NNI (SGH Campus) SGH; Prof Kua Ee Heok Head Dept of Psychological Medicine Yong Loo Lin School of Medicine NUH; Dr Ng Li Ling Senior Consultant Dept of Psychological Medicine CGH; Dr Lim Wee Shiong Consultant Dept of Geriatric Medicine TTSH; Dr Chin Jing Jih Consultant Dept of Geriatric Medicine TTSH; Dr Philip Yap Lin Kiat Consultant Dept of Geriatric Medicine AH; Dr Chiam Peak Chiang Chief & Senior Consultant Dept of Geriatric Psychiatry WH/IMH; Dr Francis Ngui Tet Shin Medical Director Adam Road Hospital; Dr Tan Kok Leong Director Singhealth Polyclinics-Outram
Financial Disclosures/Conflicts of Interest
Not stated
Guideline Status
This is the current release of the guideline.
This guideline updates a previous version: Singapore Ministry of Health. Dementia. Singapore: Singapore Ministry of Health; 2001 Sep. 21 p.
The workgroup advises that these guidelines be scheduled for review 5 years after publication or if new evidence appears that requires substantive changes to the recommendations.
Guideline Availability
Electronic copies: Available in Portable Document Format (PDF) from the Singapore Ministry of Health Web site.
Print copies: Available from the Singapore Ministry of Health College of Medicine Building Mezzanine Floor 16 College Rd Singapore 169854.
Availability of Companion Documents
The full text guideline and summary card are available for PDA download in ISilo and MSReader formats from the Singapore Ministry of Health Web site.
Patient Resources
None available
NGC STATUS
This summary was completed by ECRI on January 8 2002. The information was verified by the guideline developer on February 22 2002. This NGC summary was updated by ECRI Institute on July 11 2007. This summary was updated by ECRI Institute on October 31 2007 following the U.S. Food and Drug Administration advisory on Antidepressant drugs. This summary was updated by ECRI Institute on January 10 2008 following the U.S. Food and Drug Administration advisory on Carbamazepine. This summary was updated by ECRI Institute on July 25 2008 following the U.S. Food and Drug Administration advisory on Antipsychotics.
COPYRIGHT STATEMENT
This NGC summary is based on the original guideline which is subject to the guideline developer's copyright restrictions. Please contact the Ministry of Health Singapore by e-mail at MOH_INFO@MOH.GOV.SG.
NGC Disclaimer
The National Guideline Clearinghouse™ (NGC) does not develop produce approve or endorse the guidelines represented on this site.
All guidelines summarized by NGC and hosted on our site are produced under the auspices of medical specialty societies relevant professional associations public or private organizations other government agencies health care organizations or plans and similar entities.
Guidelines represented on the NGC Web site are submitted by guideline developers and are screened solely to determine that they meet the NGC Inclusion Criteria which may be found at http://www.guideline.gov/about/inclusion.aspx .
NGC AHRQ and its contractor ECRI Institute make no warranties concerning the content or clinical efficacy or effectiveness of the clinical practice guidelines and related materials represented on this site. Moreover the views and opinions of developers or authors of guidelines represented on this site do not necessarily state or reflect those of NGC AHRQ or its contractor ECRI Institute and inclusion or hosting of guidelines in NGC may not be used for advertising or commercial endorsement purposes.
Readers with questions regarding guideline content are directed to contact the guideline developer.
Tools
No Quick Reference tools have been developed.

