SciELO - Scientific Electronic Library Online

 
vol.40 issue2Approach and guidance of trans and non-binary people in primary health care: experience and knowledgeSGLT2i pharmacological treatment in type 2 diabetes mellitus control and its underlying obesity author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • Have no similar articlesSimilars in SciELO

Share


Revista Portuguesa de Medicina Geral e Familiar

Print version ISSN 2182-5173

Rev Port Med Geral Fam vol.40 no.2 Lisboa Apr. 2024  Epub Apr 30, 2024

https://doi.org/10.32385/rpmgf.v40i2.13655 

Estudos originais

Cross-cultural adaptation of the PHQ-4 to European Portuguese and its validation with the psychological burden by the multimorbidity management in GP/FM practice in Central Portugal

Adaptação cultural da escala PHQ4 para o português europeu e validação pela sobrecarga psicológica pela gestão da multimorbilidade em MGF no Centro de Portugal

Luiz Miguel Santiago1  2  3 
http://orcid.org/0000-0002-9343-2827

Marta Rodrigues3 

1. MD, PhD, Associated Professor. Clínica Universitária de Medicina Geral e Familiar, Faculdade de Medicina da Universidade de Coimbra. Coimbra, Portugal.

2. Centro de Estudos e Investigação em Saúde, Universidade de Coimbra, Coimbra, Portugal.

3. Faculdade de Medicina da Universidade de Coimbra. Coimbra, Portugal.


Abstract

Background:

Mental health is an important issue in general practice/family medicine. The Patient Health Questionnaire for Depression and Anxiety (PHQ-4) allows depression and anxiety screening and psychologic distress evaluation. PHQ-4 cross-cultural adaptation and concurrent validation was the objective of this paper in a population of general practice/family medicine (GP/FM) doctors.

Methods:

Translation, linguistic verification and back-translation, internal consistency, and reliability of the final translated tool were performed for the cultural adaptation of the PHQ-4 scale. The European Quality of Life 5 Dimensions 3L (EQ-5D-3L) scale and the “Sentimentos Negativos - Negative Feelings”, subscale of the “Questionário da Avaliação da Sobrecarga da Gestão da Multimorbilidade em Medicina Geral e Familiar - Questionnaire of Evaluation of Burden of Management of Multimorbidity in General Practice and Family Medicine” [SoGeMM-MGF]) were used for concurrent validation. Descriptive, inferential, and correlational statistics were used, according to the distribution of data, with a p-value of <0.01 for statistical significance being defined.

Results:

Forty-six participants (50.0% women, 39.1% less than 35 years) were enrolled in the cultural adaptation phase. The PHQ-4 scale’s internal consistency was Cronbach’s Alfa 0.762 (test) and 0.764 (retest), and the Intraclass Correlation Coefficient of 0.762. No significant differences by question or total score between both applications were found (p>0.01). The concurrent validation phase included 91 participants (28.6% men, 78.9% less than 45 years). The convergent validity of the PHQ-4 scale was confirmed by the moderate, positive, significant correlation with the “Anxiety/Depression” domain of the EQ-5D-3L scale (Spearman ρ=0.577; p<0.001) and with the moderate, positive, significant correlation with “Sentimentos Negativos - Negative Feelings”, subscale from the SoGeMM-MGF questionnaire (Spearman ρ=0.518; p<0.001).

Conclusion:

PHQ-4 scale cultural adaptation and concurrent validity were made, PHQ4 being a valid and reliable screening tool, to assess anxiety, depression, and psychological distress.

Keywords: Anxiety; Depression; EQ-5D-3L; Family medicine; General practice; PHQ-4; Multimorbidity; SoGeMM-MGF

Resumo

Introdução:

A saúde mental é um aspeto cada vez mais importante em medicina geral e familiar. O Patient Health Questionnaire for Depression and Anxiety (PHQ-4) permite o rastreio de depressão e ansiedade, bem como do distress psicoclógico. A adaptação cultural e a validação concorrente foram o objetivo deste estudo em médicos de medicina geral e familiar.

Métodos:

Tradução, verificação linguística, tradução para o inglês, verificação de consistência interna e de reprodutibilidade foram realizadas para a adaptação cultural do PHQ4. A escala “European Quality of Life 5 Dimensions 3L (EQ-5D-3L)” e a subescala “Sentimentos Negativos” da Escala “Questionário da Avaliação da Sobrecarga da Gestão da Multimorbilidade em Medicina Geral e Familiar” [SoGeMM-MGF] foram usadas para a fase de validação. Foi usada estatística descritiva e inferencial, adaptada aos fins do estudo e definido p<0,01 para diferença significativa.

Resultados:

Um total de 46 participantes (50,0% mulheres, 39,1% menores de 35 anos) foi estudado na fase de adaptação cultural. A consistência interna da escala PHQ4 pelo alfa de Cronbach foi de 0,762 (teste) e de 0,764 (retest) com Coeficiente de Correlação Intraclasse de 0,762 inicial e sem diferenças significativas por item ou pela soma da escala em ambos os tempos de aplicação (p>0,01). Na fase de validação foram estudados 91 participantes em amostra de conveniência, sendo 8,6% homens, 78,9% menores de 45 anos. A validade convergente de PHQ4 foi confirmada com moderada, positiva e significativa correlação com o domínio «Ansiedade/Depressão» da EQ5D-3L (Spearman ρ=0,577; p<0,001) e com moderada, positiva e significativa correlação com a subescala “Sentimentos Negativos” da SoGeMM-MGF (Spearman ρ=0,518; p<0,001).

Conclusão:

A escala PHQ4 foi culturalmente adaptada e a sua validade concorrente foi feita, sendo a PHQ4 uma escala fiável para rastreio de ansiedade, depressão e distress psicológico.

Palavras-chave: Ansiedade; Depressão; EQ-5D-3L; Clínica geral; Medicina familiar; PHQ-4; Multimorbilidade; SoGeMM-MGF

Background

Portuguese General Practice/Family Doctors (GP/FMD) have an increasing work-load with patients suffering from multimorbidity, defined as “any combination of chronic disease with at least one other disease (acute or chronic), biopsychosocial factor (associated or not) or somatic risk factor”,1 its prevalence being estimated as of 72.7% of adult patients, and particularly the elderly. (2 Portuguese population’s aging is a reality that increases the workload and responsibility for GP/FMD. (3

Multimorbidity is a common theme of research wi-thin GP/FMD. However, there are few studies primarily focused on the impact of the management of these complex patients on the quality of life and well-being of doctors, from a medical perspective. The first studies on this topic showed that doctors consider the management of these patients a complex diagnostic and therapeutic challenge, which often results in higher levels of distress among these healthcare professionals. (4

The validation of the ‘Questionnaire of Evaluation of Burden of Management of Multimorbidity in General Practice and Family Medicine’ (SoGeMM-MGF), a questionnaire that aims to evaluate how doctors perceive the burden of managing multimorbidity, was recently published in Portugal. It allows the evaluation of four impact areas of multimorbid patient management on doctors: negative feelings, cooperation, clinical work, and consultation workload. In the discussion chapter, the authors noticed the need to measure the psychological impact of the multimorbid patient’s management burden, considering other valid instruments, for SoGeMM-MGF only signals the problem. (5

Doctors’ well-being is a key player in providing high-quality healthcare. When at risk, it entails not only individual negative consequences but is also associated with lower therapeutic performance, translating into a higher rate of medical errors and reduced patient satisfaction with the care provided. (6-7

Anxiety and depression are two common psychological conditions among doctors. (8 In addition to individual factors, others such as work overload and difficult peer relationships have been identified as possible causal agents. (9 Even knowing that emotional dysfunction is related to high disability in the personal, social, and professional sphere of doctors, they often tend to neglect to feel unwell and rarely seek other specialist te-chnical help such as psychology or psychiatry. (10 This may impair their quality of life, which can and should be measured, (11 to implement strategies for its improvement.

In 2009, Kroenke and collaborators published the Patient Health Questionnaire for Depression and Anxiety (PHQ-4) scale, a screening tool for anxiety and depression that combines two subscales: Patient Health Questionnaire-2 (PHQ-2) and Generalized Anxiety Disorder-2 (GAD-2). (12 Comprising only four questions, which makes it highly practical, PHQ-4 was proven to be a valid and reliable screening tool for these pathologies, (13 having already been used in different studies. (14-15

PHQ-4 contains normative data which allows to assess the possibility of an individual suffering from anxious and depressive pathology. It is recommended to consider a total PHQ-4 sum to verify ‘yellow flags’ and ‘red flags’ and also to verify psychologic distress. (16

As doctors manage multimorbid patients, as older persons tend to have worse results and guidelines are ever more demanding and frequent, medical anxiety, depression, and distress can appear, and quality of life can worsen. After all, even differentiated doctors are persons.

Knowing that the PHQ-4 tool had not yet been adapted to the European spoken Portuguese this work’s objective was such accomplishment. Additionally, PHQ4’s concurrent validity with the psychological burden by the management of multimorbid patients (using the SoGeMM-MGF scale) and quality of life (using the European Quality of Life 5 Dimensions 3L scale, (EQ-5D-3L)) in a population of GP/FMD Portuguese specialists was intended.

Methods

The PHQ-4 scale was translated and cross-culturally adapted to European Portuguese following approval by the Health Ethics Commission of the Regional Health Administration (RHA) of Central Portugal (Administração Regional de Saúde do Centro). Permission has also been gathered from the original au-thor of all scales. This procedure entailed:

  • Translation: of the original scale from English to European Portuguese by two Portuguese experts. These experts were external to the study and had full professional working proficiency in English.

  • Linguistic verification: by three academic general practitioner experts, with previous experience in similar tasks and fluent in European Portuguese and English. Experts compared the original English version of the scale against the two translated versions and selected the one they considered the most resemblant to English semantics.

  • Back-translation: back to English of the consensus resulting from the linguistic verification by two Portuguese experts, who did not know about the original scale. The retro-translated scale was then compared against the original version.

The final accepted version of the PHQ-4 scale (in European Portuguese) was then applied to a subset of 46 convenience participants from the general population (n=29) and GP/FMD (n=17), aiming to evaluate its understandability, internal consistency, and reliability. Informed consent was recorded.

All participants were asked to answer a questionnaire which, in addition to the PHQ-4 scale, also included a list of context questions related to gender and age group.

Participants responded to the questionnaire at two different time points, in a test and retest format. Initially, participants were asked to respond to the questionnaire in a written format, followed by a second moment where the same questionnaire was applied orally by the investigator who collected their answers. There was an interval of, at least, 15 minutes between both evaluation time points, as a measure of reliability.

During the validation phase, an observational and correlational study was conducted with GP/FMD specialists and internees practicing in Health Centre Groups (Agrupamentos de Centros de Saúde, ACeS) under the management of the RHA of Central Portugal, who voluntarily accepted to be part of the study, to co-validate the PHQ-4 scale with the EQ-5D-3L scale and the “Sentimentos Negativos - Negative Feelings” sub-scale (part of the SoGeMM-MGF scale).

GP/FMD Portuguese specialists and trainees in the Portuguese National Health System can work in one of three kinds of primary healthcare units: Personalised Healthcare Unit (UCSP), Family Healthcare (model A, USF-A), and Family Healthcare (model B, USF-B), which differ in how they are structured and how they manage the list of patients being followed up. Portuguese National Health Service defines, as a decentralised entity, the Administração Regional de Saúde (RHA) and, subsequently, the Agrupamentos de Centros de Saúde (HCG).

The protocol for data collection was approved by the Health Ethics Commission of the RHA of Central Portugal and the permission for using the scales mentioned above has been authorised by the respective authors.

Study participants were enrolled from GP/FMD-related social media groups, due to the COVID-19 pandemic, using an invite shared by the investigators. This invite provided a link to the server where the questionnaire had been hosted. Only one invitation was made. The questionnaire included an introductory section with an informed consent request, which is necessary for the answers to be accepted and validated. Throughout the process, the confidentiality and secrecy of the participants have been assured. In addition to the three instruments mentioned above, the questionnaire also included a set of questions to evaluate the context characteristics of the population: gender; age group; place of work (unit); career stage (internee vs specialist), and, if specialist, trainer on its or a different specialty and HCG of work.

Data collection took place between July and September 2020.

After data was collected, descriptive and inferential statistics were used. With that in mind, the 25th edition of the Statistical Package for the Social Science (SPSS) was used, with a P value of <0.01 for statistical significance. Descriptive and inferential statistics, non-parametric Mann-Whitney U; Kruskal Wallis Tests, Cronbach’s alfa if item-deleted, and F-test were used, based on the type of variable studied.

Tools

PHQ-4

PHQ-4 is a four-point Likert-type scale that evaluates how often the respondent was affected by different problems over the two weeks before the questionnaire. A score of 0 to 3 is attributed to each item (0 - Not at all; 1 - Several days; 2 - More than half the days; 3 - Nearly every day). This screening tool comprises two subscales: Anxiety/GAD-2, consisting of items 1 and 2, and Depression/PHQ-2, consisting of items 3 and 4. The total score is determined by adding together the individual scores of each of the four items, which can range between 0 and 12, allowing to classify the levels of distress in four categories: none (0-2), mild (3-5), moderate/’yellow flag’ (6-8) and severe/’red flag’ (9-12). By applying the subscale GAD-2, a result of 3 or more in the sum of the scores of the first two items suggests anxiety. In the same way, a score ≥3 in the PHQ-2 subscale identifies the individuals who may be affected by this problem. Scores >5 on any subscales should be considered ‘red flags’. For clinical use, the authors recommend considering the sum of the scale, followed by the individual study of the subscales for anxiety and depression. (12-13

EQ-5D-3L

EQ-5D-3L is a tool for health-related quality-of-life assessment. It consists of a descriptive system that allows for the characterisation of the respondent’s health state through five different dimensions: mobility, self-care, usual activities, pain/discomfort, and anxiety/depression. Each of these dimensions can be described using a three-level severity scale, corresponding to ‘no problems’ (1), ‘some problems’ (2), and ‘extreme problems’ (3), respectively. (17 The responses to the descriptive system can then be aggregated through a society value-sensitive algorithm, resulting in a value index that can be used to compare the health state of the respondent with one of the populations where they belong. For the Portuguese population, the estimated average of the utility score is 0.758. (18

SoGeMM-MGF

SoGeMM-MGF is a questionnaire aiming to assess the burden caused by the management of multimorbid patients, from a medical perspective. It comprises a total of four subscales, but only the subscale “Sentimentos Negativos - Negative Feelings” was used in this work. This subscale includes five self-assessment questions for Likert response, with five options for response each. For every item, the score ranges from 1 to 5 - the bigger the score, the higher the level of burden. (5

Results

After the initial process, the final European Portuguese version of the PHQ-4 scale was obtained (Table 1). This was applied to a sample of 46 individuals (27 from the general community and 19 doctors), with 23 (50.0%) women, 18 (39.1%) aged between 18 and 34 years old, 16 (34.8%) aged between 35 and 64 and 12 (26.1%) aged 65 or over.

Table 1 Portuguese final version of PHQ-4 

The application of the PHQ-4 scale for the first time led to a Cronbach’s alpha of 0.762, with a Cronbach’s alfa if item-deleted ranging from 0.580 (item 1) to 0.832 (item 3), with a F-test value of 23.224 (p<0.001) and an Intraclass Correlation of 0.762. In terms of the internal consistency at the second time of application of the scale, the Cronbach’s alfa obtained was 0.764, with a Cronbach’s alfa if item-deleted ranging from 0.651 (item 1) to 0.793 (item 3), the Intraclass Correlation of 0.637. These data are detailed in Table 2.

Table 2 Assessment of the value of each PHQ-4 scale item if item-deleted 

Using the Wilcoxon test to compare the answers between the two-time points, p=0.317 was obtained for «Feeling nervous, anxious or on edge», p=0.100 for «Not being able to stop or control worrying», p=0.317 for «Little interest or pleasure in doing things» and p=0.100 for «Feeling down, depressed, or hopeless».

PHQ-4 mean total scores were not statistically different based on gender (p=0.266) and age (p=0.605).

During the validation phase, a sample of 91 GP/FMD specialists and internees practicing in HCG under the coordination of the RHA of Central Portugal was studied, based on how the application of the questionnaire had been conducted.

In this convenience sample, 28.6% (n=26) were male and 78.9% (n=71) were younger than 45 years of age. Furthermore, 18.7% (n=17) of the participants worked at the UCSP, 35.2% (n=32) at the USF-A, and 46.2% (n=42) at the USF-B. Of the 43 specialists who responded to the questionnaire, 33 (76.7%), were trainers on their or for a different specialty and the majority of these were women (n=21; 63.6%). There were no statistical differences obtained based on gender (p>0.01) as shown in Table 3.

Table 3 Sociodemographic characterisation of the sample 

Using the PHQ-4 scale and given the cut-off limit of 3 in the sum of the GAD-2 subscale, 20.9% (n=19) of doctors had a positive screening for anxiety. In terms of depression, 13.2% (n=12) of participants had a positive screening. As for the levels of distress, the majority of respondents (64.8%, n=59) were not affected by this problem, while 23.1% (n=21), 8.8% (n=8), and 3.3% (n=3) showed mild, moderate and severe distress, respectively. According to Table 4, these results did not show significant gender differences (p>0.01).

Table 4 PHQ-4 scale and EQ-5D-3L scale descriptive statistics 

Based on the responses to the EQ-5D-3L scale, 52.7% (n=48) of doctors exhibited an index value lower than the one of the general population (0.758), suggesting a good quality of life. Among male participants, 53.8% (n=14) showed worse quality of life. Female participants (55.4%, n=36) presented a good quality of life. These results did not show significant gender differences (p=0.428). More detailed data can be found in Table 4.

Regarding the “Sentimentos Negativos - Negative feelings” subscale of the SoGeMM-MGF scale, the Kolmogorov-Smirnov revealed no normal distribution of its numerical score (Lillefors correction p=0.004).

Although not significantly different, the mean value of response to the subscale was higher in female GP/FMD, specific training internees, non-trainer specialists (either in their or other specialty), and among doctors working in UCSP, suggesting a greater burden of negative feelings, as shown in Table 5.

Table 5 Descriptive statistics of the “Sentimentos Negativos - Negative feelings” subscale (part of the SoGeMM-MGF scale) 

The calculations of the Spearman correlation between the PHQ-4 scale and its subscales, and the other two instruments in comparison are shown in Table 6, with moderate highly significant correlations (p<0.001).

Discussion

The aim of this work was the cross-cultural adaptation and validation to European Portuguese of the PHQ-4 scale, a compact-size screening tool, that allows the evaluation of the psychic state of an individual, in terms of anxiety, depression, and distress, in a timely and effortless way. To achieve this, the work was divided into two stages: cross-cultural adaptation and validation.

In a two-step work, the translation, verification of linguistic adaptation, and back-translation to English were initially conducted, and the reliability of the PHQ-4 scale was then evaluated. The calculation of the Cronbach’s Alfa was α=0.762 (test), and α=0.764 (retest), matching the expectations. (13 The Wilcoxon test allowed us to understand no significant differences between the responses to each scale item at the first and second times of application, confirming its reliability. After data analysis, no significant differences between the average total scores were found with PHQ-4 based on gender and age. This study’s phase was made with data from a non-medic and a GP/FMD convenience sample and supports the successful cultural adaptation of the scale.

As for the concurrent convergent validity phase, PHQ-4 showed a moderate, highly-significant correlation with the EQ-5D-3L scale (ρ=0.577; p<0.001). This correlation occurs in the expected direction: doctors with higher PHQ-4 scores, in distress, obtained a higher score in the ‘Anxiety/Depression’ domain of the EQ-5D-3L scale as well. The subscales PHQ-2 and GAD-2 also showed a positive and significant correlation with the EQ-5D-3L scale. Additionally, there was a moderate correlation between the PHQ-4 scale and the SoGeMM-MGF tool (ρ=0.518; p<0.001). Also, when doctors reported greater psychological distress associated with the management of multimorbidity, the PHQ-4 scale allowed them to corroborate this type of results. Since the values obtained are in line with published literature, it is possible to deduce that the use of the PHQ-4 scale may result in an effective and measurable screening for anxious and/or depressive states, which often affect a doctor’s well-being. The PHQ-4 scale can, therefore, contribute as a first step for a more effective approach which should be complemented by the use of more comprehensive scales and/or clinical interviews at a later stage. (19-21

This work was made in the GP/FMD specialty, as it is more directly exposed to multimorbidity in Portugal. The present results mean that the PHQ-4 scale can be adapted to the Portuguese medical GP/FMD population. However, more studies are required to evaluate the potential use of this same scale in other medical specialties, and for both cases probably with random samples.

Conclusion

The Portuguese PHQ-4 version is a valid and reliable scale that allows a quick and effortless evaluation of the psychic status of doctors in the clinical areas of anxiety, depression, and distress. A significant correlation between the score from the PHQ-4 scale, quality of life (EQ-5D-3L), and emotional burden (SoGeMM-MGF) confirms it. These results offer strong support for the validation of the PHQ-4 screening tool in Portugal.

Authors contribution

Conceptualization. LMS, and MR; methodology, LMS, and MR; software, LMS; validation, LMS, and MR; formal analysis, LMS, and MR; investigation, MR; resources, LMS, and MR; data curation, LMS, and MR; writing-original draft preparation, LMS, and MR; writing-review and editing, LMS, and MR; visualization, LMS, and MR; supervision, LMS; project administration, LMS.

Conflicts of interest

The authors declare that they have no competing interests.

References

1. Le Reste JY, Nabbe P, Manceau B, Lygidakis C, Doerr C, Lingner H, et al. The European General Practice Research Network presents a comprehensive definition of multimorbidity in family medicine and long term care, following a systematic review of relevant literature. J Am Med Dir Assoc. 2013;14(5):319-25. [ Links ]

2. Prazeres F, Santiago L. Prevalence of multimorbidity in the adult population attending primary care in Portugal: a cross-sectional study. BMJ Open. 2015;5(9):e009287. [ Links ]

3. PORDATA. Índice de envelhecimento [homepage]. PORDATA; 2020 [updated 2024 Feb 09; cited 2020 Oct 7]. Available from: https://www.pordata.pt/Municipios/Índice+de+envelhecimento-458Links ]

4. Prazeres F, Santiago L. The knowledge, awareness, and practices of Portuguese general practitioners regarding multimorbidity and its management: qualitative perspectives from open-ended questions. Int J Environ Res Public Health. 2016;13(11):1097. [ Links ]

5. Prazeres F, Santiago LM, Pereira PM, Santos PM, Cortinhal T. Multimorbilidade em medicina geral e familiar: construção e validação do Questionário de Avaliação da Sobrecarga da Gestão da Multimorbilidade em Medicina Geral e Familiar (SoGeMM-MGF). Gaz Med. 2019;6(4):221-7. [ Links ]

6. Wallace JE, Lemaire JB, Ghali WA. Physician wellness: a missing quality indicator. Lancet. 2009;374(9702):1714-21. [ Links ]

7. West CP, Shanafelt TD, Kolars JC. Quality of life, burnout, educational debt, and medical knowledge among internal medicine residents. JAMA. 2011;306(9):952-60. [ Links ]

8. de Jong MA, Nieuwenhuijsen K, Sluiter JK. Common mental disorders related to incidents and behaviour in physicians. Occup Med. 2016;66(7):506-13. [ Links ]

9. Firth-Cozens J. Individual and organizational predictors of depression in general practitioners. Br J Gen Pract. 1998;48(435):1647-51. [ Links ]

10. Frasquilho MA. Medicina, médicos e pessoas: compreender o stresse para prevenir o burnout. Acta Med Port. 2005;18(6):433-43. [ Links ]

11. Devlin NJ, Brooks R. EQ-5D and the EuroQol Group: past, present and future. Appl Health Econ Health Policy. 2017;15(2):127-37. [ Links ]

12. Kroenke K, Spitzer RL, Williams JB, Löwe B. An ultra-brief screening scale for anxiety and depression: the PHQ-4. Psychosomatics. 2009;50(6):613-21. [ Links ]

13. Löwe B, Wahl I, Rose M, Spitzer C, Glaesmer H, Wingenfeld K, et al. A 4-item measure of depression and anxiety: validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population. J Affect Disord. 2010;122(1-2):86-95. [ Links ]

14. Khubchandani J, Brey R, Kotecki J, Kleinfelder J, Anderson J. The psychometric properties of PHQ-4 Depression and Anxiety Screening Scale among college students. Arch Psychiatr Nurs. 2016;30(4):457-62. [ Links ]

15. Kerper LF, Spies CD, Tillinger J, Wegscheider K, Salz AL, Weiss-Gerlach E, et al. Screening for depression, anxiety, and general psychological distress in pre-operative surgical patients: a psychometric analysis of the Patient Health Questionnaire 4 (PHQ-4). Clin Health Promot. 2014;4(1):5-14. [ Links ]

16. Stanhope J. Patient Health Questionnaire-4. Occup Med. 2016;66(9):760-1. [ Links ]

17. Ferreira PL, Ferreira LN, Pereira LN. Contributos para a validação da versão Portuguesa do EQ-5D. Acta Med Port. 2013;26(6):664-75. [ Links ]

18. Ferreira LN, Ferreira PL, Pereira LN, Oppe M. EQ-5D Portuguese population norms. Qual Life Res. 2014;23(2):425-30. [ Links ]

19. Pais-Ribeiro J, Silva I, Ferreira T, Martins A, Meneses R, Baltar M. Validation study of a Portuguese version of the Hospital Anxiety and Depression Scale. Psychol Health Med. 2007;12(2):225-35. [ Links ]

20. Neves I, Sales C, Carlota R, Brinquete C, Magalhães A, Falcão C, et al. A relevância das medidas individualizadas: ouvimos o paciente mas captamos a história? Psicol Saúde Doenças. 2016;17(1):39-44. [ Links ]

21. Pacheco E, Santiago LM. Cross cultural adaptation and validation of the '9-item patient health questionaire'. Eur J Public Health. 2021;31(Suppl 2):ckab120.019. [ Links ]

Received: September 11, 2023; Accepted: January 07, 2024

Endereço para correspondência Luiz Miguel Santiago E-mail: luizmiguel.santiago@gmail.com

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License