The Italian version of Metacognitive Training for the acute psychiatric setting: a pilot study

Leonardo Procenesi1, Carola Di Taranto2, Gaia Cuccia1, Alberto Siracusano1,2, Cinzia Niolu1,2, Giorgio Di Lorenzo1,3

1Department of Systems Medicine, Tor Vergata University of Rome, Italy; 2Psychiatry and Clinical Psychology Unit, Fondazione Policlinico Tor Vergata, Rome, Italy; 3IRCCS Fondazione Santa Lucia, Rome, Italy.

Summary. Aim. Metacognitive Training (MCT) is an effective intervention for treating various psychiatric conditions. This pilot study is a preliminary exploration of the use of an Italian version of MCT-Acute, an adaptation for acute care settings. Materials and methods. MCT-Acute was administered to inpatients in an acute psychiatric ward, and the outcomes were compared to those of a treated-as-usual (TAU) control group. Results. The MCT-Acute group showed significantly greater improvements in global functioning (GAF), internalized stigma (ISMI), and social behavior (SBS) compared to the TAU group. The PANSS subscales also improved significantly. At 12 months of follow-up, the MCT-Acute group had a lower readmission rate and better PANSS and GAF scores. Conclusions. Although preliminary, this study suggests that MCT-ACUTE is a feasible and effective intervention in acute care settings, with benefits that may last months.

Key words. Acute psychiatric care, cognitive biases, group therapy, metacognitive training, psychiatry, psychological intervention, psychosis, severe mental illness.

Versione italiana del Training Metacognitivo per il contesto psichiatrico acuto: uno studio pilota.

Riassunto. Scopo. Il Metacognitive Training (MCT) è un intervento efficace per trattare varie condizioni psichiatriche. Questo studio pilota è un’esplorazione preliminare della versione italiana del MCT-Acute, adattamento del MCT per i contesti di cura per pazienti acuti. Metodi. MCT-Acute è stato somministrato a pazienti ricoverati in un SPDC e i risultati sono stati confrontati con un gruppo di controllo. Risultati. Il gruppo MCT-Acute ha mostrato miglioramenti significativamente maggiori nel funzionamento globale (GAF), nello stigma interiorizzato (ISMI) e nel comportamento sociale (SBS) rispetto al gruppo di controllo. Anche le sottoscale della PANSS sono migliorate significativamente. Al follow-up di 12 mesi, il gruppo MCT-Acute ha avuto un tasso di ri-ricovero più basso e punteggi migliori nelle scale PANSS e GAF. Conclusioni. Sebbene preliminare, questo studio suggerisce che MCT-Acute è un intervento applicabile ed efficace nei contesti di cura per acuti, con benefici che possono durare per mesi.

Parole chiave. Assistenza psichiatrica acuta, bias cognitivi, intervento psicologico, malattie mentali gravi, psichiatria, psicosi, terapia di gruppo, training metacognitivo.

Introduction

Metacognition can be defined as the set of abilities required to recognize and attribute mental states to oneself and others based on internal and external stimuli, reflect on mental states, distinguish mental representations from reality, and use information about mental states to make decisions, solve psychological and interpersonal problems, and master subjective suffering1.

Several studies indicate that people with various psychiatric disorders shows poor metacognitive abilities, with specific metacognitive deficits associated with various psychiatric disorders2, including schizophrenia3-6, personality disorders7, psychotic and nonpsychotic depression8, eating disorders, anxiety and substance abuse disorders9,10, and PTSD11.

Metacognitive deficits, such as causal attribution bias and jumping to conclusions, seem to play a significant cross-cutting role in acute phases, affecting mood, problem-solving abilities12, and, consequently, symptomatic improvement13, and social and occupational functioning14.

Metacognitive impairments appear also to be associated with high self-stigma15 (or internalized stigma), namely, the acceptance and self-endorsement of psychiatric patients of negative opinions and stereotypes attributed to them by society16. A high self-stigma, in turn, was associated with the severity of symptoms, risk of suicide, adherence to treatment (a risk factor for re-hospitalization17), vocational and social functioning, and poor recovery15,18.

Although recent studies demonstrate the efficacy of combining pharmacological therapy with metacognitive rehabilitation in acute phases19,20, the implementation of psychosocial interventions in acute psychiatric wards can be challenging due to several factors, such as lack of trained staff, lack of adequate time and space for interventions, short hospital stay duration, difficulty maintaining attention and drowsiness due to pharmacotherapy in patients in acute phases, and poor availability of treatments specifically adapted for this setting21.

Moritz’s Metacognition Training (MCT) is a well-established psychological intervention proven effective in addressing some of the aforementioned metacognitive deficits, leading to positive effects on clinical outcomes22. Recently, an adaptation of MCT for acute psychiatric settings (MCT-Acute) has been developed and tested with satisfactory results23.

This work describes the preliminary exploration of the use of an Italian version of MCT-Acute in an acute psychiatric hospital ward, aiming to investigate its feasibility and efficacy in the treatment of patients with severe psychopathological states.

Materials and methods

The preliminary use of our Italian version of MCT-Acute was investigated by administering it to a group of patients in our psychiatric inward for acute phases and comparing the outcome with a treated-as-usual control group (TAU) in the same ward through psychometric tests.

Once authorization was obtained from the authors of the original version (see https://lc.cx/A0Geol), the modules were translated and adapted into Italian through a multicenter effort.

Recruitment of participants

The patients recruited in this study were selected based on the following criteria:

Inclusion criteria:

1. Acute psychiatric patients admitted for inpatient care in our ward.

2. The same diagnoses considered in the validation protocol of the original version of MCT-Acute (see https://lc.cx/7sGFp8) (table 1).




Exclusion criteria:

1. Insufficient ability to express consent/refusal.

2. Inadequate knowledge of Italian.

3. Intellectual disability and dementia.

4. Previous treatment with metacognitive or any psychiatric rehabilitation therapy.

Description of the sample

As shown in Table 2, 8 (30.8%) of the 26 recruited subjects were female, and 18 (69.2%) were male.




Regarding admission status, 24 (92.3%) received voluntary psychiatric treatment, while 2 (7.7%) received involuntary psychiatric treatment during hospitalization. Regarding age, the sample had a mean age of 38.27 years (minimum age: 18 years; maximum age: 73 years; standard deviation - SD: 13.84 years) and a mean educational level of 12.42 years (min: 8 years; max: 18 years; SD: 3.56 years). At discharge, 7 (26.92%) subjects received a diagnosis within the mood disorders spectrum, 14 (53.85%) within the schizophrenia spectrum, and 5 (19.23%) within the personality disorders spectrum; only one patient in the latter group received an additional diagnosis of substance use disorder. Of the 14 subjects in the TAU group, only one patient (5.6%) underwent involuntary psychiatric treatment. Demographically, eight patients (44.4%) were female, and the remaining 10 (55.6%) were male; the mean age was 43.1 years (min: 20 years; max age: 57 years; SD: 11.57 years), and the mean level of education was 11.17 years (min: 5 years; max: 18 years; SD: 3.7 years). Nine patients (50%) received a diagnosis of mood disorders, 8 (44.4%) received a diagnosis within the spectrum of schizophrenia, and 1 (5.6%) received a diagnosis of personality disorders.

Assessment

Psychometric tests were administered to quantify general psychopathology, levels of anxiety-depressive symptoms, global functioning, and social behavior. Additionally, a self-assessment scale for mental health stigma was included. The assessment was carried out before (T0) and after (T1) the administration of MCT-Acute and at similar times for the TAU group.

The recruited subjects completed the tests before the first session (T0) and the day after they completed the MCT-Acute (T1). Furthermore, at T1, patient feedback was collected through the administration of a satisfaction questionnaire consisting of closed-ended questions on various aspects of the intervention, such as the clarity of presentation of slides and conductors, the level of comfort during the sessions, and the perceived benefit. At a 12-month follow-up (T2), patients were contacted for a brief interview and reevaluation using the PANSS scale. The TAU group patients were evaluated at time points equivalent to those used for those patients who received MCT-Acute.

Positive and Negative Syndrome Scale (PANSS)

PANSS24 is a clinical-administered rating scale with proven reliability and consists of 7 items for positive symptoms (PANSS-P), 7 for negative symptoms (PANSS-N), and 16 for general psychopathology (PANSS-G). PANSS items were also studied with a six-factor scoring as follows: Positive (PANSS-Pos, P1+P3+P5+P6+G9), Negative–Expressive (PANSS-Neg-Exp, N1+N3+N6+G7), Negative-Social (PANSS-Neg-Soc, N2+N4+G16), Disorganization (PANSS-Dis, P2+N7+N5+G10+G11+G12+G5+G13), Excitement (PANSS-Exc, P4+P7+G8+G14), and Emotional Distress (PANSS-Emo-D, G1+G2+G3+G4+G6+G15)25-29.

Hamilton Rating Scale for Depression (HAM-D)

HAM-D30 consists of 21 clinical-administered items based on a Likert scale. Several studies demonstrated good reliability31,32 in quantifying the severity of depressive symptoms and evaluating their variation throughout treatment.

Hamilton Anxiety Scale (HAM-A)

HAM-A33 is a clinical-administered scale that has been proven valid and reliable in quantifying the severity of anxiety symptoms34. It consists of 14 items rated on a 5-point Likert scale. A total score of 18 is considered pathological.

Global Assessment of Functioning (GAF)

GAF35 was included in DSM-III-R and subsequently in DSM-IV (1994) as Axis V for the global assessment of a patient’s psychosocial and occupational functioning, regardless of his psychiatric diagnosis. It consists of 10 anchor points. The total score falls on a continuum ranging from maximum functioning (100 points) to the highest level of functional impairment (1 point, associated with severe mental disorder and risk of death).

Social Behavior Scale (SBS)

SBS36 is a semi-structured interview designed to assess social skills, aggressive or suicidal ideation/behaviors, self-care, and emotional control. This study used a 17-item version and examined total scores and factors, including antisocial behavior (SBS-AB), depressive behavior (SBS-DB), social withdrawal (SBS-SW), and thought disturbances (SBS-TD)37.

Internalized Stigma of Mental Illness (ISMI)

ISMI38 is a 29-item self-administered scale that investigates the subjective experience of stigma. Higher scores indicate a higher level of internalized stigma. It has five subscales: alienation (ISMI-Al), stereotype endorsement (ISMI-St), perceived discrimination (ISMI-Dis), social withdrawal (ISMI-Soc), and stigma resistance (ISMI-Res).

MCT-Acute

MCT-Acute is an intervention of proven feasibility, acceptability, and safety23. It was developed to adapt the existing MCT for psychosis and depression39-41 and focuses on the most frequent cognitive distortions associated with psychopathological experiences in acute episodes42-44. Cognitive biases are known to promote the development and maintenance of specific psychiatric symptoms45,46, even in acute phases47. Since the manifestation of psychiatric symptoms is generally the result of a gradual alteration of cognitive, affective, and behavioral aspects48,49, strengthening metacognitive competence could help prevent future exacerbation. MCT-Acute aims to guide patients towards critical and constructive reflections on their ways of experiencing internal and external reality50,51 and improve problem-solving skills52.

MCT-Acute is a group intervention comprising seven modules administered in as many sessions. Modules are designed to be less complex than other MCT protocols and are structured with clearly delimitated phases, allowing facilitators to plan sessions flexibly. Each session follows a basic framework summarized as follows:

introduction to the topic (empathy, mood, attribution style, stigma, jumping to conclusions, coping strategies, and self-esteem);

discussion of subjective knowledge of the participants;

identification of adaptive and maladaptive cognitive styles;

psychoeducation and proposal of alternative strategies;

exercises to apply the newly acquired knowledge;

general conclusions and feedback from participants.

Sessions were held three times a week and lasted approximately 45-55 minutes. At the beginning of each group, there was an introduction in which each participant and the trainers were presented, fostering an initial sense of familiarity.

Statistical analysis

Data were entered into an MS Excel spreadsheet, and statistical analyses were performed using IBM SPSS Statistics software, version 26 for Windows.

Chi-square tests (χ2) were conducted to investigate categorical variables (diagnosis, sex, voluntary admission). Continuous variables were investigated with the Wilcoxon signed rank test for the variation of psychometric tests at T1 and the Mann-Whitney test for the differences between the MCT-Acute and TAU groups. The effect size (ES) was investigated with coefficient r (r=Z/√N), and an ES was considered small, medium, or large when it exceeded the values of 0.1, 0.3, and 0.5, respectively53.

Results

At T0, no significant differences emerged between the two groups for the parameters considered (table 2).

As indicated in table 3, the variation at T1 of the mean scores of all tests is statistically significant, with almost all showing a large ES.




The comparison between the variations at T1 of the psychometric test scores for the two groups is summarized in table 4.




Statistically significant differences were found in the variation of the scores on the PANSS subscales of general psychopathology and symptoms of disorganization, as well as on the GAF and ISMI scales (total score and subscales of alienation, stereotype endorsement, and experience of discrimination), and on the SBS scale (total score and subscales of antisocial behavior, depressive behavior, and social withdrawal), with ES ranging from medium to large, except for the discrimination subscale of ISMI.

Regarding the follow-up period, readmission could be investigated for all 44 study subjects, but only 12 of the 26 in the MCT-Acute group and 8 of the 18 in the TAU group gave their consent to the reassessment of T2. The rate of readmission to the psychiatric ward in patients of the MCT-Acute group (19.23%) was significantly lower compared to the TAU group (55.56%), with a statistically significant difference (χ2= .25, p=0.02).

Furthermore, a statistically significant difference was observed for the mean scores of the PANSS scales (total score, PANSS-G, PANSS-Dis, PANSS-Exc, and PANSS-Emo-D) and GAF at T2 compared to T1 and T0. ES was large in the MCT-Acute group for all variables reported, except for PANSS-Exc (medium ES) (table 5).




Discussion

The Italian version of MCT-Acute appears to be a suitable treatment in the Italian context of acute psychiatric care. None of the participants discontinued treatment or requested to do it. The feedback from the satisfaction questionnaire administered at T1 was generally positive regarding perceived relevance and usefulness, clarity, and administration methods. Additionally, the mean scores of the scales at T1 suggest that the administration of this intervention does not hinder the general improvement of the patients.

The comparison between the data from the MCT-Acute group and the TAU group at T1 appears encouraging. The MCT-Acute group showed a markedly greater improvement in the “global psychopathology” subscale and the “disorganization” factor of the PANSS, suggesting the potential of MCT-Acute to address specific dimensions of psychopathology.

The mean greater improvement in the GAF and SBS score (total score and three factors, antisocial and depressive behavior, and social withdrawal) of the sample is in line with this concept. As mentioned above, GAF evaluates patients from a “global”, multidimensional perspective, not limited to psychopathology. The variation in its score for the MCT-Acute group appears to reflect the effects of the intervention on metacognitive performance and coping strategies, which are closely related to personal, social, and occupational life14.

The greater reduction in ISMI scores in the MCT-Acute group is an expected result, as one of the MCT-Acute modules focuses specifically on stigma, challenging stereotypes about individuals with mental disorders, and attempting to reduce the sense of alienation through normalization. In addition, it provides some advice on how to communicate one’s diagnosis, facilitating the request for help and preventing future relapses. Given that one of the aims of psychiatric rehabilitation is to guide the awareness and acceptance of limitations to deal with them in a recovery-oriented management of mental disorders, this result is encouraging and worthy of further exploration, hopefully with a direct investigation of the possible role of insight improvement.

ISMI and SBS include a “social withdrawal” factor, but a statistically significant improvement compared to TAU could be observed only in SBS. A possible reason for this finding could be the disparity between the perspectives of the patients and the observer (ISMI, unlike SBS, is self-administered), with a possible role of the patient’s partial self-awareness. Another explanation could be the tendency of the cited scales to detect the impact of different aspects of mental illnesses on relational life. As a matter of fact, ISMI-Soc investigates active withdrawal as a direct effect of shame from the internalized stigma37, while SBS-SW explores the social consequences of slowness, lack of concentration, and poor initiative in communication and activity38.

No statistically significant differences were observed between the MCT-Acute and TAU groups in the variations at T1 of the scores of HAM-D, HAM-A, SBS-TD, ISMI-Soc, ISMI-Res as well as of total and some subscales scores of the PANSS. The timing of the reassessment, related to typically short hospital stays in psychiatric emergency wards, together with possible concurrent psychopharmacological treatment, may have influenced the overall findings. Although the pharmacological component often takes precedence during acute phases due to its well-established short-term efficacy, the multidisciplinary approach remains the gold standard in psychiatric care. MCT-Acute, targeting the cognitive distortions that underlie psychiatric symptoms, appears to be a promising intervention that may not primarily lead to an immediate observable reduction in the severity of acute symptoms but could play a crucial role in laying the foundation for longer-term recovery.

Furthermore, it is essential to remember that psychiatric rehabilitation is not limited to symptom reduction. Its broader objective is to promote comprehensive functional recovery, and in this sense, MCT-Acute holds significant promise as a tool that complements pharmacotherapy and promotes improvements beyond the acute phase.

Consistent with this, the analysis of the follow-up data (T2) shows a more favorable variation in the mean PANSS scores for the MCT-Acute group compared to the TAU group, not only for the same factors discussed for T1 but also for “emotional distress” and the total score. The coherence of T1 and T2 data appears to reinforce the specific dimensions on which MCT-Acute exerts its effects, while the additional improvements observed in these new scores suggest a progressive consolidation of therapeutic benefits over time. A possible explanation for this trend is that MCT-Acute help participants accept their condition, internalize the importance of treatment adherence, and recognize certain experiences as symptoms, thereby fostering enduring and broader improvements in psychopathology.

Additionally, the 1-year rehospitalization rate for acute psychiatric episodes was significantly lower for the MCT-Acute group. These encouraging findings suggest a durable benefit of MCT-Acute.

As previously stated, this study is a preliminary investigation into the applicability of an Italian version of MCT-Acute. However, it has several limitations, the most significant being the small sample size, which is insufficient to fully demonstrate the feasibility and effectiveness of the intervention. Recruitment was undoubtedly affected by the typically short duration of hospitalization, which often does not allow enough time to administer MCT-Acute. The mean duration of the stay in Italy is 12.7 days54. As mentioned earlier, this limited timeframe also hampers the comprehensive assessment of changes in psychopathological and functioning indices. The brief stay in acute psychiatric wards is generally incompatible with the time required for MCT-Acute, which includes seven sessions with intervals deemed important for the internalization of content. These constraints limit the investigation of the intervention’s impact and highlight the challenge of implementing it within such a short timeframe. Furthermore, some patients (an average 6.2% in Italy)54 are admitted involuntarily to the ward, often due to a refusal of the proposed treatment, including psychological interventions. This may introduce a potential selection bias, as the patients included in the study are likely those with a minimum level of treatment adherence or longer-than-average hospital stays, which could affect the generalizability of the findings.

The limitation of sample size becomes even more evident at T2, with the dropout of some patients from both groups and, in some of the remaining, the refusal to undergo a detailed evaluation, which could help detect possible differences between groups underlying the improvement of the MCT-Acute group compared to the TAU group.

While MCT-Acute is designed as a transdiagnostic intervention, the diagnostically heterogeneous sample in this study limits the ability to evaluate its feasibility and efficacy within specific diagnostic categories or to identify differences in outcomes across diagnostic groups.

Furthermore, as our study primarily focused on feasibility and effectiveness, it did not explore the potential mechanisms underlying the observed improvements.

However, the results of this preliminary study indicate potential medium-term benefits, warranting further investigation in larger, more comprehensive studies. Increasing the sample size, potentially through a multicenter effort, could help confirm the feasibility and efficacy of the intervention while exploring potential variability among nosological categories. Investigating the administration of MCT-Acute in acute outpatient settings, such as day hospital services, may also be worthwhile, as these settings pose fewer intrinsic environmental challenges21. Moreover, the delivery of MCT-Acute – comprising seven almost-independent modules – could begin in hospital wards and be completed in alternative care settings, such as day hospitals and post-acute residential facilities. This approach could address the mismatch between the average inpatient stays and the duration of the intervention, as well as the potential selection bias discussed earlier.

Furthermore, as some participants reported moderate difficulty maintaining attention throughout the sessions in the satisfaction questionnaire, it may be worthwhile to test the inclusion of breaks, which could align with the modular structure of the sessions.

Future studies could also include an in-depth exploration of mediating and moderating factors to identify specific pathways through which MCT-Acute exerts its effects, such as enhancing cognitive flexibility, improving insight, or fostering more positive attitudes toward medication or psychiatric care. Additionally, implementing shorter-term or multi-phase follow-ups could help reduce dropout rates, provide a more comprehensive evaluation of long-term outcomes, and account for potential variabilities emerging after the intervention.

Finally, in the Italian context, this work suggests that the version employed is applicable for research purposes and potentially for clinical implementation.

Conclusions

The main purpose of this study was to explore the applicability of an Italian version of MCT-Acute in the context of acute psychiatric care in Italy. Although preliminary, this study suggests that the administration of MCT-Acute does not diminish the benefits of the conventional intervention for acute psychiatric episodes in the dimensions explored and may even lead to an improvement in some of these, particularly global functioning and self-stigma. Data on rehospitalization rates suggest that the benefits of MCT-Acute may persist for months. The results of this work are considered encouraging and worthy of confirmation and further investigation.

Conflict of interests: the authors have no conflict of interests to declare.

Acknowledgments: GDL was supported by #NEXTGENERAIONEU (NGEU) and funded by the Ministry of University and Research (MUR), National Recovery and Resilience Plan (NRRP), project MNESYS (PE0000006) – (DN. 1553 11.10.2022).

References

1. Carcione A, Nicolò G, Pedone R, et al. Metacognitive mastery dysfunctions in personality disorder psychotherapy. Psychiatry Res 2011; 190: 60-71.

2. Dimaggio G, Lysaker PH (eds). Metacognition and severe adult mental disorders: from research to treatment. Routledge: Taylor & Francis Group, 2010.

3. Brüne M. “Theory of mind” in schizophrenia: a review of the literature. Schizophr Bull 2005; 31: 21-42.

4. Harrington L, Siegert RJ, McClure J. Theory of mind in schizophrenia: a critical review. Cogn Neuropsychiatry 2005; 10: 249-86.

5. Lysaker PH, Buck KD. Neurocognitive deficits as a barrier to psychosocial function in schizophrenia: effects on learning, coping, & self-concept. J Psychosoc Nurs Ment Health Serv 2007; 45: 24-30.

6. Barnicot K, Michael C, Trione E, et al. Psychological interventions for acute psychiatric inpatients with schizophrenia-spectrum disorders: a systematic review and meta-analysis. Clin Psychol Rev 2020; 82: 101929.

7. Semerari A, Colle L, Pellecchia G, et al. Metacognitive dysfunctions in personality disorders: correlations with disorder severity and personality styles. J Pers Disord 2014; 28: 751-66.

8. Yamada K, Inoue Y, Kanba S. Theory of mind ability predicts prognosis of outpatients with major depressive disorder. Psychiatry Res 2015; 230: 604-8.

9. Taylor GJ, Bagby RM, Parker JDA. Disorders of affect regulation: alexithymia in medical and psychiatric illness. Cambridge: Cambridge University Press, 1997.

10. Vanheule S, Desmet M, Meganck R, Bogaerts S. Alexithymia and interpersonal problems. J Clin Psychol 2007; 63: 109-17.

11. Megías JL, Ryan E, Vaquero JM, Frese B. Comparisons of traumatic and positive memories in people with and without PTSD profile. Applied Cognitive Psychology 2007; 21: 117-30.

12. Lysaker PH, Kukla M, Leonhardt BL, et al. Meaning, integration, and the self in serious mental illness: Implications of research in metacognition for psychiatric rehabilitation. Psychiatr Rehabil J 2020; 43: 275-83.

13. Nicolò G, Dimaggio G, Popolo R, et al. Associations of metacognition with symptoms, insight, and neurocognition in clinically stable outpatients with schizophrenia. J Nerv Ment Dis 2012; 200: 644-7.

14. Kukla M, Faith LA, Lysaker PH, Wiesepape C, Corbière M, Lecomte T. Total metacognitive capacity predicts competitive employment acquisition across 6 months in adults with serious mental illness receiving psychiatric rehabilitation services. J Nerv Ment Dis 2022; 210: 869-73.

15. Dubreucq J, Plasse J, Franck N. Self-stigma in serious mental illness: a systematic review of frequency, correlates, and consequences. Schizophr Bull 2021; 47: 1261-87.

16. Yanos PT, Roe D, Markus K, Lysaker PH. Pathways between internalized stigma and outcomes related to recovery in schizophrenia spectrum disorders. Psychiatr Serv 2008; 59: 1437-42.

17. Berardelli I, Sarubbi S, Rogante E, et al. Exploring risk factors for re-hospitalization in a psychiatric inpatient setting: a retrospective naturalistic study. BMC Psychiatry 2022; 22: 821.

18. Yanos PT, DeLuca JS, Roe D, Lysaker PH. The impact of illness identity on recovery from severe mental illness: a review of the evidence. Psychiatry Res 2020; 288: 112950.

19. Haga S, Kobayashi M, Takehara A, Kawano K, Endo K. Efficacy of metacognitive training for patients with schizophrenia in psychiatric emergency wards: a pilot randomized controlled trial. Front Psychol 2022; 13: 861102.

20. Fischer R, Scheunemann J, Bohlender A, Duletzki P, Nagel M, Moritz S. ‘You are trying to teach us to think more slowly!’: adapting metacognitive training for the acute care setting - a case report. Clin Psychol Psychother 2022; 29: 1877-85.

21. Evlat G, Wood L, Glover N. A systematic review of the implementation of psychological therapies in acute mental health inpatient settings. Clin Psychol Psychother 2021; 28: 1574-86.

22. Moritz S, Menon M, Balzan R, Woodward TS. Metacognitive training for psychosis (MCT): past, present, and future. Eur Arch Psychiatry Clin Neurosci 2023; 273: 811-7.

23. Fischer R, Nagel M, Schöttle D, et al. Metacognitive training in the acute psychiatric care setting: feasibility, acceptability, and safety. Front Psychol 2023;14: 1247725.

24. Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull 1987; 13: 261-76.

25. Van den Oord EJ, Rujescu D, Robles JR, et al. Factor structure and external validity of the PANSS revisited. Schizophr Res 2006; 82: 213-23.

26. van der Gaag M, Hoffman T, Remijsen M, et al. The five-factor model of the Positive and Negative Syndrome Scale II: a ten-fold cross-validation of a revised model. Schizophr Res 2006; 85: 280-7.

27. Wallwork RS, Fortgang R, Hashimoto R, Weinberger DR, Dickinson D. Searching for a consensus five-factor model of the Positive and Negative Syndrome Scale for schizophrenia. Schizophr Res 2012; 137: 246-50.

28. Liemburg E, Castelein S, Stewart R, et al. Two subdomains of negative symptoms in psychotic disorders: established and confirmed in two large cohorts. J Psychiatr Res 2013; 47: 718-25.

29. Di Lorenzo G, Daverio A, Ferrentino F, et al. Altered resting-state EEG source functional connectivity in schizophrenia: the effect of illness duration. Front Hum Neurosci 2015; 9: 234.

30. Hamilton M. Development of a rating scale for primary depressive illness. Br J Soc Clin Psychol 1967; 6: 278-96.

31. Hedlund JL, Vieweg BW. The Hamilton rating scale for depression: a comprehensive review. Journal of Operational Psychiatry 1979; 10: 149-65.

32. Cicchetti DV, Prusoff BA. Reliability of depression and associated clinical symptoms. Arch Gen Psychiatry 1983; 40: 987-90.

33. Hamilton M. The assessment of anxiety states by rating. Br J Med Psychol 1959; 32: 50-5.

34. Maier W, Buller R, Philipp M, Heuser I. The Hamilton Anxiety Scale: reliability, validity and sensitivity to change in anxiety and depressive disorders. J Affect Disord 1988; 14: 61-8.

35. Endicott J, Spitzer RL, Fleiss JL, Cohen J. The global assessment scale. A procedure for measuring overall severity of psychiatric disturbance. Arch Gen Psychiatry 1976; 33: 766-71.

36. Wykes T, Sturt E. The measurement of social behaviour in psychiatric patients: an assessment of the reliability and validity of the SBS schedule. Br J Psychiatry 1986; 148: 1-11.

37. Cella M, Stratta P, Chahal K, Huddy V, Reeder C, Wykes T. Measuring community functioning in schizophrenia with the Social Behaviour Schedule. Schizophr Res 2014; 153: 220-4.

38. Ritsher JB, Otilingam PG, Grajales M. Internalized stigma of mental illness: psychometric properties of a new measure. Psychiatry Res 2003; 121: 31-49.

39. Moritz S, Woodward TS. Metacognitive training in schizophrenia: from basic research to knowledge translation and intervention. Curr Opin Psychiatry 2007; 20: 619-25.

40. Moritz S, Veckenstedt R, Bohn F, Köther U, Woodward TS. Metacognitive training in schizophrenia. Theoretical rationale and administration. In: Roberts DL, Penn DL (eds). Social cognition in schizophrenia. From evidence to treatment. New York: Oxford University Press, 2013.

41. Moritz S, Andreou C, Schneider BC, et al. Sowing the seeds of doubt: a narrative review on Metacognitive training in schizophrenia. Clin Psychol Rev 2014; 34: 358-66.

42. Nelson TO. Metamemory: a theoretical framework and new findings. In: Bower GH (ed). Psychology of Learning and Motivation. (Vol. 26) London: Academic Press, 1990.

43. Frith CD. The Cognitive Neuropsychology of Schizophrenia (1st ed.). London: Psychology Press, 1992.

44. Biedermann F, Frajo-Apor B, Hofer A. Theory of mind and its relevance in schizophrenia. Curr Opin Psychiatry 2012; 25: 71-5.

45. Perdighe C, Mancini F. Elementi di psicoterapia cognitiva. Roma: Fioriti Editore, 2010.

46. Freeman D. Suspicious minds: the psychology of persecutory delusions. Clin Psychol Rev 2007; 27: 425-57.

47. Kerr N, Dunbar RI, Bentall RP. Theory of mind deficits in bipolar affective disorder. J Affect Disord 2003; 73: 253-9.

48. Moritz S, Vitzthum F, Randjbar S, Veckenstedt R, Woodward TS. Detecting and defusing cognitive traps: metacognitive intervention in schizophrenia. Curr Opin Psychiatry 2010; 23: 561-9.

49. Stratta P, Bustini M, Daneluzzo E, Rossi A. Metacognitive ability assessment in schizophrenic disorder: from cognitive function to real world. Italian Journal of Psychopathology 2008; 14: 75-9.

50. Moritz S, Veckenstedt R, Randjbar S, Vitzthum F, Woodward TS. Antipsychotic treatment beyond antipsychotics: metacognitive intervention for schizophrenia patients improves delusional symptoms. Psychol Med 2011; 41: 1823-32.

51. Moritz S, Kerstan A, Veckenstedt R, et al. Further evidence for the efficacy of a metacognitive group training in schizophrenia. Behav Res Ther 2011; 49: 151-7.

52. Vita A (ed). La riabilitazione cognitiva della schizofrenia: principi, metodi e prove di efficacia. Milan: Springer, 2013.

53. Rosenthal R. Parametric measures of effect size. In: Cooper H, Hedges LV (eds). The handbook of research synthesis. New York: Russell Sage Foundation, 1994.

54. Ministero della Salute. Rapporto salute mentale 2022. Roma: Ministero della Salute 2023.