https://orcid.org/0000-0002-4448-0478
Figures
Abstract
Background
A comprehensive, comparable assessment of the economic disease burden and the value of relevant care forms a major challenge in the case of mental diseases. This study aimed to inform the development of a resource use measurement (RUM) instrument and harmonized reference unit costs valid for multi-sectoral and multi-national cost assessments for mental health diseases as part of the European PECUNIA project.
Methods
An iterative, multi-methods approach was applied. Systematic literature reviews appended with national grey literature searches in six European countries were conducted to generate preliminary, literature-based, international, mental health-related service and resource use lists for all investigated sectors in 2018. As part of a multi-national expert survey, these lists were reviewed by 18 Austrian sector-specific experts regarding the clarity, relevance, comprehensiveness and availability in the Austrian context.
Results
Out of 295 items included in the preliminary, international, sector-specific lists (health and social care—201 items, criminal justice—35 items, education—39 items; patient, family and informal care—20 items), a total of 261 items and descriptions (88%) were considered clear by all experts. 42 items (14%) were considered not existing in Austria, and 111 items (38%) were prioritized regarding their relevance in the national context. Thirteen additional items (4%) were suggested to be added to accommodate for Austria-specific features of the individual sectors. Major typological difficulties based on item names were observed.
Conclusions
The identified country-specific variations and general typological bias and their potential contributions to service and resource use cost variations across countries and sectors call for further systematic investigation. Next, PECUNIA will develop internationally harmonized and comparable definitions of the listed items and their units of analysis based on a new conceptual multi-sectoral costing framework. The developed lists will require consolidation and further prioritization for the development of a patient-reported RUM instrument and consequent reference unit cost valuation.
Citation: Fischer C, Mayer S, Perić N, Simon J, on behalf of the PECUNIA Group (2022) Establishing a comprehensive list of mental health-related services and resource use items in Austria: A national-level, cross-sectoral country report for the PECUNIA project. PLoS ONE 17(1): e0262091. https://doi.org/10.1371/journal.pone.0262091
Editor: Athina Economou, University of Thessaly, GREECE
Received: April 16, 2021; Accepted: December 16, 2021; Published: January 21, 2022
Copyright: © 2022 Fischer et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: This study aimed to inform the development of a resource use measurement instrument and harmonized reference unit costs valid for multi-sectoral and multi-national cost assessments for mental health diseases as part of the European PECUNIA (ProgrammE in Costing, resource use measurement and outcome valuation for Use in multi-sectoral National and International health economic evaluAtions (grant agreement No 779292)) project. This research project was funded by the European Union’s Horizon 2020 research and innovation programme. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The competing interests statement has been added to the manuscript.
Introduction
A comprehensive and comparable assessment of the economic burden of a disease and the value of relevant care in economic evaluations across sectors and countries are in general difficult, however, it is especially of a challenge in the case of mental diseases [1]. One factor is the reliability of the measurement and the different thresholds regarding the epidemiology of diseases [2,3]. Even minor changes in definitions may cause considerable variation in the estimation of disease prevalence and service utilization [4,5]. Another factor is that although the economic burden of mental diseases in regards to costs is thought to be massive [6], resulting in doubled total costs for persons with mental diseases compared to those without [7], calculating exact costs is complicated [8,9].
This is particularly the case if health care provision and funding are both fragmented, such as in Austria [10,11]. In the Austrian health care system, the principal responsibility for the public health system is shared by the central government, nine federal state governments and agents. There is no gate-keeping system in place, which means that medical services and treatments can be utilized to a great extent and with great variety across different regions [10,12]. Around 37% of Austrians have complementary private health insurance [13], resulting in a two-tier healthcare system.
For many ill-health conditions, such as mental diseases, the economic consequences are not limited to the healthcare sector, but also spread to other sectors [14]. These interventions within the healthcare sector, which have consequences spilling over to other sectors, are referred to as inter-sectoral costs and benefits (ICBs) [15]. Relevant sectors include the social sector (e.g. through social care), the criminal justice system (e.g. through police interventions), the education sector (e.g. through special education needs), and the patient and family domains (e.g. due to informal caregiving activities). Next to direct cost consequences (e.g. service costs, out-of-pocket costs) and tangible consequences that can be valued in monetary terms (e.g. changes in productivity, care giving or in the level of vandalism), also the consideration of non-monetary, intangible consequences (e.g. stigma) is crucial in the case of mental health. By considering all these types of ICBs, the perspective from which an economic evaluation is conducted will be comprehensive enough to form a valid decision base for decision makers and qualifies to be categorized as the perspective type that is broadest and most advocated, which is the societal perspective. [16]
Internationally, there have been different attempts to assess the costs of mental diseases in the healthcare sector. Nevertheless, health economic studies often adopt the healthcare sector perspective in their analysis and do not include costs affecting sectors beyond [e.g. [17,18]]. In a recent review of published health economic evaluations in Austria, only one study could be identified that included costs from the criminal justice sector [19]. This might be due to the lack of available data and valuation methods [20]. At the same time, these inter-sectoral costs were found to contribute a considerable proportion to the total costs of mental diseases [7,15,21,22]. With economic evaluations being increasingly used as a base for decision making in healthcare, a comprehensive reflection of the societal costs associated with a disease is also vital in this context and has been already recommended in national health economics guidelines in the Netherlands and Spain [23,24]. While intangible consequences so far lack monetary considerations in economic evaluations, differences in costing methodologies for direct costs and tangible consequences between studies and countries often result in incomparable (unit) cost estimates [25–28]. Developing methodology to tackle the latter problem in practice was the main focus of the EU project PECUNIA, i.e. the ProgrammE in Costing, resource-use measurement and outcome valuation for Use in multisectoral National and International health economic evaluAtions. PECUNIA aims to establish standardised costing and outcome assessment systems that directly enable comparability, applicability and transferability of cost-effectiveness evidence for health-related interventions across sectors and countries [29,30]. The streams of work focused on the assessment of costs across multiple sectors related to health and social care (HCSC), criminal justice (CJ), education (ED), employment and productivity (EP), and patient, family and informal care (PFI) alongside four horizontal methodological axes following the steps of identification, definition, measurement and valuation of resources in the relevant work streams. Further information on the PECUNIA project can be found elsewhere [29–31].
The aim of this study was to synthesize international and national information on relevant services related to mental diseases in general, and three specific disease areas (depression, schizophrenia and post-traumatic stress disorder (PTSD)) across multiple sectors, and subject it to expert assessment in Austria. This will inform the development of a patient-reported resource use measurement (RUM) instrument targeted at adults and adolescents and harmonized reference unit costs valid for multi-sectoral and multi-national cost assessments as part of the European PECUNIA project.
Methods
This study was conducted as part of the first identification step in PECUNIA, which aimed at collating mental health-related services and resource use items within the relevant sectors for Europe using six selected countries (Austria, Germany, Hungary, the Netherlands, Spain, the United Kingdom). Methods followed a cross-sectoral and cross-country harmonized approach similar to earlier research conducted for Germany [8]. For the employment and productivity sector, a systematic literature review of measurement instruments of productivity loss of paid and unpaid work was conducted. In consequence, these instruments underwent a newly designed appraisal framework to assess their content validity and suitability in terms of availability, feasibility, and applicability for their use in economic evaluations from a societal perspective. The methodology of this adopted approach is covered in detail elsewhere [32].
An overview of the development process steps of the international sector-specific item lists is provided in Fig 1 and described in detail in the section below.
Compilation of the preliminary, international, sector-specific item lists
The identification process commenced with systematic literature reviews to generate a preliminary, literature-based, international, mental health-related sector-specific service and resource use item lists. The searches were adapted to sector specific needs. For example, for the HCSC sectors the search focused on cost-of-illness studies and cost-effectiveness analyses. In contrast, the search for the CJ sector was not limited to a specific study design. Summaries of the main methodological characteristics of the conducted systematic literature searches and their necessary sector specific adaptions are presented in S1 Table. Full descriptions have been published elsewhere [33,34]. They included sector-specific, peer-reviewed publications and were conducted at sector level to serve as a scientific foundation. Further, country and sector-specific grey literature searches were carried out in all six selected countries to complement the preliminary, literature-based, sector-specific, mental-health related lists of services and other resource use items such as ICBs for the investigated sectors in Europe. Services were defined as “describ[ing] a combined and coordinated set of inputs (including structure, staff and organization) that can be provided to different user groups in a given sector (e.g. education) and under a common domain (e.g. child care), to improve the individual or population [health] status and/or functioning, or to attain a set of defined goals within a given sector.” [35].
The second step aimed at developing a first consolidated literature-based list of services and other resource use items such as ICBs in English for each included sector including short initial item descriptions/definitions (in MsExcel® 2013), hereinafter referred to as ‘preliminary item lists’. Definitions were taken from the original sources or based on internet search. Although the HCSC sectors are generally considered to be two separate sectors, services and experts from the two sectors are increasingly integrated around the needs of individuals, their carers and other family members. Therefore, it was decided to treat these two sectors in a combined manner and create one HCSC item list. The same applied to the item lists developed for PFI sectors.
For the HCSC sectors, the initial international literature-based list was further extended to accommodate for a special characteristic of the Austrian health care system. In Austria, outpatient specialist services (e.g. provided by a gynecologist) may be delivered both in the ambulatory care sector (i.e. in physician practices) and in hospital outpatient wards [13]. As unit costs for services provided inside or outside a hospital may be fairly different [36], further specifications of the items were necessary for the Austrian expert survey. Relevant outpatient items were thus separated into ‘outside the hospital, in physician practices’ versus ‘in hospital outpatient ward’.
Further in this step, any problems regarding the allocation of services to the specific sectors was tackled. In cases where one service potentially crossed multiple sectors, the service and its description were discussed in detail within the PECUNIA Consortium until consensus was reached between the team of researchers regarding the main sector of provision. This was based on the general rule developed and used in the PECUNIA costing concept that the sector specificity of a service should be determined by its provision and not its funding, since the latter one is often complex or blurry and cannot be allocated clearly to a single sector. In the case of some services, that the service had to be allocated to two different sectors and the service descriptions had to be adapted to enable a clear distinction of the scope of the activities distinguishing them (e.g. home assistance).
National expert survey
The final step aimed at critically assessing these literature-based, sector-specific preliminary item lists by national experts as part of a multi-national expert survey. Based on the initial national grey literature search and additional systematic assessment of sector-specific websites and documents of Austrian institutions and stakeholders, potential experts were identified. Invited experts included stakeholders, decision-makers, people actively working in the field and researchers with sector-specific applied expertise. Initially identified experts were also asked to recommend additional experts (snowballing). A purposive sampling approach was adopted [37,38]. Austria being a federal state with fragmented competencies in the different sectors and regions, experts were recruited from both the national and regional levels to accommodate for potential regional variations. To allow for representative assessment, an equal number of experts from different stakeholder groups and a maximum of two experts per institution were invited. Two participating experts per sector were considered the minimum target. An overview of the experts considered for recruitment for the expert survey within the specific sectors are shown in S2 Table.
For the multi-national expert survey, survey instructions, standardized email templates and informed consent forms were created. Survey participants were invited to review each service list regarding the clarity of the listed items, relevance (frequency of use or proportion of sector-specific costs), completeness and existence within the national context. To this end, experts were firstly asked to comment on the naming and short descriptions of the listed items in terms of clarity and accuracy. Open-ended questions were included to also provide experts with the opportunity to comment on non-existing and missing items. Secondly, experts for the HCSC and PFI sectors were asked to assess the frequency of use based on the listed items for mental health patients in general as well as for the three exemplary disease categories (depression, schizophrenia and PTSD). Items with a use frequency of >10% were ‘prioritized’. In the surveys on the CJ and ED sectors, experts were additionally asked to rank the most important items (5 in the ED sector and 8 in the CJ sector) from an economic perspective based on frequency of occurrence/use and costliness from 1 (most important) to 5/8 (least important).
This section of the surveys consisted of closed-ended questions. The surveys including the item lists and short descriptions were generally provided in English and were designed to take between 30 and 60 minutes to complete. An overview of questions and answer options of the sector-specific expert surveys are provided in S3 Table.
An email invitation was sent out and experts were contacted where feasible mid-November 2018. These experts were provided with a written information leaflet (containing information on the study purpose, data security, etc.). No minors were included. Those experts who agreed to take part in the study were provided with the given sector-specific preliminary item list as well as a written informed consent form. In the consent form, experts could indicate whether they wanted their name and affiliation to be mentioned on the PECUNIA project website and/or in the acknowledgement section of any related publication, or if they preferred to stay anonymous altogether. The survey ran until the end of January 2019 with multiple reminders. When requested, experts were supported in the completion of the survey via phone. The expert survey study involved no patients or interventions, therefore, ethical approval by the Medical University of Vienna was not considered necessary. Survey results were analysed by calculating frequencies of the highly prioritized items, unclear and not existing items. Due to the limited number of responses and to assure data protection, expert survey data may be provided upon request from the corresponding author in aggregated form per sector.
Results
Preliminary, international, sector-specific item lists
For the HCSC sectors, combining the accumulated items retrieved from the systematic literature reviews and the national grey literature searches resulted in a total of 201 items and revealed major difficulties in the differentiation of services and interventions suggestive of a considerable underlying typological problem based on item names. A total of 35 items were included in the list for the CJ sector and 39 items for the ED sector. For the list in the PFI sectors, 20 items were included based on the systematic literature review. An overview of the sources of the identified items in the preliminary, international sector-specific list is shown in Fig 2.
Abbreviations: AT–Austria, DE–Germany, NL–the Netherlands, HU- Hungary, ES–Spain, UK–United Kingdom, ICB–inter-sectoral costs and benefits.
National expert survey
Survey participants.
Of the 83 Austrian experts who were initially invited to participate in the survey, 50 experts (60%) did not respond to the general email invitation, while 33 experts (40%) consented to take part in the study and were included in the survey. Among the experts who initially consented to take part, 15 (45%) did not return the survey. Only four experts reported their reasons for dropping out, including perceived data protection issues, inability to provide data-driven responses and language barriers. The other eleven experts were lost to follow-up. A total of 18 experts completed the sector-specific Austrian surveys, therefore, the pre-specified, minimally required responses by two experts per sector were achieved for all sectors (Table 1).
Among completers, 9 were female and 9 were male. The majority of these experts (n = 10) were based in Vienna (Salzburg: n = 3, Lower Austria: n = 2, Styria, Burgenland and Upper Austria: n = 1, respectively). Although no experts from the federal states Vorarlberg, Carinthia and Tyrol could be recruited, several of the participating experts were representatives of national institutions, and therefore they were able to provide national estimates in their survey responses. The expert survey included four representatives of patient organizations, three psychiatrists, two representatives of health insurance funds, four service providers, two policymakers and three representatives of federal state authorities.
Survey results.
Out of a combined number of 295 items included in the preliminary item lists sent out to the experts, a total of 261 items and descriptions (88%) were considered clear by all experts. 43 items (15%) were considered not existing in Austria by at least one expert, and 110 items (37%) were prioritized in regards to their use frequency. A total of 13 additional items (4%) were suggested for addition to accommodate the Austria-specific features of the individual sectors. An overview of the results by sector is provided in the subsequent sections.
Health and social care (HCSC) sectors. Altogether, seven experts commented on 201 items in the preliminary HCSC sectors list. The items were grouped as inpatient ((non-)mental health hospital unit, medical/laboratory procedures), outpatient (outpatient (non-) mental health-specific physician, outpatient non physician (nursing services, alternative services/institutions, pharmacy)), cross-categorial (including both, inpatient and outpatient services) services (rehabilitative, psychiatric, therapeutic and diagnostic procedures), and non-medical costs for (social) support, living support and vocational support. 77 items (38.3%) had an estimated use frequency >10% of persons with mental diseases and were prioritized (see items in bold). Details on the perceived item clarity (twenty-one unclear items (10,4%)) and existence (twenty-six non-existent items (12,9%)), as well as the six suggested additional items can be seen from Table 2.
Criminal justice (CJ) sector. Two experts reviewed the 35 items in the preliminary CJ sector list. The items were grouped as costs incurred as a consequence of crime (including offences against the person or property; psychological, material or other crime consequences) and costs incurred in response to crime (including law enforcement, victim/witness support and other). Nine items (25.7%, six items in the section ‘costs incurred as a consequence of crime’, three items in the section ‘costs incurred in response to crime’) were ranked among the most important items from an economic perspective by at least one of the experts (see items in bold). The three considered unclear items (8.6%) and three non-existent items in Austria (8.6%) can be seen in Table 3. No new items for suggested for the CJ sector list.
Education (ED) sector. Four experts commented on the 39 items in the preliminary list for the ED sector, which were grouped into intangible and tangible ICBs. Tangible ICBs encompassed services within the educational sector aimed at students with mental diseases (i.e. special education). Intangible ICBs referred to the consequences of mental health diseases experienced by students that could have an influence on the educational sector (i.e. cognitive deficits). The idea behind the chosen classification reflects the aspects of the impact of mental health interventions on either costs (or benefits) or outcomes. Therefore, tangible ICBs are most likely to lead to costs (or benefits) in the educational sector, while intangible ICBs will probably affect the quality of life. Eleven items (28%) were ranked among the most important items from an economic perspective by at least one of the experts (see items in bold). Table 4 shows further details on the four items (10%) that were considered to be not clear, the five items (13%) reported to be not existent in Austria and the five additional items (13%) suggested to be added by the experts.
Patient, family and informal care (PFI) sectors. Five experts reviewed the preliminary item list for the PFI sectors in regard to their clarity and non-existing/additional items for Austria. The items were grouped into four categories: informal care, services, goods and others. Fourteen items were ranked among the most important items from an economic perspective by at least one of the experts. All of the items within the ‘informal care’ section were clear, whereas six (30%) items in the ‘services’, ‘goods’ and ‘other’ sections were regarded as unclear by one expert. Eight items (40%) were regarded to be non-existent in Austria by at least one of the five experts. Two additional items were suggested to be added to the list (Table 5).
Discussion
For the comprehensive and internationally comparable assessment of the cost impact of mental diseases from a societal perspective, an overview of the potentially relevant services and resource use is a key prerequisite. This manuscript summarizes a first attempt by detailing the iterative development process of four item lists based on a cross-country and cross-sectoral harmonization strategy as part of the ongoing European PECUNIA project with a focus on Austria. The item lists were designed to include all services and other resource use items including ICBs that are relevant for assessing the consequences of mental health-related interventions in the Austrian HCSC, ED, CJ and PFI sectors. The need for such a step has already been established as part of the earlier European MHEEN study not only for therapeutical interventions but also for mental health promotion and prevention [39].
Preliminary, international, sector-specific item lists were subjected to an expert review as part of a multi-national survey with regards to their clarity, descriptions, frequency of use and completeness. Out of a combined number of 295 items included in all lists, a total of 261 items and descriptions (88%) were considered clear by all experts, 42 items (14%) were considered non-existent in Austria by at least one expert, while a total of 13 additional items (4%) were suggested to be added to accommodate for Austria-specific features of the individual sectors.
While the item list for the CJ sector was considered complete, for the other three sectors additional items were suggested to be relevant for Austria. In terms of the six items that were considered as currently missing from the HCSC sectors list, two items referred to the inpatient sector (psychiatric hospital, specialized hospital), and three items to the outpatient sector. The suggested item ‘caregiver self-help groups’ was indeed already covered in the list for the PFI sectors. The new items that were deemed relevant for the Austrian ED sector included additional staff and additional lessons. One additional item (professional therapy for children with exposure to violence) could be considered as covered also in the list of the HCSC sectors. Another suggestion (impact on parents and relatives) can be categorized as intangible item. For the PFI sectors, the two additionally suggested items include one service (case manager) and one other item (relations discounting).
This first identification step in the PECUNIA project revealed several points potentially specific to the Austrian context. Firstly, it was necessary to slightly adapt the international item list for the Austrian HCSC sectors already prior to the expert survey. In Austria, some outpatient specialist services may not only be delivered in hospital outpatient wards as captured within the international item list but also in the ambulatory care sector (i.e. in physician practices). Such a specification was therefore added where relevant, resulting in the ex-ante inclusions of a total of 17 additional Austria-specific items. Thirdly, completion of the questions related to the economic relevance of the listed items in the Austrian HCSC sectors was complicated by the lack of administrative data [40]. As pointed out by participating experts, data for the Austrian inpatient sector data is available in terms of diagnoses but not with regards to actual service use. Hence, a data-driven completion of this part of the survey was deemed impossible. At the same time, it was pointed out that data availability is a more general problem, as also for the outpatient sector reliable estimates of the economic relevance would be difficult to provide due to the absence of publicly available data. This might also explain why despite extensive efforts to identify and recruit experts for the surveys in the different sectors, the participation rate amongst those experts who had initially indicated to be willing to participate in the survey remained low. In addition, in four cases (57%) information on the frequency of the service use or economic relevance of the listed items for mental health diseases was missing in the returned surveys. This especially applies to the surveys in the HCSC sectors and may be due to the long list of items (n = 201) in comparison to the other sectors. For the PFI sectors, the question on the relevance of the listed items was also considered challenging, albeit for a different reason. Austrian experts specifically pointed out the gap between the actual use of the listed items as captured in the survey question and the potential users’ needs for them, which seems to be considerable in the PFI sectors. Another reason may lie in the perceived variation in disease severity even within one disease area (e.g. mild depression versus severe depression) and perceived variations in service use during disease episodes within one year that hamper such general assessments, as reported back by two experts.
All sector-specific surveys and item lists were developed in English as part of the cross-country and cross-sector harmonization approach. Generally, experts did not seem to have language issues. However, significant language barriers occurred in the PFI sectors, where experts preferred to fill out a translated German-language survey. This is likely to be related to differences in the professional profile of these experts. It may also explain the overall difficulties in recruiting experts for the PFI sectors specifically in addition to the still very limited practice of involving patients’ and carers’ views in research in Austria.
Further, a considerable variation in prioritization of items in regards to the individual economic importance by the experts was observed. This might be a reflection of national vs. regional variations in HCSC services.
The study also revealed important general points relevant to multi-sectoral, multi-national costing studies within the European context. Firstly, despite generally being considered as two separate sectors, one (combined) list of items was developed for the HCSC sectors. This was necessary due to the high level of variations that exist between countries in terms of the funding and provision arrangements whereby the two areas of service use may not be clearly distinguishable and separation of the item lists would be extremely challenging and not feasible with European-level comparability. A similar issue emerged in the case of the PFI sectors. Secondly, we experienced major difficulties in the differentiation of services and interventions based on item names suggestive of considerable underlying typological problems both in the literature and by experts. Thirdly, there was a great imbalance in the number of items and in the feasibility of finding sector-specific experts between the HCSC and the CJ and ED sectors confirming the need for additional mapping of the latter sectors for health-related services.
Strengths and limitations
To the best of our knowledge, this is the first attempt both internationally and nationally to summarize mental health-related resource use comprehensively across several sectors, across six European countries based on iterative, harmonized methods including literature reviews as well as expert surveys. At the same time, the developed preliminary item lists and their assessment need to be interpreted in light of potential limitations. Firstly, the identification of experts for all considered sectors was challenging in all countries, although, through the identification of relevant stakeholders based on the national literature search and the application of snowballing techniques in expert recruitment, a sufficient pool of sector-specific experts could be determined in Austria. Secondly, in light of the above explored low sector-specific response rates the voluntary participation might have led to a selection bias. Further, the observed variation in response quality required assumptions regarding missing responses, therefore, future research may be necessary to validate and confirm the experts’ prioritization and completeness of the developed lists for Austria. To achieve this, especially in the CJ and ED sectors, additional mapping work of service availability would be needed. Thirdly, for all sector-specific surveys, experts were recruited from the national, regional and local level to accommodate for regional differences in service provision within Austria. Inevitably, variations in responses may therefore also be due to actual regional variations, which was not further elaborated in the present study. This especially affects the items classified as ‘non-existing’ in Austria. While these items were chosen from the list by at least one expert, conversely all other experts implicitly confirmed the existence of these items on the basis of their regional expertise. It is possible that confounding factors were not mitigated sufficiently considering that expert opinion-based studies are often based on personal judgements [41]. In future studies, a Delphi approach could be considered to tackle this issue and enhance decision-making in a systematic manner [42–44].
Conclusion
The identified country-specific variations and general typological bias and their potential contributions to service and other resource use cost variations across countries and sectors call for further systematic investigation. In the next steps, PECUNIA will develop internationally harmonized and comparable definitions of the listed items and a new conceptual multi-sectoral costing framework. In addition, the developed lists will need to be consolidated across the six selected European countries and further prioritized for the development of a patient-reported RUM instrument and consequent reference unit cost valuation.
Supporting information
S1 Table. Main methodological characteristics of conducted literature searches.
https://doi.org/10.1371/journal.pone.0262091.s001
(DOCX)
S2 Table. Overview of the experts considered for recruitment for the expert survey within the specific sectors.
https://doi.org/10.1371/journal.pone.0262091.s002
(DOCX)
S3 Table. Design of the sector-specific expert surveys.
https://doi.org/10.1371/journal.pone.0262091.s003
(DOCX)
Acknowledgments
We thank all the Austrian experts who contributed with their expertise in our expert survey and provided critical feedback and may list the following participants also by name (in alphabetic order): Cassandra Cicero, Patrick Frottier, Alexander Grabenhofer-Eggerth, Jürgen Kaiser, Petra Katzenschläger, Berthold Kelnreiter, Günter Polt, Felix Rossberg, Sigrid Steffen, Michaela Stitz, and Johannes Wancata.
^Members of the PECUNIA Group are:
Medizinische Universität Wien: PI: Judit Simon; team members (in alphabetical order): Michael Berger, Claudia Fischer, Agata Łaszewska, Susanne Mayer, Nataša Perić; Universitätsklinikum Hamburg-Eppendorf: PI: Hans-Helmut König; team members (in alphabetical order): Christian Brettschneider, Marie Christine Duval, Paul Hinck, Johanna Katharina Hohls, Alexander Konnopka, Louisa-Kristin Muntendorf; Budapesti Corvinus Egyetem: PI: Valentin Brodszky; team members: László Gulácsi; Universiteit Maastricht: PI: Silvia M.A.A. Evers; team members (in alphabetical order): Ruben M.W.A. Drost, Luca M.M. Janssen, Aggie T.G. Paulus, Irina Pokhilenko; Erasmus Universiteit Rotterdam: PI: Leona Hakkaart-van Roijen; team members (in alphabetical order): Kimberley Hubens, Ayesha Sajjad; Servicio Canario de la Salud: PI: Pedro Serrano-Aguilar; team members (in alphabetical order): Lidia García-Pérez, Renata Linertová, Lilisbeth Perestelo-Pérez, Cristina Valcárcel-Nazco; Asociación Científica Psicost: PI: Luis Salvador-Carulla; team members (in alphabetical order): Nerea Almeda, Pilar Campoy-Muñoz, Carlos R. García-Alonso, Mencía R. Gutiérrez-Colosía, Cristina Romero-López-Alberca; London School of Economics and Political Science: PI: A-La Park; University of Bristol: PI: William Hollingworth; team members (in alphabetical order): Sian Noble, Joanna Thorn.
References
- 1.
Simon J. Health economic analysis of service provision. In: Geddes JR, Andreasen NC, Goodwin GM, editors. New Oxford Textbook of Psychiatry. 3rd ed. Oxford: Oxford University Press; 2020. Section 23/136.
- 2. Helzer JE, Kraemer HC, Krueger RF. The feasibility and need for dimensional psychiatric diagnoses. Psychol Med. 2006;36(12):1671–80. pmid:16907995
- 3. Eaton WW, Martins SS, Nestadt G, Bienvenu OJ, Clarke D, Alexandre P. The burden of mental disorders. Epidemiol Rev. 2008;30(1):1–14. pmid:18806255
- 4. Druss BG. Rising mental health costs: what are we getting for our money? Health Aff. 2006;25(3):614–22. pmid:16684724
- 5. Łaszewska A, Österle A, Wancata J, Simon J. Prevalence of mental diseases in Austria: Systematic review of the published evidence. Wien Klin Wochenschr. 2018;130(3–4):141–50. pmid:29368240
- 6. Konnopka A, Klingberg S, Wittorf A, König H-H. Die Kosten der Schizophrenie in Deutschland: Ein systematischer Literaturüberblick [The cost of schizophrenia in Germany: a systematic review of the literature]. Psychiatr Prax. 2009;36(05):211–8.
- 7. Łaszewska A, Wancata J, Jahn R, Simon J. The excess economic burden of mental disorders: findings from a cross-sectional prevalence survey in Austria. Eur J Health Econ. 2020;21(7):1075–89. pmid:32458164
- 8. Grupp H, Koenig HH, Konnopka A. Cost measurement of mental disorders in Germany. J Ment Health Policy Econ. 2014;17(1):3–8. pmid:24864116
- 9. Knapp M, Wong G. Economics and mental health: the current scenario. World Psychiatry. 2020;19(1):3–14. pmid:31922693
- 10. Hofmarcher MM, Quentin W. Austria: Health system review. Health Syst Transit. 2013;15(7):1–292. pmid:24334772
- 11. Böhm K, Schmid A, Götze R, Landwehr C, Rothgang H. Five types of OECD healthcare systems: empirical results of a deductive classification. Health Policy. 2013;113(3):258–69. pmid:24095274
- 12. Nolte E, Knai C, Hofmarcher M, Conklin A, Erler A, Elissen A, et al. Overcoming fragmentation in health care: chronic care in Austria, Germany and The Netherlands. Health Econ Policy Law. 2012;7(1):125–46. pmid:22221931
- 13. Bachner F, Bobek J, Habimana K, Ladurner J, Lepuschütz L, Ostermann H, et al. Austria: Health system review 2018. Health Syst Transit. 2018;20(3):1–254.
- 14. Weatherly H, Drummond M, Claxton K, Cookson R, Ferguson B, Godfrey C, et al. Methods for assessing the cost-effectiveness of public health interventions: key challenges and recommendations. Health Policy. 2009;93(2–3):85–92. pmid:19709773
- 15. Drost RM, Paulus AT, Ruwaard D, Evers SM. Inter-sectoral costs and benefits of mental health prevention: towards a new classification scheme. J Ment Health Policy Econ. 2013;16(4):179–86. pmid:24526586
- 16. Drost RM, van der Putten IM, Ruwaard D, Evers SM, Paulus AT. Conceptualizations of the societal perspective within economic evaluations: a systematic review. International journal of technology assessment in health care. 2017;33(2):251–60. pmid:28641592
- 17. Romeo R, Byford S, Knapp M. Annotation: Economic evaluations of child and adolescent mental health interventions: a systematic review. J Child Psychol Psychiatry. 2005;46(9):919–30. pmid:16108995
- 18. Khushalani JS, Qin J, Cyrus J, Buchanan Lunsford N, Rim SH, Han X, et al. Systematic review of healthcare costs related to mental health conditions among cancer survivors. Expert Rev Pharmacoecon Outcomes Res. 2018;18(5):505–17. pmid:29869568
- 19. Mayer S, Kiss N, Łaszewska A, Simon J. Costing evidence for health care decision-making in Austria: A systematic review. PLOS ONE. 2017;12(8):e0183116. pmid:28806728
- 20. Stone PW, Chapman RH, Sandberg EA, Liljas B, Neumann PJ. Measuring costs in cost-utility analyses: variations in the literature. Int J Technol Assess Health Care. 2000;16(1):111–24. pmid:10815358
- 21. Drost RM, Paulus AT, Ruwaard D, Evers SM. Valuing inter-sectoral costs and benefits of interventions in the healthcare sector: methods for obtaining unit prices. Expert Rev Pharmacoecon Outcomes Res. 2017;17(1):77–84. pmid:26757960
- 22. Koopmanschap MA, van Exel NJA, van den Berg B, Brouwer WB. An overview of methods and applications to value informal care in economic evaluations of healthcare. Pharmacoeconomics. 2008;26(4):269–80. pmid:18370563
- 23.
ZIN—Zorginstituut Nederland. Guideline for economic evaluations in healthcare [Richtlijn voor het uitvoeren van economische evaluaties in de gezondheidszorg]: Zorginstituut Nederland—National Health Care Institute; 2016 [updated June 2016]. Available from: https://www.zorginstituutnederland.nl/binaries/zinl/documenten/publicatie/2016/02/29/richtlijn-voor-het-uitvoeren-van-economische-evaluaties-in-de-gezondheidszorg/richtlijn-voor-het-uitvoeren-van-economische-evaluaties-in-de-gezondheidszorg.pdf.
- 24. Lopez-Bastida J, Oliva J, Antonanzas F, Garcia-Altes A, Gisbert R, Mar J, et al. Spanish recommendations on economic evaluation of health technologies. Eur J Health Econ. 2010;11(5):513–20. pmid:20405159
- 25. Frappier J, Tremblay G, Charny M, Cloutier LM. Costing bias in economic evaluations. J Med Econ. 2015;18(8):596–9. pmid:25800456
- 26. Mayer S, Fischer C, Zechmeister-Koss I, Ostermann H, Simon J. Are Unit Costs the Same? A Case Study Comparing Different Valuation Methods for Unit Cost Calculation of General Practitioner Consultations. Value Health. 2020;23(9):1142–8. pmid:32940231
- 27. Busse R, Schreyögg J, Smith PC. Variability in healthcare treatment costs amongst nine EU countries–results from the HealthBASKET project. Health Econ. 2008;17:1–8. pmid:18088075
- 28. Tan SS, Geissler A, Serdén L, Heurgren M, Van Ineveld BM, Redekop WK, et al. DRG systems in Europe: variations in cost accounting systems among 12 countries. Eur J Public Health. 2014;24(6):1023–8. pmid:24627542
- 29.
PECUNIA—ProgrammE in Costing, resource use measurement and outcome valuation for Use in multi-sectoral National and International health economic evaluAtions. Available from: http://www.pecunia-project.eu/.
- 30. Simon J. Multi-sectoral costs and benefits in health economic evaluations across Europe: The PECUNIA project. J Ment Health Policy Econ. 2019;22(Supplement 1):1–40.
- 31.
PECUNIA Consortium. Assessing the costs and outcomes of healthcare. EU Research (Online) ISSN 2752–4736 (SPR21/P21). Available from: http://www.euresearcher.com/14/eu-research-live 2021/.
- 32. Hubens K, Uyl-De Groot C, Hakkaart-van Roijen L. Measurement instruments of productivity loss of paid and unpaid work: A systematic review and framework for assessment from a societal perspective. Value in Health. 2020; 23:649. pmid:32389231
- 33. Janssen LMM, Pokhilenko I, Evers S, Paulus ATG, Simon J, König HH, et al. Exploring the identification, validation, and categorization of the cost and benefits of criminal justice in mental health: the PECUNIA project. Int J Technol Assess Health Care. 2020;36(4):418–25.
- 34. Pokhilenko I, Janssen LMM, Evers S, Paulus ATG, Simon J, König HH, et al. Exploring the identification, validation, and categorization of costs and benefits of education in mental health: The PECUNIA project. Int J Technol Assess Health Care. 2020;36(4):325–31.
- 35. Montagni I, Salvador-Carulla L, Alvarez-Galvez J, Romero C, Gutierrez-Colosia MR, Weber G, et al. Evaluation of an integrated system for classification, assessment and comparison of services for long-term care in Europe: the eDESDE-LTC study. BMC Health Serv Res. 2013;13:218. pmid:23768163
- 36.
Österreich Rechnungshof. Finanzierung und Kosten von Leistungen in Spitalsambulanzen und Ordinationen [Funding and costs of services in hospital outpatient departments and physician practices]. Vienna: Rechnungshof; 2011.
- 37.
Bryman A. Social research methods. Oxford: Oxford University Press. 2016. https://doi.org/10.1111/aogs.13054 pmid:27861716
- 38. Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Health. 2015;42(5):533–44.
- 39. Zechmeister I, Kilian R, McDaid D. Is it worth investing in mental health promotion and prevention of mental illness? A systematic review of the evidence from economic evaluations. BMC Public Health. 2008;8:20. pmid:18211677
- 40. Fülöp G. Patientenorientierte Bedarfsplanung in Österreich [Patient-oriented health care planning in Austria]. Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen. 2017;125:60–9. pmid:28778490
- 41. Burns PB, Rohrich RJ, Chung KC. The levels of evidence and their role in evidence-based medicine. Plast Reconstr Surg. 2011;128(1):305–10. pmid:21701348
- 42. Heiko A. Consensus measurement in Delphi studies: review and implications for future quality assurance. Technol Forecast Soc Change. 2012;79(8):1525–36.
- 43. Hsu C-C, Sandford BA. The Delphi technique: making sense of consensus. Pract Assess, Res Eval. 2007;12(1):10.
- 44. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–15. pmid:11095242