- Open Access
Accuracy of insulin resistance indices for metabolic syndrome: a cross-sectional study in adults
Diabetology & Metabolic Syndromevolume 10, Article number: 65 (2018)
This study aimed to determine the ability of commonly used insulin resistance indices to identify the metabolic syndrome.
183 people referred for outpatient care at the Metabolism Unit of Hospital de Clínicas de Porto Alegre were evaluated with anthropometric, blood pressure, lipid profile, and adiponectin measurements. Glucose tolerance status was determined by 2-h 75-g oral glucose tolerance test and glycosylated hemoglobin. Definition of metabolic syndrome was based on the Joint Interim Statement of different medical associations. Twenty-one indices of insulin resistance were estimated from published equations. The accuracy of these indices was determined by area under the ROC curve (AUC) analysis. In addition, we determined an optimal cut point for each index and its performance as a diagnostic test.
The study population was comprised of 183 people (73.2% women; 78.7% white; age 52.6 ± 12.0 years, mean ± standard deviation), of whom 140 (76.5%) had metabolic syndrome. The reciprocal of the Gutt index provided the greatest AUC for identification of metabolic syndrome, but there were no statistical differences between Gutt and 11 AUC indices. Gutt presented 86.4% sensitivity and 76.7% specificity to identify metabolic syndrome.
A number of commonly employed indices of insulin resistance are capable of identifying individuals with the metabolic syndrome.
Insulin resistance is a condition in which a greater than normal amount of insulin is required to obtain a quantitatively normal metabolic response. Most commonly, insulin resistance is used to refer to the inability of insulin to stimulate glucose disposal . Insulin resistance is also associated with the development of the metabolic syndrome , which represents a cluster of cardiometabolic risk factors which promote the development of cardiovascular disease and type 2 diabetes [3, 4]. The individual components of the metabolic syndrome include hyperglycemia, elevated blood pressure, elevated triglyceride levels, low HDL cholesterol levels, and central obesity . A recent systematic review estimated the general prevalence of metabolic syndrome of adults in Brazil in 29.6% (range 14.9–65.3%) .
Although insulin resistance has been shown to be closely associated with the metabolic syndrome and to play an important physiopathological role in the development of the individual components of the metabolic syndrome , quantification of insulin resistance in general clinical practice is difficult. The most precise method for quantitating insulin resistance is the hyperinsulinemic euglycemic clamp technique, because it directly measures the effects of insulin to stimulate glucose utilization under steady-state conditions in vivo . However, it involves intravenous infusion of insulin, frequent blood sampling over a 2-h period, and continuous adjustment of a glucose infusion, making it an impractical tool for large-scale epidemiological studies and clinical practice .
Consequently, a number of surrogate indices have been developed to estimate insulin sensitivity . Both static indices, using fasting blood samples, and dynamic indices, requiring fasting and 2-h blood samples from an oral glucose tolerance test, have been developed [9, 10]. Measurements of adiponectin and inflammatory markers have also been used as a surrogate measurement of insulin sensitivity . The performance of these equations has been evaluated in different populations against a variety of measures of insulin sensitivity (Additional file 1).
Insulin resistance is a key component of the metabolic syndrome, but it is not included as part of the definition because it is not easily quantitated in clinical practice. To investigate the relationship between insulin resistance and metabolic syndrome, we evaluated the correlation between multiple surrogate indices of insulin resistance and the presence of metabolic syndrome in adult participants, aged 24–83 years, with different degrees of glucose tolerance.
The patient population initially consisted of 223 consecutive participants who did not have a previous diagnosis of metabolic syndrome and who were referred for outpatient care in the Metabolism Unit of Hospital de Clínicas de Porto Alegre. Forty participants were not included based on following exclusion criteria: insulin treatment, clinically significant autoimmune disease, uncompensated hypo- or hyperthyroidism, malignant disease that could affect 5-year survival, stage IV–V chronic kidney disease, AIDS, pregnancy/lactation, dementia, cirrhosis, hepatitis, glucocorticoid or anti-retroviral treatment, menopause hormone replacement therapy, and malnutrition. The remaining 183 participants were included in the analysis. Nine were on treatment with oral hypoglycemic agents. The research related to human use has been complied with all the relevant national regulations, institutional policies and in accordance to the tenets of the Helsinki Declaration, and has been approved by the authors’ institutional review board. The participants provided written informed consent prior to participation.
Participants underwent a standard evaluation, which included medical history, physical examination, and anthropometric measurements. Ethnicity was based on self-reported skin color and recorded as white or non-white, which included black, brown, yellow, Indigenous, and undeclared, according to the national definition used in Brazil . Physical activity was classified in four categories, based upon the classification proposed by Tuomilehto et al. : sedentary, light exercise, moderate exercise, and heavy exercise. Waist circumference was taken at the midpoint between the lower costal margin and the iliac crest measured to the nearest 0.5 cm.
Blood pressure was measured in the seated position 1 week after withdrawal of all antihypertensive medications, in the right arm with an oscillometric monitor device (OMRON® H-003D), with cuff adjusted for arm circumference. The mean of the last two measurements was used to estimate systolic and diastolic blood pressure.
Blood samples were drawn after a 12-h overnight fast for analysis of lipids (triglycerides, total, LDL and HDL cholesterol), high-sensitive C-reactive protein, and glycosylated hemoglobin (HbA1c). Triglyceride and HDL cholesterol measurements in participants who were receiving drug treatment for elevated plasma triglycerides levels and/or for reduced HDL cholesterol levels were not included in the analysis. At 8 am following a 10–12 h overnight fast, subjects received a 75-g oral glucose tolerance test with plasma glucose and insulin determinations at 0, 30, 60, 90 and 120 min. In the 9 subjects who were taking oral hypoglycemic agents, the oral glucose tolerance test was performed 4 days after withdrawal of hypoglycemic medications. Fasting glucose was defined by the glucose concentration at 0 min. All participants were classified according to glucose tolerance status  and presence of metabolic syndrome . The methodology and procedures were reviewed to equate to STARD criteria, and the diagram to report flow of participants through the study is displayed in Additional file 2 .
Classification of metabolic syndrome
Metabolic syndrome was defined as the presence of 3 of 5 following: waist circumference ≥ 80 cm for women and ≥ 94 cm for men; serum triglyceride ≥ 1.7 mmol/L) or receiving treatment for elevated serum triglycerides; HDL cholesterol < 1.0 mmol/L for men and < 1.3 mmol/L for women or receiving treatment for reduced HDL cholesterol; systolic blood pressure ≥ 130 mmHg or diastolic blood pressure ≥ 85 mmHg or receiving antihypertensive treatment; and fasting plasma glucose ≥ 6.1 mmol/L or receiving treatment for hyperglycemia, according to the Joint Interim Statement for the harmonization of metabolic syndrome criteria . In addition, the American Diabetes Association criteria for impaired glucose tolerance (2 h-plasma glucose ≥ 7.8 mmol/L) was used as a criteria for hyperglycemia .
Classification of glucose tolerance
Based on HbA1c and fasting and 2 h-plasma glucose concentrations, participants were categorized according to American Diabetes Association criteria as having normal glucose tolerance (fasting plasma glucose < 6.1 mmol/L, 2 h-plasma glucose level < 7.8 mmol/L, and HbA1c < 5.7% [39 mmol/mol]), impaired fasting glucose (fasting plasma glucose 6.1–6.9 mmol/L and 2 h-plasma glucose level < 7.8 mmol/L); impaired glucose tolerance (fasting plasma glucose < 6.1 mmol/L and 2 h-plasma glucose level 7.8–11.0 mmol/L), and diabetes (fasting plasma glucose ≥ 7.0 mmol/L and/or 2-h PG ≥ 11.1 mmol/L or HbA1c ≥ 6.5% [48 mmol/mol] or receiving medication for diabetes control) . Participants with impaired fasting glucose and/or impaired glucose tolerance and/or HbA1c between 5.7% (39 mmol/mol) and 6.4% (48 mmol/mol) were considered to have prediabetes.
Estimation of insulin resistance indices
Eleven static indices were analyzed: Bennet, fasting insulin (Ins0min), fasting insulin/fasting glucose ratio, fasting insulin resistance index (FIRI), fasting insulin sensitivity index (ISI0min), homeostasis model assessment (HOMA)-IR, HOMA-2-IR, HOMA-2-IS, McAuley, quantitative insulin sensitivity check index (QUICKI) and Raynaud. Eight dynamic indices were analyzed: Avignon, Gutt, Matsuda, oral glucose insulin sensitivity index (OGIS), Stumvoll with and without demographics, 2 h-insulin sensitivity index (ISI120min), and 2 h-insulin/2 h-glucose ratio.
All indices were calculated according to published equations, as described in Additional file 1. The reciprocal of an IS index was used as equivalent to an insulin resistance index (1/insulin sensitivity index = insulin resistance index). Two additional markers, adiponectin and HOMA-AD, were also examined because of their potential physiopathological association with metabolic syndrome . Indices designed specifically to estimate beta-cell function were not considered.
Data were expressed as absolute number and %, mean ± standard deviation or median (P25–P75). Sample size analysis was performed considering an expected sensitivity of 0.73 and an expected specificity of 0.70 to identify metabolic syndrome, based on a study that evaluated the performance of the HOMA index , and on an expected prevalence of metabolic syndrome of 0.30 . It was estimated that 182 subjects would be necessary to achieve a precision of 0.118 for sensitivity and 0.080 for specificity. Calculations were made by using an Excel spreadsheet available online . To compare demographic, clinical, and laboratory data, using the presence of metabolic syndrome in our sample, the Chi square test and independent-sample t-test were used as appropriate. Variables with a non-normal distribution were log transformed before analysis. The accuracy of insulin resistance indices to identify the metabolic syndrome was determined by analyzing the area under the curve (AUC) in a receiver operating characteristic (ROC) curve. The AUC comparison for different insulin resistance indices was examined by the method proposed by DeLong et al. . For each index, we determined an optimal cut point at the ROC curve based on the Youden index and distance to coordinate (0, 1). The Youden index is a common summary measure of the ROC curve. It was calculated as (Sensitivity + Specificity) − 1 . From this ideal cut point, we established the performance of these indices as a diagnostic test for the metabolic syndrome, including sensitivity, specificity, and positive and negative likelihood ratios. For practical clinical purposes, we estimated the probability of the outcome employing the Bayes nomogram. The pretest probability was defined as the prevalence of metabolic syndrome in our sample . To deal with multiple testing, we performed a Bonferroni correction test . The conventional P value of 0.05 was divided by the total number of analyzed indices in the present study (21 indices), giving a P-value of 0.0024 for statistical significance. For one-to-one comparisons, i.e., in Table 1, it was considered P < 0.05. Calculations were made by using SPSS (version 19.0; SPSS Inc., Chicago) and pROC package for R i386 (version 3.1.2.; R Foundation, Vienna).
The patient population was subdivided by the absence (23.5%) or presence (76.5%) of metabolic syndrome. Participants with metabolic syndrome were older and had lower adiponectin plasma levels, and higher HbA1c and high-sensitive C-reactive protein levels. The groups did not differ by gender distribution, ethnicity, smoking habits, and physical activity status. As expected, the prevalence of prediabetes and type 2 diabetes was higher in the group with metabolic syndrome (Table 1).
Accuracy of insulin resistance indices in the diagnosis of metabolic syndrome
ROC analysis showed that the reciprocal of Gutt and OGIS indices yielded an AUC above 0.8, whereas most other indices gave an AUC between 0.7 and 0.8 (Fig. 1). However, there was no statistical difference between the reciprocal of Gutt AUC and the following 11 indices of AUC (OGIS, Matsuda, HOMA-AD, Avignon, ISI0min, HOMA-IR, FIRI, Bennet, HOMA-2-IS, fasting insulin, and Raynaud; P ≥ 0.0024), indicating that these equations provide an index of insulin resistance that identifies individuals with the metabolic syndrome (Fig. 2; Additional file 3).
Since subjects with metabolic syndrome were older than subjects without the condition, we stratified our sample based on median of age and performed an additional analysis. For subjects younger than 53 years old, there was no statistical difference between the reciprocal of Gutt AUC and 16 indices of AUC; while for subjects older than 53 years old, there was no difference for 17 indices (Additional file 4).
Additionally, we performed a stratified analysis of AUC values for subjects with and without obesity and with normal and large waist circumference. Generally, Gutt still presented the largest AUC, but more indices were statistically equivalent to Gutt. When the subgroup of patients with obesity is analyzed, Gutt and OGIS present a great performance (AUC 0.930 and 0.924).
Performance of insulin resistance indices as diagnostic tests for metabolic syndrome
Using the ideal cut point, we determined the sensitivity and specificity of each equation in demonstrating the presence of metabolic syndrome. The reciprocals of Gutt and OGIS, which had the greatest AUC values in predicting the metabolic syndrome, and HOMA-IR and fasting insulin, which are commonly employed indices for insulin resistance, are displayed in Fig. 2 and in Additional file 3. Using an optimal cut point of 0.268 for the reciprocal of Gutt, this index gave sensitivity of 86.4% (80.1–91.4%; CI 95%) and specificity of 76.7% (68.2–87.6%) to identify the metabolic syndrome. For a positive test result (test value above the cut point), the post test probability of identifying metabolic syndrome was 92, which means a 20% increase in the probability of identifying metabolic syndrome when Gutt has a positive result. For a negative test result (test value below the cut point), the post test probability was 37%, which means a 51% decrease in the probability of identifying metabolic syndrome when Gutt has a negative result. In comparison, for a positive HOMA-IR test result, the post test probability of identifying metabolic syndrome was 90% (increase of 17%); for a negative test result, the post test probability was 53% (decrease of 30%). The same procedure was applied to other indices (Fig. 2; Additional file 3).
In the present study, we evaluated the ability of all published indices of insulin resistance to identify the metabolic syndrome. From the quantitative standpoint, the Gutt index had the greatest area under the ROC curve (Fig. 1). However, 11 other indices, most notably the dynamic ones, were statistically non-inferior to the Gutt index. The inability to demonstrate statistically significant differences between those 12 indices of insulin resistance most likely is related to the conservative method utilized to define significance. Because 21 differences were evaluated, the alpha (P < 0.05) was split by 21, requiring a P < 0.0024 to demonstrate significance. If one-to-one comparisons are made using P < 0.05, the Gutt index outperforms all other indices, except OGIS. OGIS had a similar performance when the sample was stratified by age, BMI and waist circumference (Additional file 4). It should be noted that the Gutt index, although validated against the euglycemic insulin clamp, primarily included subjects who were obese and had normal glucose tolerance. Hanley et al.  found that the Gutt index demonstrated the best overall ability to predict type 2 diabetes compared to 18 other indices in a large multiethnic cohort. A Finnish study showed that Gutt was not statistically inferior to other indices when tested against the gold standard measure of insulin sensitivity obtained by the hyperinsulinemic euglycemic clamp .
Additionally, we found that adiponectin, an insulin sensibilizing hormone, and high-sensitive C-reactive protein, a marker of subclinical inflammation, were different in subjects with and without metabolic syndrome. The insulin sensitizer and anti-inflammatory role of adiponectin is a result of several actions: suppression of hepatic gluconeogenesis, activation of AMPK and fatty acid oxidation in skeletal muscle, suppression of the inflammatory response through the enhancement of nitric oxide synthase activity in endothelial cells and inhibition of the expression of adhesion molecules, such as VCAM-1, E-selectin, and ICAM . In a previous study, we found that adiponectin levels decreased with increasing number of metabolic syndrome criteria, and it is in part determined by its relationship with abdominal adiposity . Additionally, adiponectin levels were inversely related to HDL levels and high-sensitive C-reactive protein and positively related to blood pressure levels . These findings were confirmed in an additional analysis within this study, where the number of metabolic syndrome criteria were greater in subjects more insulin resistant than those more insulin sensitive categorized by the median of insulin resistance indices (Additional file 5). From a physiopathological perspective, inflammation inhibits insulin action through the release of cytokines and adipocytokines and contributes to the progression from insulin resistance to the development of hyperglycemia , which explain the higher rates of dysglycemia and diabetes in the group with metabolic syndrome. These findings also corroborate the role of adipokines and inflammation in the pathogenesis of metabolic syndrome .
The present study has some limitations. First, our sample was composed by a predominantly White female population with a high prevalence of metabolic syndrome. It would be important to confirm these findings in further studies, in populations with a more diverse ethnic background, more balanced gender distribution, and a lower prevalence of metabolic syndrome. Second, methods for insulin measurement are not standardized . Although we used a reliable assay with appropriate controls, these results might not be applicable to other studies, which use different assays to measure plasma insulin. Third, we did not perform euglycemic insulin clamps in the present study. It would have been of great interest to see how well the insulin clamp predicts the metabolic syndrome in comparison to the other 21 insulin resistance indices that were evaluated.
In summary, a variety of indices provide a measure of insulin resistance that can be used for clinical and epidemiological research studies. Because the equations used to estimate insulin resistance rely on different variables, i.e., hyperglycemia, hyperinsulinemia, and, in some cases, adiposity and demographic parameters, they reflect different components of the underlying physiopathological disturbances present in the metabolic syndrome. Thus, it is not surprising that there may be variability in their ability to predict the metabolic syndrome.
area under the curve
fasting insulin resistance index
homeostasis model assessment
- Ins0min :
- ISI0min :
fasting insulin sensitivity index
- ISI120min :
2 h-insulin sensitivity index
oral glucose insulin sensitivity index
quantitative insulin sensitivity check index
receiver operating characteristic
Berson S, Yalow R. Insulin agonists and insulin resistance. In: Ellenberg M, Rifkin H, editors. Diabetes mellitus: theory and practice. New York: McGraw-Hill; 1970. p. 388–423.
Kahn SE, Hull RL, Utzschneider KM. Mechanisms linking obesity to insulin resistance and type 2 diabetes. Nature. 2006. https://doi.org/10.1038/nature05482.
Ford ES. Risks for all-cause mortality, cardiovascular disease, and diabetes associated with the metabolic syndrome: a summary of the evidence. Diabetes Care. 2005;28(7):1769–78.
Malik S, Wong N, Franklin S, Kamath T, L’Italien G, Pio J, et al. Impact of the metabolic syndrome on mortality from coronary heart disease, cardiovascular disease, and all causes in United States adults. Circulation. 2004. https://doi.org/10.1161/01.CIR.0000140677.20606.0E.
Alberti K, Eckel RH, Grundy SM, Zimmet PZ, Cleeman JI, Donato KA, et al. Harmonizing the metabolic syndrome: a joint interim statement of the International Diabetes Federation Task Force on Epidemiology and Prevention; National Heart, Lung, and Blood Institute; American Heart Association; World Heart Federation; International Atherosclerosis Society; and International Association for the Study of Obesity. Circulation. 2009. https://doi.org/10.1161/CIRCULATIONAHA.109.192644.
Vidigal F, Bressan J, Babio N, Salas-Salvadó J. Prevalence of metabolic syndrome in Brazilian adults: a systematic review. BMC Public Health. 2013. https://doi.org/10.1186/1471-2458-13-1198.
Defronzo RA. Glucose intolerance and aging: evidence for tissue insensitivity to insulin. Diabetes. 1979;28(12):1095–101.
Singh B. Surrogate markers of insulin resistance: a review. World J Diabetes. 2010;1(2):36.
Liu R, Christoffel KK, Brickman WJ, Liu X, Gadgil M, Wang G, et al. Do static and dynamic insulin resistance indices perform similarly in predicting pre-diabetes and type 2 diabetes? Diabetes Res Clin Pract. 2014. https://doi.org/10.1016/j.diabres.2014.04.014.
Stumvoll M, Mitrakou A, Pimenta W, Jenssen T, Yki-Jarvinen H, Haeften TV, et al. Use of the oral glucose tolerance test to assess insulin release and insulin sensitivity. Diabetes Care. 2000;23(3):295–301.
Petruccelli J, Saboia A. Caracteristícas étnico-raciais da populacão: classificacões e identidades—número 2. Rio de Janeiro: Instituto Brasileiro de Geografia e Estatística; 2013.
Tuomilehto J, Lindström J, Eriksson JG, Valle TT, Hämäläinen H, Ilanne-Parikka P, et al. Prevention of type 2 diabetes mellitus by changes in lifestyle among subjects with impaired glucose tolerance. N Engl J Med. 2001. https://doi.org/10.1056/NEJM200105033441801.
American Diabetes Association. Executive summary: standards of medical care in diabetes–2009. Diabetes Care. 2008. https://doi.org/10.2337/dc09-s013.
Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig L, et al. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ. 2015. https://doi.org/10.1136/bmj.h5527.
Gayoso-Diz P, Otero-González A, Rodriguez-Alvarez MX, Gude F, García F, Francisco AD, et al. Insulin resistance (HOMA-IR) cut-off values and the metabolic syndrome in a general adult population: effect of gender and age: EPIRCE cross-sectional study. BMC Endocr Disord. 2013. https://doi.org/10.1186/1472-6823-13-47.
Naing L. Sample size calculation for sensitivity & specificity studies. In: Universiti Sains Malaysia. 2004. http://www.kck.usm.my/ppsg/statistical_resources/samplesize_forsensitivity_specificitystudiesLinNaing.xls. Accessed 07 Mar 2018.
Delong ER, Delong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837.
Ruopp MD, Perkins NJ, Whitcomb BW, Schisterman EF. Youden index and optimal cut-point estimated from observations affected by a lower limit of detection. Biom J. 2008. https://doi.org/10.1002/bimj.200710415.
Kramer CK, Zinman B, Gross JL, Canani LH, Rodrigues TC, Azevedo MJ, et al. Coronary artery calcium score prediction of all cause mortality and cardiovascular events in people with type 2 diabetes: systematic review and meta-analysis. BMJ. 2013. https://doi.org/10.1136/bmj.f1654.
Armstrong RA. When to use the Bonferroni correction. Ophthalmic Physiol Opt. 2014. https://doi.org/10.1111/opo.12131.
Hanley AJ, Williams K, Gonzalez C, D’agostino RB, Wagenknecht LE, Stern MP, et al. Prediction of type 2 diabetes using simple measures of insulin resistance: combined results from the San Antonio Heart Study, the Mexico City Diabetes Study, and the Insulin Resistance Atherosclerosis Study. Diabetes. 2003;52(2):463–9.
Lorenzo C, Haffner SM, Stančáková A, Laakso M. Relation of direct and surrogate measures of insulin resistance to cardiovascular risk factors in nondiabetic finnish offspring of type 2 diabetic individuals. J Clin Endocrinol Metab. 2010. https://doi.org/10.1210/jc.2010-1144.
Ruscica M, Baragetti A, Catapano AL, Norata GD. Translating the biology of adipokines in atherosclerosis and cardiovascular diseases: gaps and open questions. Nutr Metab Cardiovasc Dis. 2017. https://doi.org/10.1016/j.numecd.2016.12.005.
Frankenberg ADV, Nascimento FV, Gatelli LE, Nedel BL, Garcia SP, Oliveira CV, et al. Major components of metabolic syndrome and adiponectin levels: a cross-sectional study. Diabetol Metab Syndr. 2014. https://doi.org/10.1186/1758-5996-6-26.
Frankenberg ADV, Reis AF, Gerchman F. Relationships between adiponectin levels, the metabolic syndrome, and type 2 diabetes: a literature review. Arch Endocrinol Metab. 2017. https://doi.org/10.1590/2359-3997000000316.
Shulman GI. Ectopic fat in insulin resistance, dyslipidemia, and cardiometabolic disease. N Engl J Med. 2014. https://doi.org/10.1056/NEJMra1011035.
LPA reviewed the literature relating to the various indices of insulin resistance and wrote the manuscript. BLN, TCP and LdAM coassisted in researching the data and reviewed the manuscript. Fernando Gerchman discussed the results with all others, and edited the manuscript. All authors read and approved the final manuscript.
Prof. Ralph Anthony DeFronzo for his critical review and helpful feedback of this study. The manuscript was edited to conform to scientific English by the English Language Editing service from Elsevier’s Web Shop.
The authors declare that they have no competing interests.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Consent for publication
Ethics approval and consent to participate
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Informed consent was obtained from all individual participants included in the study.
This work was supported by the Rio Grande do Sul Research Foundation (FAPERGS; Grant Number 5989.284.18921.12062013), the Coordination of Higher Education and Graduate Training (CAPES; Grant Number 486802/2013-2), the Brazilian National Research Council (CNPq; Number 486802/2013-2), and the Hospital de Clínicas de Porto Alegre Research and Events Incentive Funds (FIPE-HCPA). Luciana P. Antoniolli received a scientific initiation scholarship from the Rio Grande do Sul Research Foundation and the Brazilian National Research Council.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.