- Open Access
Better detection of platelet aggregation in patients with metabolic syndrome using epinephrine and ADP
Diabetology & Metabolic Syndromevolume 6, Article number: 93 (2014)
Patients with metabolic syndrome (MS) often have increased platelet aggregation. In order to determine which concentration detects a higher level of platelet aggregation in patients with MS, the agonists ADP and epinephrine were compared.
The study included 56 subjects with MS and 53 healthy subjects. Blood pressure, weight, body-mass index, and hip-to-waist ratio were collected from all subjects. Insulin, glucose, total serum cholesterol, HDL-C, LDL-C, total triglycerides, markers of plasma atherogenicity, and indices of insulin resistance were measured in all participants. For aggregometry assays, the Born method was used. Platelets were treated with ADP and epinephrine in decreasing concentrations of 2.34, 1.17, and 0.58 μM, as well as, 11.0, 1.1, and 0.55 μM, respectively. ROC curves were plotted to define the diagnostic efficiency of epinephrine levels for MS.
Among healthy individuals and MS patients significant differences were observed in body weight, body-mass index, waist-circumference, levels of insulin, indices of insulin resistance, and levels of HDL-cholesterol, LDL-cholesterol and total triglycerides. There was a significant difference in the detection of increased platelet aggregation using 11.0 μM and 0.55 μM epinephrine and 0.58 μM ADP. With both agonists, ROC analysis showed an area under the curve of >0.8 for 11.0 μM epinephrine and 2.34 μM ADP. However, for MS patients, 11.0 μM epinephrine had a slightly better diagnostic efficiency than 2.34 μM ADP.
It was found that 11.0 μM epinephrine and 2.34 μM ADP detected better platelet aggregation in patients with MS than in healthy subject. Both concentrations detected increased platelet aggregation in patients with MS.
Increased platelet aggregation is involved in myocardial infarction, ischemic stroke, type 1 diabetes mellitus, microangiopathy, and other diseases. For this reason, it is important to have effective methods for identifying this hyperactive state. Multiplate and VerifyNow are two other very widely used point-of-care- tests however, light transmission platelet aggregation (LTA), still remains the gold standard for the study of platelet function.
Platelet factors are involved, not only in the prothrombotic risk associated with insulin resistance , but also, in the risk associated with MS, which is related to some prothrombotic states of increased platelet aggregation, increased thrombin generation, and decreased fibrinolysis .
When comparing healthy individuals with patients of increased platelet aggregation, type 1 and type 2 diabetes mellitus, atherosclerosis , ischemic coronary disease, ischemic stroke , and several other vascular diseases is identified with the latter.
Diagnosis of increased platelet aggregation with LTA is performed by adding different concentrations of agonists to platelet rich plasma, such as: ADP, epinephrine , collagen, collagen-related peptide, arachidonic acid, or ristocetin . In healthy subjects, Yee DL et al. reported that epinephrine and collagen-related peptides are reliable and efficient agonists for the detection of increased platelet aggregation .
The agonist epinephrine has a higher level of sensitivity and reproducibility for detecting increased platelet aggregation ; however, ADP is also used due to its ability to detect possible increments in P2Y12 activity . Therefore, it is important to select the platelet agonist which is most appropriate for a particular clinical practice. In this study, the platelet agonists ADP and epinephrine were compared with the aim of identifying which concentration better detects increased platelet aggregation in patients with MS.
Materials and methods
Subjects and design
For this case–control study, patients with MS and healthy subjects between the ages of 25 and 75 were recruited over a period of three years. Sample size was calculated based on a 5% margin of error, a 95% confidence level, and a 50% response distribution (Raosoft, Herndon, VA) . The case group had 56 MS patients, and the control group had 53 healthy subjects. Within these two groups, those who had taken antiplatelet or non-steroideal anti-inflammatory drugs during a 10-day period before entering the study were excluded.
The Joint Interim Statement (JIS) has a consensus criteria for the clinical diagnosis of metabolic syndrome , this is defined as a condition displaying three or more of the following indicators: greater waist-circumference according to ethnicity, ≥150 mg/dL triglycerides, < 40 mg/dL in males and < 50 mg/dL in females with HDL-C, ≥130 mm Hg systolic and/or ≥ 85 mm Hg diastolic blood pressure, and >100 mg/dL fasting glucose 4 . Although the JIS does not consider insulin resistance within the criteria for MS, it recognizes that insulin resistance is a connecting factor in MS. The definition of insulin resistance is based on the homeostasis model assessment (HOMA-IR) . In this study, all MS patients had at least three criteria within the JIS. In particular, waist-circumference was considered according to the following cutoffs: 94 cm for men and 90 cm for women .
Both MS patients and those in the healthy group were screened for insulin levels, assessed by the (HOMA-IR) , the quantitative insulin sensitivity check index (QUICKI) , and by the lipid-parameter-based index (Mffm/I) [15–17]. The study was approved by the Institutional Review Board of the Graduate Program and by the Ethics Committee of the Unidad de Bioquímica e Inmunologia del Instituto Tecnologico Regional de Oaxaca, México. Prior to entering the study, an agreement of written informed consent was obtained from all participants.
Clinical and laboratory parameters
The following data was collected from all subjects: age, weight, height, hip and waist-circumferences, and body mass index (BMI). Height was measured with a standard scale and weight was measured using a digital scale.
Blood pressure (BP) was evaluated on three different occasions with a standard mercurial sphygmomanometer after lying in the supine position for 5 min. In addition, fasting glucose (Glc), total serum cholesterol (TC), HDL-C, low density lipoprotein cholesterol (LDL-C), and TT were measured with the Vitros DT60 II Chemistry System (Kodak, Rochester, NY, USA). Fasting insulin was tested with the Inmulite 1000 Immunoassay Analyzer (Diagnostic Products Corporation, Llanberis Glyn Rhonwy Caernarfon, UK).
Platelet aggregation test
Blood was drawn from 53 healthy subjects and 56 patients with MS. First, it was diluted in a solution of 3.8% sodium citrate and centrifuged at 150 g, at room temperature for 15 min. Platelet-rich plasma (PRP) was removed with silicone-coated Pasteur pipettes and stored in plastic test-tubes at room temperature for a maximum of 180 min. Adenosine 5′-disphosphate (ADP) and epinephrine bitartrate were obtained from Sigma (Sigma Chemical Co., St. Louis, MO, USA). Various agonist concentrations were selected to identify possible differences within the groups. Concentrations of 2.34, 1.17, and 0.58 μM ADP and 11.0, 1.1, and 0.55 μM epinephrine were evaluated. LTA assays were performed on these agonist concentrations using a dual-channel platelet aggregometer (Sienco, Houston, TX, USA) based on the Born method . Platelet counts of the PRP were standardized at 200 × 109/L with autologous platelet-poor plasma. The incubation time was 1 min at 37°C. A stirring rate of 1,200 rpm and a running time of 6 min were maintained after adding 15 μL of the respective ADP and epinephrine concentrations.
The insulin sensitivity index, derived from fasting measurements of the HOMA-IR, QUICKI, and Mffm/I, gave an appropriate calculation of insulin resistance, which was calculated as previously described [6–8]. The Atherogenic index of plasma (AIP), a sensitive marker of differences in lipoprotein complex, increased significantly with greater atherogenic risk, this AIP was calculated as reported by Dobiásová .
In consideration of the variability in factors occuring in subjects with insulin resistance, an attempt was made to select subjects with clinical characteristics as similar as possible. The Unpaired t test with Welch's correction was performed to detect differences in the median using the GraphPad Prism version 3.0 of Windows (GraphPad Software, San Diego, CA, USA). The p value < 0.05 was considered statistically significant, and the Receiver Operating Characteristic curve was plotted using the GraphPad Prism version 6.00 of Windows, GraphPad Software, La Jolla California USA, http://www.graphpad.com.
The groups evaluated in this study consisted of 53 healthy and 56 MS subjects. Amongst the two groups, significant differences were observed in terms of body weight, BMI, and waist-circumference. Additionally, significant differences were found in levels of HDL-C, LDL-C, TT, insulin, and AIP, HOMA IR, QUICKI, and Mffm/I indices (Table 1). This suggests that patients from the MS group are overweight, insulin resistant and have an increased atherogenic risk.
In relation to platelet aggregometry assays, an increase in platelet aggregation was found in healthy subjects with the addition of 1.17 μM ADP, and 1.1 μM Epinephrine. In MS patients, concentrations of 0.58 μM ADP, 11.0 and 0.55 μM epinephrine were increased (Table 2).
The ROC curve was used in order to differentiate between healthy subjects and patients with MS and to compare the effects of the concentrations of epinephrine and ADP. The area under the curve (AUC) is generally considered acceptable when >0.8 . This study showed an AUC >0.8% for epinephrine and ADP concentrations of 11.0 and 2.34 μM, respectively (Figure 1).
Three different concentrations of agonists in ROC analysis of platelet aggregometry revealed that one, had a cut-off of > 57.0%, a sensitivity of 80.00%, and a specificity of 75.86% with 11.0 μM epinephrine, another, had a cut-off of <30.75%, a sensitivity of 60.00%, and a specificity of 89.66% with 1.1 μM epinephrine, and the other, had a cut-off of > 24.50%, a sensitivity of 33.33% and a specificity of 96.55% with 0.55 μM epinephrine. These results highlighted the differences between healthy and MS subjects.
ROC analysis of ADP revealed that a platelet aggregation cut-off of > 58.15% had a sensitivity of 76.36%, and a specificity of 82.76% with 2.34 μM. A cut-off of <30.75% had a sensitivity of 50.00%, and specificity of 89.00% with 1.17 μM, and an inverse cut-off of < 30.25% had a sensitivity of 5.55% and a specificity of 93.10% with 0.58 μM ADP. These analyses also showed differences between healthy and MS subjects.
Since increased platelet aggregation is related to atherothrombotic risk, it is important to identify subjects with persistent hyperfunctional platelets . ADP is one of the most important platelet agonists. ADP is a nucleotide able to activate three different subtypes of receptors namely, P2Y1, P2Y12, and P2Y13 . These receptors are also in-vitro concentration dependent. For example, ADP concentrations of between 10 and 20 μM may cause TxA2-independent aggregation while a moderate concentration of ADP (5 μM), only partially, depends on TxA2. Moreover, in order to initiate the agonist effect of ADP, co-activation of P2Y1 and P2Y12 is required. In this study, a low concentration of ADP was also used.
Noteworthy, is an increased response in platelet aggregation, elicited by ADP assays, due to a P2Y12 receptor gene H2 haplotype. This is also able to increase the risk of coronary artery disease . Also, signaling, through the P2Y12 receptor, enhances platelet reactivity, due to hypercholesterolemia .
It appears that ADP and epinephrine are weak agonists in platelet aggregation, in contrast to thrombin and collagen, which are used as agonists in other methods to identify platelet hyperactivity associated with polymorphisms, such as, GPIIIa PlA1 allele, in the case of Collagen/Epinephrine closure time (CEPI-CT) .
Platelet hyperactivity in LTA with epinephrine is associated with ageing men , and also in patients with non-insulin-dependent diabetes mellitus (NIDDM). It is attributed to enhanced platelet aggregation in the presence of a thrombin receptor-activating peptide or epinephrine , and noted in studies in patients with ischemic heart disease, by Yokoyama M et al. . The latter found that ADP and epinephrine had variable responses from person to person, using a range of concentrations from 100 to 0.1 μM, and an increased platelet sensitivity to adrenaline in subjects of advanced age. Epinephrine is also related to a variant of angina, which is detected by less agonist activity and relates to concentrations used in this study .
In this study, 11.0 μM epinephrine gave a ROC curve area of 0.8526, which suggests that this may differentiate better between healthy subjects and patients with MS. Moreover, 2.34 μM ADP gave a slightly larger area under a curve of 0.8671. Lesser doses of 0.55 μM ADP were not able to identify MS patients correctly, although shown as significant in Unpaired t tests with Welch's corrections (Table 2).
When comparing the ROC curves of 2.34 μM ADP and 11.0 μM epinephrine, although the area of the curve was greater in ADP, the epinephrine curve climbed quickly toward the top-left. This suggests that the 11.0 μM concentration may be better in identifying patients with increases in platelet aggregation. However, in consideration of the fact that both agonists provide information related to different signaling pathways, both concentrations may be useful in the study of MS.
Obesity and MS are strong predictors of coronary heart disease, in addition to the use of the AIP . In the MS group there was an increase in the AIP. As a consequence, one may come to the conclusion that the group with MS also had an increased atherogenic risk and a higher risk of developing type 2 diabetes and vascular conditions when compared to the healthy group.
Moreover, individuals with high total triglycerides have greater AIP levels and an increased atherogenic risk. In the MS group, hypertriglyceridemia, with reduced HDL-C and increased LDL-C, is associated with the atherogenic triad, and may be related to increased platelet aggregation, leading to an increased atherothrombotic risk [32, 33].
In this study, 44 patients in the MS group were women. They had an waist-circumference increased, which suggests that, although not all patients with obesity have insulin resistance, they may have increased platelet aggregation as a consequence of the negative effects of visceral obesity . Moreover, the anti-aggregating effect of insulin is lost on patients with insulin resistance as it can occur in obesity, diabetes mellitus, arterial hypertension , or in MS. In the MS group, despite having an increase in insulin, its effect on platelets was reduced.
The HOMA-IR, QUICKI, and Mffm/I indices are based on fasting levels of insulin and glucose. All indices in the MS group differed significantly, compared to those obtained in healthy subjects. These indices were an evaluation of hepatic insulin resistance (IR), rather than peripheral insulin sensitivity. Hepatic IR is a major contributing factor in pre-diabetic states and it is also related to impaired fasting glucose levels . However, it is not totally proven if platelet insulin resistance is due, solely, to obesity [14, 37]. In this study, all the MS patients had an increased weight and obesity, which may indicate that these patients have platelet insulin resistance.
This study has some limitations and caution should be taken in the interpretation of the findings because of the small sample size of the study. Additionally, it may be possible that other platelet agonists, such as serotonin and submaximal doses of epinephrine induce platelet aggregation and they could be considered in further analysis .
This study supports the use of these agonist concentrations to perform platelet aggregation assays, as they could improve identification of increased platelet aggregation in patients with MS.
We found an increase in platelet aggregation in subjects with MS when platelet aggregation assays were performed using 11.0 μM epinephrine and 2.34 μM ADP. These tests showed an area under the ROC curve which distinguishes between patients with MS and healthy subjects with increased platelet aggregation.
Total serum cholesterol
Total triglyceride levels
Atherogenic index of plasma
Homeostasis model assessment
Quantitative insulin sensitivity check index
Receiver operating characteristic.
Vazzana N, Ranalli P, Cuccurullo C, Davi G: Diabetes mellitus and thrombosis. Thromb Res. 2012, 129: 371-377. 10.1016/j.thromres.2011.11.052.
Anfossi G, Russo I, Trovati M: Platelet dysfunction in central obesity. Nutr Metab Cardiovasc Dis. 2009, 19 (6): 440-449. 10.1016/j.numecd.2009.01.006.
Kurrelmeyer K, Becker L, Becker D, Yanek L, Goldschmidt-Clermont P, Bray PF: Platelet hyperreactivity in women from families with premature atherosclerosis. J Am Med Womens Assoc. 2003, 58: 272-277.
Fateh-Moghadam S, Htun P, Tomandl B, Sander D, Stellos K, Geisler T, Langer H, Walton K, Handschu R, Garlichs C, Daniel WG, Gawaz M: Hyperresponsiveness of platelets in ischemic stroke. Thromb Haemost. 2007, 97: 974-978.
Mammen EF, Barnhart MI, Selik NR: Sticky platelet syndrome: a congenital platelet abnormality predisposing to thrombosis. Folia Haematol. 1998, 115: 361-365.
Yee DL, Bergeron AL, Sun CW, Dong JF, Bray PF: Platelet hyperreactivity generalizes to multiple forms of stimulation. J Thromb Haemost. 2006, 4: 2043-2050. 10.1111/j.1538-7836.2006.02089.x.
Yee DL, Sun CW, Bergeron AL, Dong JF, Bray PF: Aggregometry detects platelet hyperreactivity in healthy individuals. Blood. 2005, 106 (8): 2723-2729. 10.1182/blood-2005-03-1290.
Aradi D, Magyarlaki T, Tokés-Füzesi M, Rideg O, Vorobcsuk A, Komócsi A: Comparison of conventional aggregometry with VASP for monitoring P2Y12-specific platelet inhibition. Platelets. 2010, 21 (7): 563-570. 10.3109/09537104.2010.494742.
Raosoft: Sample Size Calculator.http://www.raosoft.com/samplesize.html,
Alberti KG, Eckel RH, Grundy SM, Zimmet PZ, Cleeman JI, Donato KA, Fruchart JC, James WP, Loria CM, Smith SC, International Diabetes Federation Task Force on Epidemiology and Prevention; Hational Heart, Lung, and Blood Institute; AmericanHeart Association; World Heart Federation; International Atherosclerosis Society; International Association for the Study of Obesity: Harmonizing the metabolic syndrome: a joint interim statement of the international diabetes federation task force on epidemiology and prevention; national heart, lung, and blood institute; American heart association; world heart federation; international atherosclerosis society; and international association for the study of obesity. Circulation. 2009, 120 (16): 1640-1645. 10.1161/CIRCULATIONAHA.109.192644.
Qu HQ, Li Q, Rentfro AR, Fisher-Hoch SP, McCormick JB: The definition of insulin resistance using HOMA-IR for Americans of Mexican descent using machine learning. PLoS One. 2011, 6 (6): e21041-10.1371/journal.pone.0021041.
Aschner P, Buendía R, Brajkovich I, Gonzalez A, Figueredo R, Juarez XE, Uriza F, Gomez AM, Ponte CI: Determination of the cutoff point for waist circumference that establishes the presence of abdominal obesity in Latin American men and women. Diabetes Res Clin Pract. 2011, 93 (2): 243-247. 10.1016/j.diabres.2011.05.002.
Hanson RL, Pratley RE, Bogardus C, Narayan KM, Roumain JM, Imperatore G, Fagot-Campagna A, Pettitt DJ, Bennett PH, Knowler WC: Evaluation of simple indices of insulin sensitivity and insulin secretion for use in epidemiologic studies. Am J Epidemiol. 2000, 151: 190-198. 10.1093/oxfordjournals.aje.a010187.
Bonora E, Kiechl S, Willeit J, Oberhollenzer F, Egger G, Targher G, Alberiche M, Bonadonna RC, Muggeo M: Prevalence of insulin resistance in metabolic disorders: the Bruneck Study. Bruneck study Diabetes. 1998, 47: 1643-650.
Katz A, Nambi SS, Mather K, Baron AD, Follmann DA, Sullivan G, Quon MJ: Quantitative insulin sensitivity check index: A simple, accurate method for assessing insulin sensitivity in humans. J Clin Endocrinol Metab. 2000, 85: 2402-2410. 10.1210/jcem.85.7.6661.
Muniyappa R, Lee S, Chen H, Quon MJ: Current approaches for assessing insulin sensitivity and resistance in vivo: advantages limitations, and appropriate usage. Am J Physiol Endocrinol Metab. 2008, 294: E15-26.
McAuley KA, Williams SM, Mann JI, Walker RJ, Lewis-Barned NJ, Temple LA, Duncan AW: Diagnosing insulin resistance in the general population. Diabetes Care. 2001, 24: 460-464. 10.2337/diacare.24.3.460.
Born GVR: Quantitative investigations into the aggregation of blood platelets. J Physiol. 1962, 162: 67-68.
Dobiásová M: Atherogenic index of plasma [log(triglycerides/HDL- cholesterol)]: theoretical and practical implications. Clin Chem. 2004, 50: 1113-1115. 10.1373/clinchem.2004.033175.
Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic curve. Radiology. 1982, 143: 29-36. 10.1148/radiology.143.1.7063747.
Wang TH, Bhatt DL, Topol EJ: Aspirin and clopidogrel resistance: an emerging clinical entity. Eur Heart J. 2006, 27: 647-654. 10.1093/eurheartj/ehi684.
Jacobson KA, Deflorian F, Mishra S, Costanzi S: Pharmacochemistry of the platelet purinergic receptors. Purinergic Signal. 2011, 7 (3): 305-324. 10.1007/s11302-011-9216-0.
Cattaneo M: Aspirin and clopidogrel: efficacy, safety, and the issue of drug resistance. Arterioscler Thromb Vasc Biol. 2004, 24: 1980-1987. 10.1161/01.ATV.0000145980.39477.a9.
Cavallari U, Trabetti E, Malerba G, Biscuola M, Girelli D, Olivieri O, Martinelli N, Angiolillo DJ, Corrocher R, Pignatti PF: Gene sequence variations of the platelet P2Y12 receptor are associated with coronary artery disease. BMC Med Genet. 2007, 8: 59-
Nagy B, Jin J, Ashby B, Reilly MP, Kunapuli SP: Contribution of the P2Y12 receptor-mediated pathway to platelet hyperreactivity in hypercholesterolemia. J Thromb Haemost. 2011, 9 (4): 810-819. 10.1111/j.1538-7836.2011.04217.x.
Abderrazek F, Chakroun T, Addad F, Dridi Z, Gerotziafas G, Gamra H, Hassine M, Elalamy I: The GPIIIa PlA polymorphism and the platelet hyperactivity in Tunisian patients with stable coronary artery disease treated with aspirin. Thromb Res. 2010, 125 (6): e265-e268. 10.1016/j.thromres.2010.01.011.
Yokoyama M, Kusui A, Sakamoto S, Fukuzaki H: Age-associated increments in human platelet alpha-adrenoceptor capacity. Possible mechanism for platelet hyperactivity to epinephrine in aging man. Thromb Res. 1984, 34 (4): 287-95. 10.1016/0049-3848(84)90385-2.
Srivastava K, Dash D: Changes in membrane microenvironment and signal transduction in platelets from NIDDM patients-a pilot study. Clin Chim Acta. 2002, 317 (1–2): 213-220.
Yokoyama M, Kawashima S, Sakamoto S, Akita H, Okada T, Mizutani T, Fukuzaki H: Platelet reactivity and its dependence on alpha-adrenergic receptor function in patients with ischaemic heart disease. Br Heart J. 1983, 49 (1): 20-25. 10.1136/hrt.49.1.20.
Yokoyama M, Kawashima S, Sakamoto S, Akita H, Okada T, Mizutani T, Fukuzaki H: Platelet reactivity and its dependence on alpha-adrenergic receptor function in patients with ischaemic heart disease. Br Heart J. 1983, 49 (1): 20-25. 10.1136/hrt.49.1.20.
Onat A, Can G, Kaya H, Hergenç G: "Atherogenic index of plasma" (log10 triglyceride/high-density lipoprotein-cholesterol) predicts high blood pressure, diabetes, and vascular events. J Clin Lipidol. 2010, 4 (2): 89-98. 10.1016/j.jacl.2010.02.005.
Puccetti L, Bruni F, Pasqui AL, Pastorelli M, Bova G, Cercignani M, Palazzuoli A, Auteri A: Dyslipidemias and fibrinolysis. Ital Heart J. 2002, 3 (10): 579-586.
Grundy SM, Pasternak R, Greenland P, Smith S, Fuster V: AHA/ACC scientific statement: assessment of cardiovascular risk by use of multiple-risk- factor assessment equations: a statement for healthcare professionals from the American Heart Association and the American College of Cardiology. J Am Coll Cardiol. 1999, 34: 1348-1359. 10.1016/S0735-1097(99)00387-3.
Davì G, Guagnano MT, Ciabattoni G, Basili S, Falco A, Marinopiccoli M, Nutini M, Sensi S, Patrono C: Platelet activation in obese women: role of inflammation and oxidant stress. JAMA. 2002, 288: 2008e14-
Trovati M, Mularoni EM, Burzacca S, Ponziani MC, Massucco P, Mattiello L, Piretto V, Cavalot F, Anfossi G: Impaired insulin-induced platelet antiaggregating effect in obesity and in obese NIDDM patients. Diabetes. 1995, 44 (11): 1318-1322. 10.2337/diab.44.11.1318.
Borai A, Livingstone C, Kaddam I, Ferns G: Selection of the appropriate method for the assessment of insulin resistance. BMC Med Res Methodol. 2011, 11: 158-10.1186/1471-2288-11-158.
Spectre G, Östenson CG, Li N, Hjemdahl P: Postprandial platelet activation is related to postprandial plasma insulin rather than glucose in patients with type 2 diabetes. Diabetes. 2012, 61 (9): 2380-2384. 10.2337/db11-1806.
Berger JS, Becker RC, Kuhn C, Helms MJ, Ortel TL, Williams R: Hyperreactive platelet phenotypes: relationship to altered serotonin transporter number, transport kinetics and intrinsic response to adrenergic co-stimulation. Thromb Haemost. 2013, 109 (1): 85-92.
Thanks are due to Monserrat Leticia Flores Ramirez and Victoria C. Ibañez for their technical assistance. The authors kindly thank Charlotte Grundy for her editorial assistance. The authors have no conflicts of interest to declare.
The authors declare that they have no competing interests.
LPCM, EPC, EZ, AMC, EPO, participated in; study concept, design, supervised conduct of the study, drafting and critical revision of the manuscript. DMP, FJRC, RMC, SPC, PH, MARF, GMA, BG, participated in; design, acquisition of data, analysis and interpretation of data. All authors have read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.