|Year : 2017 | Volume
| Issue : 2 | Page : 106-113
Developing an economic case of clinical pharmacists' interventions on venous thromboembolism prophylaxis through service evaluation
Eun Hee Lee1, Victoria Bray2, Robert Horne3
1 Department of Pharmacy, University College London, London, England
2 Emergency Department, St. George's University Hospitals NHS Foundation Trust, London, England
3 Centre for Behavioural Medicine, University College London, London, England
|Date of Web Publication||31-May-2017|
Eun Hee Lee
Department of Pharmacy, University College London, London
Source of Support: None, Conflict of Interest: None
Objective: Venous thromboembolism (VTE) has become a huge health problem as well as a financial burden for the National Health Service. The objective of this study was to characterize current practice of VTE prophylaxis (VTEP) and evaluate the economic impact of clinical pharmacists' interventions (CPIs) on VTEP. Methods: A prospective service evaluation was conducted in a medical and surgical ward at a tertiary teaching hospital in London from 23 May to 08 June 2016. Appropriateness of risk assessment (RA) and VTEP and CPIs were categorized and assessed. Based on the results of the service evaluation, a pharmacoeconomic analysis was undertaken to estimate the cost savings by CPIs for inappropriate pharmacological VTEP. Findings: A total of 203 cases were analyzed. The rates of appropriateness for RA on admission, RA at 24 h and pharmacological VTEP were 58.6%, 39.7%, and 75.4%, respectively. In the medical ward, there was a significant difference of appropriate RAs between on admission and at 24 h (70.3% vs. 23.8%, respectively). Whereas, the rate of appropriate pharmacological VTEP accounted for 75.4% and the rate of appropriate prophylaxis was significantly higher in the medical ward than surgical ward (80.5% vs. 68.2%, P= 0.045). Of 50 cases of inappropriate pharmacological prophylaxis, 39 cases (78.0%) were corrected by clinical pharmacists. These CPIs resulted in £1,286.23 cost savings during the study and it was estimated to be £517,522/annum. Conclusion: CPIs had significant positive clinical and economic impacts on VTEP. There is more scope for the improvement of RA at 24 h through CPIs.
Keywords: Clinical pharmacists' interventions, pharmacoeconomic analysis, venous thromboembolism prophylaxis
|How to cite this article:|
Lee EH, Bray V, Horne R. Developing an economic case of clinical pharmacists' interventions on venous thromboembolism prophylaxis through service evaluation. J Res Pharm Pract 2017;6:106-13
|How to cite this URL:|
Lee EH, Bray V, Horne R. Developing an economic case of clinical pharmacists' interventions on venous thromboembolism prophylaxis through service evaluation. J Res Pharm Pract [serial online] 2017 [cited 2018 Sep 25];6:106-13. Available from: http://www.jrpp.net/text.asp?2017/6/2/106/207352
| Introduction|| |
Venous thromboembolism (VTE) refers to deep vein thrombosis (DVT) and pulmonary embolism (PE). This is a leading cause of mortality and morbidity in hospitalized patients.,, Every year, over 25,000 people in England die from hospital-acquired VTE and it has become a huge health problem., The total cost of managing VTE in the UK is approximately £640 million/year. However, hospital-acquired thrombosis can be preventable with evidence-based pharmacological and/or mechanical prophylaxis.
Therefore, the National Institute for Health and Care Excellence (NICE) guidelines recommend risk assessment (RA) and most clinically and cost-effective options for thromboprophylaxis for hospitalized patients. RA should be conducted for all patients on admission to identify those who are at increased risk of VTE. This is assessed based on whether to have ongoing reduced mobility for medical patients, VTE risk factors and bleeding risk factors for both medical and surgical patients. In addition, reassessment of the patients' VTE and bleeding risk factors within 24 h of admission and whenever the clinical situation changes are also recommended by the guidelines to ensure that the methods of thromboprophylaxis being used are suitable and that thromboprophylaxis is being used correctly and also to identify adverse events resulting from thromboprophylaxis.
Despite explicit guidelines of thromboprophylaxis, underutilized and suboptimal thromboprophylaxis in hospitalized patients remains problematic. Although evidence shows that clinical pharmacists' interventions (CPIs) on VTE prophylaxis (VTEP) can improve doctors' prescribing patterns and adherence of VTEP guidelines., Furthermore, there were only a few studies , that investigated the economic impact of CPIs on VTEP. Therefore, this study aimed to characterize current practice of VTEP and evaluate the economic impact of CPIs on VTEP. Finally, it aimed to identify scope of the clinical and economic improvement through CPIs.
| Methods|| |
A pharmacoeconomic study based on a prospective service evaluation was conducted at a 993-bed tertiary teaching hospital in South London. This hospital has been putting continuous effort into improving VTEP. Finally, it became a National VTE Exemplar Centre in November 2015.
Study population for the service evaluation was all adults (aged ≥18) who were admitted to hospital at a medical and surgical ward as in-patients to be assessed risk of VTE and bleeding. The two wards selected were high turnover wards selected to achieve sufficient sample size during the study, as well as because the study focused on VTEP on admission and at 24 h. The ethical issues were reviewed and approved by University College London ethics approval process.
Data collection was from 23 May 2016 to 08 June 2016. A short study period was picked not only to rule out seasonal variation in compliance to VTEP but also to minimize the intrusion on the pharmacists' daily practice as they had fairly demanding roles in this prospective study setting. Ward pharmacists recorded patients' demographics, each of RA components (mobility, thrombosis, bleeding, signing, and reassessment at 24 h), VTEP prescription (drug, dose, frequency, and route) as well as their interventions on VTEP. In the medical ward, data were collected by pharmacists during morning and evening post-take ward rounds (PTWR).
The researcher had a responsibility to validate all data collected by pharmacists through comparing collected data to original drug charts. Incorrect or ambiguous data was dealt with by discussions with ward pharmacists. The researcher collected risk reassessment data at 24 h, when ward pharmacists did not record. Based on collected data, the researcher assessed appropriateness of VTEP and categorized as appropriate prophylaxis (AP) and inappropriate pharmacological VTEP Type I–IV [Figure 1].
|Figure 1: Flowchart to decide type of venous thromboembolism prophylaxis. VTEP: Venous thromboembolism prophylaxis, AP: Appropriate prophylaxis|
Click here to view
Appropriate RA was defined as all components of RA were initially appropriately completed by doctors without CPIs. However, for reassessment at 24 h, appropriateness refers to completion regardless whether by a doctor or pharmacist at the time of follow-up, because a lot of this data were followed-up by the researcher. In this case, it was not recognized by the researcher whether CPIs involved in completion of reassessment at 24 h.
Appropriate VTEP was defined as a case prescribed the right choice of drug (e.g., unfractionated heparin [UFH] or dalteparin or fondaparinux), a right dose and a right frequency through a right route by doctors without CPIs. Inappropriate VTEP was defined as a case received any of the wrong choice of drug or a wrong dose or a frequency or a wrong route so CPIs were needed to complete AP. These outcomes were measured in each number of patients who received appropriate/inappropriate RA or VTEP.
- AP: Right indication and AP received, or no indication and no VTEP received
- Type I: Right indication but no VTEP received
- Type II: Right indication and VTEP received, but wrong drug
- Type III: Right indication and VTEP received, but incorrect dose or frequency
- Type IV: No indication but VTEP received.
Before commencing data analysis, all collected data were processed by data cleaning process to select the input errors or missing values. IBM SPSS Statistics for Windows, Version 22.0. (Armonk, NY: IBM Corp.) and Microsoft Excel software 2010 were used in this data analysis. Descriptive analysis was used for patients' demographics, the rates of appropriate/inappropriate RA and VTEP, frequencies of CPIs. Inferential analysis (Chi-square test) was used for comparing appropriateness of RA and VTEP between the medical and surgical ward.
Based on the data analysis of the service evaluation, a cost-benefit analysis was conducted.
Due to the lack of evidence on indirect cost of CPIs and possibility of an increase of uncertainty, this study did not consider indirect costs throughout the cost-benefit analysis. The cost of CPIs was estimated based on a pharmacist's annual salary and time spent of CPIs on VTEP per patient. Time spent of CPIs on VTEP per patient was obtained from the actual average time (4 min) which was documented by pharmacists in the data collection tool. Pharmacist employment cost was based on band six mid-point as per the Agenda for Change 2016/17 (£30,357/year) plus an additional 10% of on-costs (£3036) was included as payments for overtime, shift work, national insurance, and superannuation.
Cost of CPIs on VTEP = Total number of sample patients during the data collection period × Time spent of CPIs on VTEP per patient (min) × Pharmacist's cost per unit (min)
The benefit of CPIs only included the cost avoidance associated with inappropriate pharmacological VTEP, although CPIs frequently contributed to inappropriate RA. It is because information of the costs associated with inappropriate RA was not available, and these costs were likely to be offset by savings that could be achieved from VTE avoided as a consequence of VTEP. The benefit of CPIs refers to the cost avoidance saved by preventing adverse drug events (ADEs) by CPIs, as CPIs can contribute to potentially avoiding the medical costs caused by inappropriate pharmacological VTEP. However, all medication errors relating to inappropriate pharmacological VTEP may not lead to ADEs, thus the probability of ADEs should be considered in estimation of the number of patients who would avoid ADEs by CPIs. Therefore, the benefit of CPIs (cost avoidance) was estimated based on the number of patients who would avoid ADEs by CPIs and the cost for managing ADEs.
Benefit of CPIs (cost avoidance of ADEs caused by inappropriate VTEP) = Total number of patients who received inappropriate VTEP without CPIs during the data collection period × Probability of ADEs × Cost of managing ADEs
The previous studies found that ADEs associated with inappropriate VTEP were VTE or bleeding.,, These probabilities of VTE and bleeding were corresponded to the basic probability setting of ADEs (0, 0.01, 0.1, 0.4, and 0.6) which were extrapolated from the previous studies.,, To determine the probability of VTE (0.1 for the medical patients, 0.4 for the surgical patients) and bleeding (0.01) as ADEs caused by inappropriate VTEP was also based on previous studies and published reports.,,,,,
To estimate the cost managing ADEs associated with inappropriate VTEP, the figures from the previous study  were adjusted by HCHS index between 2007 and 2015 (293.1/257.0) to reflect the inflation rate. Inappropriate pharmacological VTEP Type I and Type III could develop VTE (DVT or PE) as ADEs in the absence of CPIs. This cost of managing VTE was matched with the calibrated cost of significant ADEs, which was £171. Inappropriate pharmacological VTEP Type II and Type IV could be associated with bleeding as ADEs, and these cases were considered more serious ADEs as patients were at an actual risk of bleeding due to the presence of concurrent renal impairment or the administration of oral anticoagulants (e.g., warfarin). Thus the cost of £813 was assigned to manage ADEs.
Based on estimating the cost avoidance associated with inappropriate VTEP and the cost of CPIs, a cost-benefit analysis was carried out as a pharmacoeconomic analysis. Apart from a cost-benefit ratio, a net benefit was calculated by the difference between the benefit of CPIs and the cost of CPIs.
To test the robustness of the results in the presence of uncertainty, a sensitivity analysis was conducted by changing time spent of CPIs on VTEP per patient and the costs of managing ADEs. To confirm a positive economic impact of CPIs under the worst case scenario, time of CPIs increased by 100% and the costs of managing ADEs were set as minimum costs from the reference costs; hence, the result would have a minimum benefit.
| Results|| |
There were 327 admissions during the data collection in both the medical and surgical wards. Among these admissions, 203 patients' data were included for the final analysis and 25 of these were collected from the pilot study as there were no significant change of study settings between the pilot study and the actual study. [Figure 2] displays the data collection flowchart. [Table 1] summarizes the characteristics of the demographics.
[Table 2] compares the appropriate rates for RA and pharmacological VTEP between the medical and surgical wards. The rates for RA on admission (70.3% vs. 42.4%, P < 0.001) and pharmacological VTEP (80.5% vs. 68.2%, P= 0.045) were significantly higher in the medical ward while the rate of RA at 24 h (23.8% vs. 60.3%, P < 0.001) was significantly higher in the surgical ward.
|Table 2: Summary of results for risk assessment and pharmacological venous thromboembolism prophylaxis|
Click here to view
[Figure 3] shows who completed the risk reassessment at 24 h, only 22 patients (10.8%) received appropriate risk reassessment within 24 h by doctors without CPIs. The risk reassessment at 24 h for more than half of the study population (108 patients, 53.2%) was not completed by neither doctor nor pharmacist.
Of fifty patients (24.6%) received inappropriate VTEP, which was initially incorrectly prescribed by doctors hence needing CPIs to complete AP, 12.8% were associated with inappropriate VTEP Type I, 3.0% with Type II, 6.4% with Type III and 2.5% with Type IV. Inappropriate Type II was associated with patients with renal impairment who needed to be prescribed UFH instead of dalteparin (four patients). The other two patients were prescribed pharmacological VTEP with a product name instead of a drug name, for example, “Fragmin” instead of “Dalteparin,” which is against Trust Medicines Management Policy whereby generic names should be used unless substitution is clinically inappropriate. Type III included the cases of patients whose body weight was over 100 kg (11 patients). They needed to be given dalteparin 5000 units, twice a day instead of once a day. Furthermore, Type III was associated with inappropriate prescription with a wrong unit of dalteparin (two patients). Type IV was associated with patients who were at a high risk of bleeding.
[Table 3] shows the type and frequency of CPIs for inappropriate pharmacological VTEP. Of 50 cases of inappropriate pharmacological VTEP, 11 cases (22.0%) remained inappropriate without CPIs. In seven cases (14.0%), pharmacists intervened in inappropriate doctors' prescriptions but doctors did not complete AP, and in four cases (8.0%), pharmacists did not attempt CPIs in inappropriate doctors' VTEP prescriptions.
|Table 3: Type and frequency of clinical pharmacists' interventions for inappropriate pharmacological venous thromboembolism prophylaxis|
Click here to view
For the holistic appropriate VTEP, which was defined as appropriate RA on admission and at 24 h and appropriate pharmacological VTEP, only 35 patients (17.2%) of the total study population were treated appropriately. There was no significant difference in the final appropriate VTEP between the medical and surgical ward (19.5% vs. 14.1%, P= 0.317).
In terms of the cost-benefit analysis, [Table 4] explains how to estimate the cost of CPIs. The total cost of CPIs during the study period was £241.28. [Table 5] shows how to estimate the benefit of CPIs (cost avoidance). £1527.51 was estimated as the cost avoidance of ADEs caused by inappropriate VTEP during the study. Therefore, a net benefit of CPIs on VTEP during the study was £1286.23, the cost-benefit ratio was 6.33 and the net cost-benefit ratio was 5.33. Considering that there were 326 admissions during the study period and 131,168 admissions in 2015/2016 at this hospital, the annual net benefit of CPIs was estimated to be £517,522.
|Table 4: Estimation of cost parameters of clinical pharmacists' interventions|
Click here to view
|Table 5: Estimation of the benefit of clinical pharmacists' interventions (cost avoidance)|
Click here to view
As stated above, of 50 cases of inappropriate pharmacological VTEP, 11 cases (22.0%) remained inappropriate without CPIs. If these 11 cases had appropriate CPIs, £357.42 would have been additionally saved during the study, which was equivalent to £143,810/year.
A sensitivity analysis was conducted by varying the time spent on CPIs on VTEP and the cost of managing ADEs. When the time increased by 100% (from 4 to 8 min), the cost of CPIs during the study period was doubled as £482.56. Nevertheless, the net benefit of CPIs was £1044.95, the cost-benefit ratio was 3.17 and the net cost-benefit ratio was 2.17. When the cost of ADEs was set as a minimum value (from £171 to £74), the benefit of CPIs (cost avoidance) decreased to £693.31. Nevertheless, the net benefit of CPIs was £452.03, the cost-benefit ratio was 2.88 and the net cost-benefit ratio was 1.88 [Appendix 1 [Additional file 1]]. All those figures still demonstrate the positive economic impact of CPIs on VTEP even in the worst scenarios.
| Discussion|| |
Through the findings from this study, the presence of clinical pharmacists in PTWR in the medical ward was highlighted as the result of better outcomes. The clear difference of the rates of appropriate RA in the medical ward between on admission (70.3%) and at 24 h (23.8%) may have been caused by attendance of clinical pharmacist in PTWR. In addition, the difference of the rates of pharmacological AP between the medical and surgical ward (80.5% and 68.2%, respectively) may have been as a result of the presence of clinical pharmacists in PTWR. This was supported by the previous study that showed more drastic improvement in AP (from 37% to 85%) was made when CPIs were made during the ward round.
Above all, this study showed that CPIs had a substantial cost saving (£517,522/year), also an additional cost saving (£143,810/year) was expected if CPIs are improved in the area of failure of CPIs. Interestingly, a similar amount of cost saving by CPIs (1,027,500 USD/year) was estimated in another study by Mahmoudi et al. In this study, the reduction in direct cost was 56% after guideline implementation as CPIs. A study by Khalili et al. also demonstrated the economic significance of CPIs in an infectious diseases ward that 39.0% of CPIs had moderate to major financial benefits and 3.8% of mean direct cost per patient decreased after CPIs. It can be concluded that improvement of clinical practice of VTEP by CPIs could not only increase patients' safety by reducing ADEs but also save the costs.,
Nevertheless, the results of this study showed that that inappropriate RA and failure of CPIs on inappropriate VTEP remained problematic and it could have caused additional medical costs. In this context, this study suggests that inappropriate RA and failure of CPIs on inappropriate VTEP could be new areas for CPIs to be improved to develop an economic case of CPIs.
Therefore, the solution to improve VTEP seems to be clear. Spontaneous input of clinical pharmacist employments in practice would allow clinical pharmacists to join the daily ward round in many wards and it would be expected the positive clinical and economic benefits on VTEP.
This study could have comparable strengths to previous studies on VTEP. First, this study prospectively collected the data during daily practice in the ward, which can be a powerful technique for data collection as these data relates to real-practice scenarios, hence can be more accurate. Second, this study aimed to assess the clinical and economic impact of CPIs on VTEP. Many of the studies ,,,,,,,,,, evaluated the clinical impact of CPIs but only few studies , extended their study objectives to the economic impact of CPIs. Even these two studies did not use precise method for economic analysis. Therefore, this pharmacoeconomic analysis based on the prospective method may have enabled this study to assess more accurate and precise clinical and economic impacts of CPIs.
Despite the meaningful findings, our study has some limitations. First, this study was designed to identify current practice on VTEP relating to CPIs; hence, this study was focused on medication errors in doctors' prescription. Thus, the actual incidence of VTE or bleeding as ADEs relating to medication errors on VTEP were not observed as it was beyond the scope of this study. Due to the lack of the actual clinical data, it may have some problems in the reliability of this study results. However, the safety and efficacy of pharmacologic VTEP in this specific population has been well proven in many studies. Therefore, our study suggests that further study measures improvement of actual clinical outcomes by CPIs in the randomized-controlled study setting in order to precisely assess the impact of CPIs. Second, the scope of observation in this study was limited on admission and at 24 h after admission. NICE outlines seven quality measures on which a high quality VTEP services should focus and aim to achieve, including extended VTEP in accordance with NICE guidelines. Extended VTEP would be especially more important for postoperative surgical patients. It may have a huge impact on patient's clinical status (such as mortality) as well as economic aspect because normally extended VTEP is associated with relatively long-term therapy thus it would affect the patient's adherence issues and healthcare costs. Lastly, this pharmacoeconomic analysis model was developed by a researcher by extrapolating the costs parameters from previous study. This model was very novel and no-one had ever used it before to assess CPIs on VTEP, even though a similar method was used in the other area of CPIs. Therefore, the cost saving obtained from this study's results may be higher or lower in real practice. However, to tackle this issue, the model applied various methodological steps to make the economic impact robust and realistic, such as a sensitivity analysis. Apart from these major limitations, the short duration of the study and significant difference of age and rate of renal impairment between the medical and surgical wards could be the potential drawbacks of this study.
Our study successfully demonstrated that CPIs had considerably positive clinical and economic impact on VTEP. Furthermore, this study found the areas which needed more improvement by CPIs. Above all, this study highlighted the value of clinical pharmacists' involvement in PTWR by showing the obviously different rates of appropriate RA between on admission with pharmacists and at 24 h without pharmacists. These findings will support the impact and value of CPIs on VTEP in practice, and provide important information for policy makers to improve VTEP.
| Authors' Contribution|| |
Eun Hee Lee contributed in concepts, design, definition of intellectual content, literature search, clinical studies, data acquisition, data analysis, statistical analysis, manuscript preparation, editing and review. Victoria Bray contributed in concepts, design, definition of intellectual content, clinical studies, manuscript preparation and editing and review. Robert Horne contributed in concepts, definition of intellectual content, data analysis, statistical analysis, manuscript editing and review.
We would like to express our gratitude to all pharmacists at St. Georges Hospital who participated in our study. Robert Horne was supported by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care (CLAHRC) North Thames at Bart's Health NHS Trust. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Bernier MC, Desjardins K, Filiatrault J, Sauriol MA, Martineau J, Gilbert E, et al.
Implementation and evaluation of a pharmacy-led thromboprophylaxis campaign in a community hospital. J Thromb Thrombolysis 2011;32:431-8.
Kahn SR, Morrison DR, Cohen JM, Emed J, Tagalakis V, Roussin A, et al.
Interventions for implementation of thromboprophylaxis in hospitalized medical and surgical patients at risk for venous thromboembolism. Cochrane Database Syst Rev 2013;(7):CD008201.
Khalili H, Dashti-Khavidaki S, Talasaz AH, Mahmoudi L, Eslami K, Tabeefar H. Is deep vein thrombosis prophylaxis appropriate in the medical wards? A clinical pharmacists' intervention study. Pharm World Sci 2010;32:594-600.
National Institute for Health and Care Excellence. Venous Thromboembolism: Reducing the Risk for Patients in Hospital; 2010. Available from: https://www.nice.org.uk/guidance/cg92
. [Last cited on 2016 Jul 04].
Piazza G, Nguyen TN, Morrison R, Cios D, Hohlfelder B, Fanikos J, et al.
Patient education program for venous thromboembolism prevention in hospitalized patients. Am J Med 2012;125:258-64.
Bauer JB, Chun DS, Karpinski TA. Pharmacist-led program to improve venous thromboembolism prophylaxis in a community hospital. Am J Health Syst Pharm 2008;65:1643-7.
Carroll DN, Hudson EB. Venous thromboembolism prophylaxis conversion in nonsurgical inpatients. Ann Pharmacother 2003;37:1194-6.
Nesbit TW, Shermock KM, Bobek MB, Capozzi DL, Flores PA, Leonard MC, et al.
Implementation and pharmacoeconomic analysis of a clinical staff pharmacist practice model. Am J Health Syst Pharm 2001;58:784-90.
Mahan C, Spyropoulos AC. Improving prevention and treatment of venous thromboembolism: Clinical trial results. J Med Econ 2012;15:611-22.
Peterson GM, Drake CI, Jupe DM, Vial JH, Wilkinson S. Educational campaign to improve the prevention of postoperative venous thromboembolism. J Clin Pharm Ther 1999;24:279-87.
Ah YM, Lee JY, Moon MR, Cho YS, Kim HS, Yi NJ, et al.
Clinical and economic evaluation of pharmacists' contribution to patient care on a multi-disciplinary liver transplant team. Int J Clin Pharmacol Ther 2016;54:102-9.
Neville HL, Chevalier B, Daley C, Nodwell L, Harding C, Hiltz A, et al.
Clinical benefits and economic impact of post-surgical care provided by pharmacists in a Canadian hospital. Int J Pharm Pract 2014;22:216-22.
Geerts WH, Bergqvist D, Pineo GF, Heit JA, Samama CM, Lassen MR, et al.
Prevention of venous thromboembolism: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines (8th
Edition). Chest 2008;133 6 Suppl: 381S-453S.
Haga CS, Mancio CM, Pioner Mda C, Alves FA, Lira AR, Silva JS, et al.
Implementation of vertical clinical pharmacist service on venous thromboembolism prophylaxis in hospitalized medical patients. Einstein (Sao Paulo) 2014;12:27-30.
Karnon J, Campbell F, Czoski-Murray C. Model-based cost-effectiveness analysis of interventions aimed at preventing medication error at hospital admission (medicines reconciliation). J Eval Clin Pract 2009;15:299-306.
Stark JE, Vesta KS. A pharmacist-initiated method to improve venous thromboembolic prophylaxis rates in medically ill patients. J Pharm Pract 2006;19:275-9.
Mahmoudi L, Karamikhah R, Mahdavinia A, Samiei H, Petramfar P, Niknam R. Implementation of pharmaceutical practice guidelines by a project model based: Clinical and economic impact. Medicine (Baltimore) 2015;94:e1744.
Khalili H, Karimzadeh I, Mirzabeigi P, Dashti-Khavidaki S. Evaluation of clinical pharmacist's interventions in an infectious diseases ward and impact on patient's direct medication cost. Eur J Intern Med 2013;24:227-33.
Smith F. Conducting Your Pharmacy Practice Research Project. London: Pharmaceutical Press; 2010.
Ra G, Thanabalan R, Ratneswaran S, Nguyen GC. Predictors and safety of venous thromboembolism prophylaxis among hospitalized inflammatory bowel disease patients. J Crohns Colitis 2013;7:e479-85.
Vervacke A, Lorent S, Motte S. Improved venous thromboembolism prophylaxis by pharmacist-driven interventions in acutely ill medical patients in Belgium. Int J Clin Pharm 2014;36:1007-13.
[Figure 1], [Figure 2], [Figure 3]
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5]