Designing Evaluation Plan For Hip Fracture Prevention Program

The assignment task is to design an appropriate evaluation for the Preparation and Implementation Project outlined above and ongoing monitoring in the first two years of the Hip Fracture Prevention Program. Your evaluation plan should be no more than 3,500 words. Students can discuss the assignments with other fellow students, however students should write up the assignment individually and independently.

The evaluation plan should specify:

1.The purpose of the overall evaluation of the Preparation and Implementation Project;
2.The specific focus of the process evaluation and impact evaluation (please use the two tables provided)
3.The rationale for specific approach selected for conducting the evaluation when applicable;
4.The strategies that will be employed to control for internal and external validity;
5.Potential risks and issues of the evaluation;
6.What should be the focus of the ongoing monitoring of the program annually? You will need to provide details of types of indicators to be collected and frequency of collection.
 

Purpose of the overall evaluation of the implementation and preparation project

The main purpose of the project is to develop a hip fracture prevention program which is generally designed in order to reduce the morbidity, mortality as well as costs within 10 residential facilities in Jurassic aged care. It is found that the entire program of hip fracture prevention is implemented for introducing proper monitoring system within time period of 3 months so that the risks that are related with physical care will be reduced within the time period of 6 months.

The two types of evaluation that are generally conducted within the preparation as well as implementation of the hip fracture prevention program are generally elaborated below:

 Process evaluation: Process evaluation method mainly reflects on the implementation procedure as well as attempts that are helpful in determining how successfully the entire project is followed in order to develop the hip fracture prevention program. It is found that the process evaluation mainly reflects on the first three segments including the logic model inputs, activities as well as outputs (Moore et al., 2015). It generally assists in allowing the evaluators for making appropriate distinction between the implementation failure as well as theory failure within a project. This evaluation method helps in identifying the procedures that are generally needed to be undertaken in order to make decisions for developing the entire program successfully.

Impact evaluation: Impact evaluation is mainly defined as an assessment that helps in determining the changes that can be attributed to a specific intervention such as a program, project as well as both the intended as well as unintended ones. It is found that impact evaluation is generally undertaken in order while organizing a fall prevention program for improving the intervention as well as informing decisions about whether to continue with the project or not (Moore et al., 2015).

The process evaluation method that is generally followed in order for successfully develop the hip fracture prevention program in order to reduce the morbidity, mortality and costs associated with falls are generally elaborated in the table below:

Strategies		Key Activities/components to be included in process evaluation		Indicators for measurement		Methods for measurement (How will you collect the data)		When will the information be collected?
Engaging persons for performing the evaluations	The activities that are needed to be undertaken for engaging persons in order to perform evaluations are listed below: Ø Separating the duties of the individuals who are involved with the process of the evaluation Ø Assigning work to the team members so that they can get involved within the work Ø Providing the facility of training to the persons who are involved with the process of evaluation.		The indicators of measurement are listed below: Ø If the duties of the individuals are separated and they are assigned with the work as per their ability then it can be helpful in measuring the engagement of the persons. Ø If   the persons are engaged with the procedure of evaluation then it is considered as one of the significant measurement steps.		The methods that are generally utilized for measuring including: Interviewing the people: The people who get involved with the process evaluation needs to be interviewed in order to order to analyze their engagement with the process evaluation. Analyzing the involvement of the persons: The involvement of the people is analyzed in order to make sure that the people are effectively involved with the procedure of process evaluation or not.		The information will be collected after the people are assigned with the work of process evaluation and they are trained.
Deciding what to measure		The steps that are needed to be undertaken for deciding what to measure are listed below: Ø Tracking information about participation of the people Ø Adherence to the curriculum as well as planning Ø In addition to this it is necessary to track information related with personal perceptions		The steps that are needed to be undertaken in order to measure the steps are listed below: Ø Analyzing the demographic data will be helpful as it helps in releveling the success of the program. Ø Attendance records assist in revealing the dosage of the participants Ø Monitoring the fidelity will be helpful as it assists in showcasing how closely the program is properly adhered  Successful adherence of the entire work plan is very much necessary.		The methods of data collection are generally elaborated below:  Data collection form or interview: Interview is mainly conducted in order to   collect data regarding the information that are required to be measured.  Fidelity monitoring procedure: Fidelity monitoring procedure is considered as one of the significant steps for collecting data about how closely the program is properly adhered. Staff surveys: Staffs surveys are required to be conducted track information related with personal perceptions on the measures that are needed to be undertaken.		The information will be conducted after the steps that are needed for discussing measures on process evaluation is successfully implemented.
Selecting methods for obtaining data		The steps that are undertaken for selecting methods for obtaining data are generally listed below: Ø Collection of various types of demographic data from various participants in order to collect details from the respondents. Tracking the attendance record of the participant for each session which will generally helpful in allowing for quantifying the entire program dosage Ø It is necessary to conduct satisfaction surveys at the send of the session		The steps that are necessary for measuring the steps are generally elaborated below: Ø The data that are necessary for the process evaluation are properly collected Ø The program is quantified successfully as per the dosage of the participant.		The steps that are used for collecting data are generally elaborated below: Surveys: Surveys are generally conducted in order to collect information details about the respondents. Satisfaction surveys: Satisfaction surveys are generally conducted in order to sum up the pros as well as cons regarding the group effort. Analyzing rosters: It assists in providing information about the participants who are involved in each of the session.		The data are generally collected after the selection of the methods of obtaining data get finalized.
Setting schedule as well as assigning responsible parties		The steps that are generally undertaken in order to set the schedule are listed below: Ø Development of schedule Ø Selection of organized person Ø Entering schedule on the process evaluation planner		The steps that are generally undertaken for measurement are generally elaborated below: Ø If the entire schedule development is completed on time. Ø If the schedule is entered successfully within the process evaluation procedure.		The steps that are undertaken for collecting data are listed below:  Interview procedure: Interview procedure is mainly utilized in order to analyze information related with data. Analysis: Proper analysis is undertaken in order to collect data about the schedule.		It is found that data collection is done after the schedule is developed successfully and the tasks are effectively assigned to the various responsible parties.

The steps that are generally undertaken in order to conduct impact evaluation for developing the hip prevention fracture program so that the morbidity, mortality and costs that are associated with the falls can be reduced. The strategies are generally elaborated in the table that is given below:

Objectives	Indicators of achievements / Success indicators	Methods for Measurements including details of data collection	When should data collection and analysis take place?
To decide whether to fund the intervention or not	The success or success indicators of the program in order to make sure whether to invest within the project or not are generally elaborated below: Ø It is analyzed that as the program is helpful in reducing morbidity, mortality as well as costs that are associated with the falls. Ø There will be reduction in the fractured necks of femur by 50% within 1 year.	The methods that are utilized in order to measure the methods are listed below: Ø The rate of morbidity, mortality as well as costs that are related with the fall gets reduced then it will generally act as method for measurement. Ø 50% reduction in the fractured necks of femur act as measurement method. The method of data collection method that are used are listed below:  Survey: Survey method is used in order to analyze the rate of reduction in falls. Interview: Interview method is also utilized for collecting data about the rate of reduction in morbidity, mortality and costs that are associated with the falls.	Data collection as well as analysis can generally take place after the success indicators about the program is successfully identified.
To learn steps about how to successfully adapt intervention	The steps that indicates that the intervention is successfully adapted are elaborated below: Ø Reduction in fall by 50% Ø Increment within the risk resident balance as well as strengths by 20% within a year. Ø The costs that are associated with the health care also gets reduced.	The steps that act as measurement methods are generally elaborated below: Ø Reduction in the rate of falls Ø Reduction in the health care costs by $500,000 Ø Minimization of chances of morbidity, mortality. The data collection method that are generally utilized in order to collect information include: Surveys: Surveys are considered as one of the significant methods that assists in collecting data about the reduction in the number of falls among the residents. This method is useful as it generally collects data from the people who faces issues in order to provide realistic analysis on the collected data.	The data are generally collected as well as analyzed after the intervention is successfully adapted.
To inform the communities about how the development of the program is helpful	The steps that indicates achievements are elaborated below: Ø People proper understood that organization of program will generally be helpful in reducing morbidity, mortality as well as costs that are associated with falls Ø People should get to know about the minimization in healthcare related cost.	The methods that helps in measuring the success of the steps are generally elaborated below: Ø Involvement of the people within the program in order to take the advantage of the program for reducing morbidity, mortality as well as costs associated with the fall. Ø They undergo within the program of training for ensuring that the program was undertaken quite successfully. The method of data collection that are generally utilized are generally elaborated below: Interview method: It is found that with the help of interview method proper information regarding the involvement of people within the program as well as impact of the program are generally elaborated.	The method of data analysis as well as data collection is generally undertaken after the communities are informed about the development of the program.

 The factors that may create impact on internal validity with explanation about controlling it are generally elaborated below:

Two types of evaluation

History: It generally helps in referring to the occurrence of the events which could helpful in altering the results as well as outcomes of the study. It is considered as one of the important factors for creating impact on the internal validity (Broman et al., 2017).

 It is found that the utilization of control group from the sample population that generally experiences same concurrent history can be helpful in eliminating the most of the effects which are related with history.

 Maturation: It is found that maturation is one of the significant factors that pertains to any type of changes which generally occurs within the study but are not considered within the part of the study and can create effect on the results.

It is found that the selection of control group will be helpful in reducing the impact of maturation from the studies.

 Testing: It is considered as one of significant factor that is related to the possible effects on the performance of the participants within a study (Boivin et al., 2014).

The utilization of research design which does not include pertest is helpful in eliminating the testing as well as potential threat that is mainly related to internal validity. Furthermore, if the baseline or data are generally required then it is necessary to utilize proper unobtrusive measures.

Mortality: It is one of the factors that is generally related with the loss of the subjects from the study because of initial non-availability or withdrawal from the subsequent studies.

Selection: It is one of the important factors that generally pertains with the possibility that is generally grouped in a study for possessing various characteristics as well as differences that generally may affect the results (Riley et al., 2015).

It is found that the selection of large groups in order to ensure that they are representative from which they are generally selected are helpful in minimizing the chances of mortality related threats. It is found that the utilization of proper procedures are also helpful in reducing mortality.

The factors that generally can create impact on the external validity with proper control measures are generally elaborated below:

Interaction effect of testing: It is found that pre-testing interacts with the various types of experimental treatments which generally can cause some effects due to the results which is generally not generalized into an untested population (Ybarra et al., 2014).

In order to resolve the impact, it is necessary to utilize research design that does not include pre-tests. In addition to this, Solomon for group design is considered to be very much useful in order to determine the extent to which the pertest can influence the entire results of the study.

Process Evaluation

Interaction effects of selection biases: It is one of the effects that occur due to some of the selection factor of intact groups for interacting with the experimental treatment that would not occur if the entire groups are properly selected.

It is necessary to use the selector factor properly for interacting with the experimental treatment in order to avoid the impact.

Reactive effects of experimental arrangements: An affect that is mainly occurred because of the fact that subjects must know that they are generally participating within an experiment for experiencing the novelty (Berendsen et al., 2015).

It is found that utilization of blind data collection method means that the researchers does not engaged within the collection data or makes proper observation. It is found that the person who generally collects information or data should be unaware of the purpose for resolving the effects.

Multiple treatment interference: It is found that when the same subjects are generally received with two or number of treatments in a repeated measures design then it can carry an over effect between number of treatments including the results which cannot be generalized into single treatments (Androutsos et al., 2014).

It is very much necessary for the researchers to select proper design in which only one treatment methodology must be assigned to one subject. It is found that if such type of design is practical then the research must try to control the effects of all the treatments in order to incorporate them into multiple treatment design.

 The risks that occur during process as well as impact evaluation with proper steps for addressing the issues and challenges are generally elaborated below:

Risks	Steps for addressing them
Improper determination of baseline: It is found that if proper baseline of process evaluation is not determined the data will not be able to reflect the present situation in the area of interest. This is because it helps in allowing the program staffs for creating appropriate as well as realistic vision of the various target indicators.	It is found that in order to resolve the issue it is very much necessary to determine the baseline of the process evaluation quite effectively so that proper as well as realistic vision of the target indicators can be achieved.
Inappropriate development of process evaluation indicators:  If the sample logic model is not used properly then it is quite difficult to develop the process evaluation indicators properly.	In order to resolve the issue, it is quite necessary to develop the logic model sample quite effectively so that the process evaluation indicators can be developed quite effectively.
Improper selection of evaluation approach: If the evaluation approach is not selected properly then it generally can cause problem in selection.	In order to resolve the issues, it is very much necessary to select proper evaluation approach for getting proper understanding about the biases that are generally generated.
Inappropriate data collection: If the data collection method is not appropriate then it can cause number of issues and challenges in collecting proper information related with the impact evaluation.	In order to resolve the issues and challenges, it is very much necessary to collect data properly so that the details regarding the impact evaluation can be properly gathered as well as analyzed.
Incorrect sample size: If the sample size that is needed within the evaluation is not selected properly then it can create number of problems in measuring the effect of a project, programme as well as policy.	It is found that for resolving the issues, it is very much necessary to select proper sample size for the impact evaluation for measuring the effect of the project that is generally undertaken.

The focus of the ongoing monitoring of the program annually are generally elaborated below:

Establishing foundation of monitoring: It is found that in order to monitor the internal control systems, the agencies or organizations need to establish proper foundation for proper monitoring (Ellard et al., 2014). This generally includes proper development of tone to emphasize the significance of internal controls as well as monitoring in order to establish the entire organizational structure that facilities the roles that are charged while monitoring by utilizing proper baseline understanding about the effectiveness of the internal controls.

Establishing as well as executing monitoring procedures: It is quite necessary to establish as well as execute the monitoring procedures for assessing the quality of he internal control of the system’s performance. It is found that management helps in monitoring the internal control system with the help of ongoing monitoring as well as separate evaluation. It is found that during each of the monitoring, it is necessary (Saunders et al., 2014). It is found that by utilizing the five components that are mainly related with the control system must be properly evaluated in order to determine the efficiency, effectiveness as well as applicability of the entire system. Monitoring efforts can be properly designed and executed by performing the entire tasks.

Impact Evaluation

Assessing as well as reporting the results:  It is necessary to asses the results of the monitoring properly. In addition to this, it is also necessary to report the results that are generally assessed with the help of the monitoring (Arends et al., 2014).

The type of indicators that are generally collected as well as the frequency of collection are generally elaborated below:

Quantitative indicators: The quantity can be considered as a pure number which is widely utilized within a development programs in order to provide proper clear measure about the things that can be compared numerically (Gertler et al., 2016). This helps in enabling the programs to properly compare the achievement as well as performance. In addition to this, it helps in allowing them to compare the statues at different time. It is found that the frequency of the quantitative frequency is monthly.

Qualitative indicators: Qualitative indicators are generally defined as the judgement as well as perception of the people on a particular subject including the confidence that is generally gained from acquiring the various types of computer related skills in order to enable proper employment related opportunities or having proper access to the internet for proper as well as better related marketing opportunities (Vedung, 2017). It is found that the qualitative indicators do not reflect the numeric measures rather they generally help in depicting the status of something that is much more qualitative.

Abdulkadiro?lu, A., Angrist, J. D., Narita, Y., & Pathak, P. A. (2017). Research design meets market design: Using centralized assignment for impact evaluation. Econometrica, 85(5), 1373-1432.

Androutsos, O., Apostolidou, E., Iotova, V., Socha, P., Birnbaum, J., Moreno, L., ... & ToyBox?study group. (2014). Process evaluation design and tools used in a kindergarten?based, family?involved intervention to prevent obesity in early childhood. The T oy B ox?study. Obesity reviews, 15, 74-80.

Arends, I., Bültmann, U., Nielsen, K., van Rhenen, W., de Boer, M. R., & van der Klink, J. J. (2014). Process evaluation of a problem solving intervention to prevent recurrent sickness absence in workers with common mental disorders. Social Science & Medicine, 100, 123-132.

Berendsen, B. A., Kremers, S. P., Savelberg, H. H., Schaper, N. C., & Hendriks, M. R. (2015). The implementation and sustainability of a combined lifestyle intervention in primary care: mixed method process evaluation. BMC family practice, 16(1), 37.

Boivin, A., Lehoux, P., Burgers, J., & Grol, R. (2014). What are the key ingredients for effective public involvement in health care improvement and policy decisions? A randomized trial process evaluation. The Milbank Quarterly, 92(2), 319-350.

Strategies

Bouwsma, E. V. A., Noordegraaf, A. V., Szlávik, Z., Brölmann, H. A. M., Emanuel, M. H., Lips, J. P., ... & Anema, J. R. (2014). Process evaluation of a multidisciplinary care program for patients undergoing gynaecological surgery. Journal of occupational rehabilitation, 24(3), 425-438.

Broman, K. K., Kensinger, C., Hart, H., Mathisen, J., & Kripalani, S. (2017). Closing the loop: a process evaluation of inpatient care team communication. BMJ Qual Saf, 26(1), 30-32.

Ellard, D. R., Thorogood, M., Underwood, M., Seale, C., & Taylor, S. J. (2014). Whole home exercise intervention for depression in older care home residents (the OPERA study): a process evaluation. BMC medicine, 12(1), 1.

Gertler, P. J., Martinez, S., Premand, P., Rawlings, L. B., & Vermeersch, C. M. (2016). Impact evaluation in practice. The World Bank.

Gunawan, F., Kurniawan, A., Gunawan, I., Ju, Y. H., Ayucitra, A., Soetaredjo, F. E., & Ismadji, S. (2014). Synthesis of biodiesel from vegetable oils wastewater sludge by in-situ subcritical methanol transesterification: Process evaluation and optimization. biomass and bioenergy, 69, 28-38.

Impact Evolution

Jennings, L., Bertrand, J., Rech, D., Harvey, S. A., Hatzold, K., Samkange, C. A., ... & Castor, D. (2014). Quality of voluntary medical male circumcision services during scale-up: a comparative process evaluation in Kenya, South Africa, Tanzania and Zimbabwe. PLoS One, 9(5), e79524.

Lechner, M. (2011). The estimation of causal effects by difference-in-difference methods. Foundations and Trends® in Econometrics, 4(3), 165-224.

Metzger, A., Leitner, P., Ivanovi?, D., Schmieders, E., Franklin, R., Carro, M., ... & Pohl, K. (2015). Comparing and combining predictive business process monitoring techniques. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 45(2), 276-290.

Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., ... & Baird, J. (2015). Process evaluation of complex interventions: Medical Research Council guidance. bmj, 350, h1258.

Moore, G., Audrey, S., Barker, M., Bond, L., Bonell, C., Cooper, C., ... & Wight, D. (2014). Process evaluation in complex public health intervention studies: the need for guidance.

Moore, G., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., ... & Baird, J. (2015). Process evaluation of complex interventions. Complex interventions in health: an overview of research methods, 222.

Morgan, P. J., Scott, H. A., Young, M. D., Plotnikoff, R. C., Collins, C. E., & Callister, R. (2014). Associations between program outcomes and adherence to social cognitive theory tasks: process evaluation of the SHED-IT community weight loss trial for men. International Journal of Behavioral Nutrition and Physical Activity, 11(1), 89.

Riley, N., Lubans, D. R., Morgan, P. J., & Young, M. (2015). Outcomes and process evaluation of a programme integrating physical activity into the primary school mathematics curriculum: The EASY Minds pilot randomised controlled trial. Journal of Science and Medicine in Sport, 18(6), 656-661.

Rogers, P. J. (2017). Implications of complicated and complex characteristics for key tasks in evaluation. In Evaluating the complex (pp. 45-64). Routledge.

Saunders, R. P., Wilcox, S., Baruth, M., & Dowda, M. (2014). Process evaluation methods, implementation fidelity results and relationship to physical activity and healthy eating in the Faith, Activity, and Nutrition (FAN) study. Evaluation and program planning, 43, 93-102.

Tapia, G., & Elwany, A. (2014). A review on process monitoring and control in metal-based additive manufacturing. Journal of Manufacturing Science and Engineering, 136(6), 060801.

Vedung, E. (2017). Public policy and program evaluation. Routledge.

Vivalt, E. (2015). Heterogeneous treatment effects in impact evaluation. American Economic Review, 105(5), 467-70.

Ybarra, M.L., Holtrop, J.S., Prescott, T.L. and Strong, D., 2014. Process evaluation of a mHealth program: Lessons learned from Stop My Smoking USA, a text messaging-based smoking cessation program for young adults. Patient education and counseling, 97(2), pp.239-243.

Yin, S., Wang, G., & Gao, H. (2016). Data-driven process monitoring based on modified orthogonal projections to latent structures. IEEE Transactions on Control Systems Technology, 24(4), 1480-1487.