Using Evidence to Frame Problems of Practice
Keywords:problem of practice, evidence, framing, root cause analysis
Improvement initiatives crafted based on well-understood problems of practice often stand the greatest chance of leading to sustainable educational improvements. Framing problems of practice using multiple modes of evidence is advisable to fully understand the system of root causes of the problem and its stakeholders. In this study, we used the document analysis method to investigate the types of evidence (e.g., literature, anecdotal, secondary data) that students used to frame problems of practice in EdD dissertations in practice within CPED consortium member institutions (N=53). Results suggest that students predominantly use literature to frame problems of practice with fewer using primary and secondary data.
*References marked with an asterisk indicate studies included in the meta-analysis.
*Alencastro, M. (2015). E Ho ‘oulu ‘la nᾱ kumu mauli ola hawai’i: Preparing Hawaiian cultural identity teachers. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/makalapua_ alencastre-alenc.pdf
*Altman, M. R., & Pizano, A. C. (2016). Quality in early care and education: Multiple perspectives and critical considerations for professional development in a diverse context. Retrieved from https://search-proquest-com.zeus.tarleton.edu/docview/1847567976/A6F3783D431F442APQ/1?accountid=7078
Archbald, D. (2014). The GAPPSI method: Problem-solving, planning and communicating. NCPEA Publishing.
Arendt, H. (1951). The origins of totalitarianism. New York: Houghton Mifflin Harcourt Publishing.
*Azziz, R. (2017). The nature of bias and its impact on disparate outcomes. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/azziz_full_dip.pdf
*Baete, G., Burks, J., & Pollio, M. (2012). Bringing urban high school reform to scale: Rapidly moving dramatic numbers of student to proficient performance. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/louisville_burks_baete_polli.pdf
Belzer, A., & Ryan, S. (2013). Defining the problem of practice dissertation: Where’s the practice, what’s the problem?. Planning and Changing, 44(3/4), 195-207.
*Benedict, C. M. (2014). Professional learning community: Increasing efficacy for student success. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/benedict.pdf
*Boeding, B. (2017). Supporting the camouflaged in transition: Serving student veterans with disabilities. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/boeding_full_dip.pdf
Booth, W. C., Colomb, G. G., Williams, J. M., Bizup, J., & Fitzgerald, W. (2016). The craft of research (4th ed.). Chicago, IL: The University of Chicago Press.
Bowen, G. A. (2009). Document analysis as a qualitative research methods. Qualitative Research Journal, 9(2), 27-40.
*Brown, R. (2013). Equity for students of color through practitioner accountability. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/brown.pdf
Bryk, A. S., Gomez, L. M., Grunow, A., & LeMahieu, P. G. (2015). Learning to improve: How America’s schools can get better at getting better. Cambridge, MA: Harvard Education Press.
*Burke, A. (2012). From policy to practice: Implementing “move on when ready” at the local level in Arizona. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/burke_dip.pdf
*Burt, T. D. (2014). From mission to measurement: Advancing postsecondary academic advising assessment and practice through evaluating program theory and outcomes. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/burt.pdf
*Canelake, C. (2012). Implementing a standards-based teacher evaluation system: Learning experiences for administrators in an urban school district. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/canelake_dip.pdf
Carnegie Project on the Education Doctorate. (n.d.-a) About CPED. Retrieved from https://www.cpedinitiative.org/page/AboutUs
Carnegie Project on the Education Doctorate. (n.d.-b). Database of Dissertations in Practice from CPED-Influenced EdD Programs. Retrieved from http://cpedinitiative.org/resource-library/dissertations
Carnegie Project on the Education Doctorate. (n.d.-c). CPED framework. Retrieved from https://cdn.ymaws.com/www.cpedinitiative.org/resource/resmgr/images/general_images/cped_infographic_5.png
*Cato, M. (2013). Nursing students anxiety in simulation settings: A mixed methods study. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/cato.pdf
*Chalkley, J., Lyles, T., & Stacy, J. (2012). Statewide communities of practice for excellence: A statewide program evaluation. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/vcu_stacy.chalkley.lyles.pdf
*Cicchino, M. (2014). Using game-based learning to foster critical thinking in student discourse. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/cicchino.pdf
*Claravall, E. B. (2014). Creating and sustaining classroom knowledge through teacher research: Morphology as design intervention for struggling learners. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/claravall.pdf
*Conlon, S., Gallagher, T., & Hooper, S. (2012). The unrealized constructs of school reform. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/louisville_gallagher.conlon.pdf
*Cooper, D. W. (2014). Exploring embedded remediation for community college career technical education pathways: Promising practices. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/cooper.pdf
Copland, M. A. (2000). Problem-based learning and prospective principals’ problem-framing ability. Educational Administration Quarterly, 36(4), 585-607.
*Creasia, C. R. (2014). The dynamics of instructional leadership & organizational structure in high performing urban schools. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/creasia.pdf
*Diaz, C. S., Strang, M. L., Unger, A. L., & Van’t Hof, S. G. (2017). Utilizing the design thinking process to aid educators in their response to childhood lead exposure. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/diaz_strang_unger_and_vant.pdf
*Eckerson, J. (2016). Teacher perspective on professional development needs for better serving Nebraska’s Spanish heritage language learners, Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/eckerson_dissertation.pdf
Gillham, J. C., Williams, N. V., Rife, G., & Parker, K. K. (2019). Problems of practice: A document analysis of education doctorate dissertations. Impacting Education: Journal on Transforming Professional Practice, 4(1), 1-9.
*Gonzalez, A. (2014). Using funds of knowledge to build trust between a teacher and parents of language-delayed preschoolers. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/quintero_gonzalez.pdf
*Guan, Y. (2014). The effects of explicit listening strategy instruction on the listening comprehension of English as a second language (ESL) community college students. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/guan.pdf
*Hall, R. A. (2014). Challenges on the road to school success for low socioeconomic and minority student: Dropout prevention and parent involvement. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/hall.pdf
*Hanchi, N. M. (2013). A study of the implementation of the Ed.D. in educational leadership at the University of Central Florida 2010-2013: A profession. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/marsh.pdf
*Hendron, J., Tolliver, S., Kim, A., & Deloatch, D. (2014). Ubiquitous computing in schools: A multi-case study of 1:1 districts. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/hendron_et_ al.pdf
*Henriquez, A. (2013). “I hope to be a symbol of encouragement”: Using craft in community colleges to facilitate student voice in the remedial studies debate. Retrieved from https://www.cpedinitiative.org/page/DiPDatabase [link changed after data collection and was not retrievable].
*Jaggers, A., & Royster, P. (2012). Putting time on your side: A system for getting all students on a college ready trajectory. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/louisville_royster.jaggers.pdf
*Jakubik, T. L. (2014). Graphic novels and the common core. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/jakubik.pdf
Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational Technology Research and Development, 48(4), 63-85.
*Kirchner, J. (2014). Student experiences of the community college developmental writing classroom. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/kirchner.pdf
*Kline, N. C. (2014). The nature and degree of the relationship between chronic absenteeism and student achievement in a large metropolitan school district in Florida. Retrieved from https://search-proquest-com.zeus.tarleton.edu/docview/1860239472/F52238B2E5F247D8PQ/1?accountid=7078
*Kobett, B. M. (2016). A university-led beginning teacher mathematics community. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/kobett_dissertation.pdf
*Larson, J. L. (2013). Secondary mathematics teachers’ literacy professional learning: An amalgamation of adolescent literacy, mathematics teaching and adult learning. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/larson.pdf
Lewis, C. (2015). What is improvement science? Do we need it in education? Educational Researcher, 44(1), 54-61. Retrieved from https://www.emmausseries2.org/uploads/2/0/5/2/20520752/lewis_2015.pdf
*Louis, T. (2014). Design and implementation plan for the “I am potential” financial literacy education program. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/louis.pdf
Ma, V. W., Dana, N. F., Adams, A., & Kennedy, B. L. (2018). Understanding the problem of practice: An analysis of professional practice EdD dissertations. Impacting Education: Journal on Transforming Professional Practice, 3, 13-22.
*Mataczynski, L. (2013). Advising and acculturation variables as predictors or sanctification, sense of belongings, and persistence among international undergraduates. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/mataczynski.pdf
*Maltby, B., Richardson, D., Koontz, J., & Bhagat, R. (2014). A regional approach to school diversity: The possibility, feasibility, and desirability. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/maltby_et_al.pdf
Mintrop, R. (2016). Design-based school improvement: A practical guide for education leaders. Cambridge, MA: Harvard Education Press.
*Morrison, C. (2015). Co-constructing college-going capital in a rural high school English class. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/carissa_morrison-morrison.pdf
*Mostofo, J. (2013). Using lesson study with preservice secondary mathematics teachers: Effects on instruction, planning and efficacy to teach mathematics. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/mostofo.pdf
*Muser, H. (2017). A parent’s dream come true: A study of adult students who are parents and their academic engagement in high education. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/muser_full_dip.pdf
*Olsen, B. D. (2016). Preservice and practicing teacher science inquiry projects: An analysis of their understanding of the inquiry process. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/olsen.benjamin_fulldip.pdf
Oxford Languages. (n.d.) Retrieved from https://en.oxforddictionaries.com/word-of-the-year/word-of-the-year-2016
*Palmer, R. (2014). Exploring online community among rural medical education students: A case study. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/cped_award_presentation.pdf
*Paredes, M. C. (2012). Parent involvement as an instructional strategy: Academic parent-teacher teams. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/paredes.pdf
*Patel, A. (2014). An evaluation study of Ravenswood’s youth transitioning to and through high school. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/patel.pdf
Perry, J. A. (2013). Carnegie project on the education doctorate: The education doctorate-degree for our time. Planning and Changing, 44(3/4), 113-126. Retrieved from https://www.researchgate.net/publication/272148530_The_Education_Doctorate-_A_degree_for_our_times
Perry, J. A., & Imig, D. G. (2016). What do we mean by impact? Impacting Education, 1. Retrieved from https://impactinged.pitt.edu/ojs/index.php/ImpactingEd/article/view/26/12
*Philadelphia, M. (2013). Will schoolbased online faculty development be an effective tool for their professional growth. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/philadelphia.pdf
*Rivera, N. (2013). Cooperative learning in a community college setting: Developmental coursework in mathematics. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/rivera.pdf
*Riva, S. (2013). Deconstructing persistence in academic language among second-generation Latinos: How do second-generation Latino language minority community students alter their academic trajectories. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/de_la_riva.pdf
Rohanna, K. (2017). Breaking the “adopt, attack, abandon” cycle: A case for improvement science in K-12 education. In C.A. Christie, M. Inkelas, & S. Lemire (Eds.), Improvement Science in Evaluation: Methods and Uses. New Directions for Evaluation, 153, 65-77. https://doi.org/10.1002/ev.20233
*Rose, D. (2013). Enrollment decisions of the underrepresented: Recruiting and college choice at military institutions. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/rose.pdf
*Ruggles, T. (2012). Masters level graduate student writing groups: Exploring academic identity. Retrieved from https://search-proquest-com.zeus.tarleton.edu/docview/1010624372/2865932CF61B44D4PQ/1?accountid=7078
Schön, D. (1983). The reflective practitioner. New York: Basic Books.
Schön, D. A., & Rein, M. (1995). Frame reflection: Toward the resolution of intractable policy controversies. New York: Basic Books.
*Schwarting, J. (2014). Influencing social capital in times of change: A three pronged approach to instructional coaching at the middle school level. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/schwarting.pdf
*Spilde, A. (2013). Mathematics in a second grade classroom: The effects of cognitively guided problem solving. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/spilde.pdf
Storey, V. A., Caskey, M. M., Hesbol, K. A., Marshall, J. E., & Maughan, B. D. (2015). Examining EdD dissertations in practice: The Carnegie Project on the Education Doctorate. International HETL Review, 5(2).
Timperley, H. S., & Robinson, V. M. J. (1998). Collegiality in schools: Its nature and implications for problem solving. Educational Administration Quarterly, 34, 608-629.
*Veith, V. (2013). Algebra for all and its relationship to English language learner’s opportunity-to-learn. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/veith.pdf
*Walker, A. (2017). Transformative school leadership: A qualitative examination of school leaders’ sensemaking of lived racial experiences and racial inequities in education. Retrieved from https://cdn.ymaws.com/www.cpedinitiative.org/resource/resmgr/docs/DiPs/Walker_Full_DiP.pdf
*Walker, J. (2016). Brain-targeted early childhood beginnings: A case study in India brain-targeted early childhood beginnings: a case study in India. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/cped_jimmie_walker_dissertat.pdf
*Wallace, W. (2013). California accountability policy and intensification: A quantitative study of teachers’ perceptions. Retrieved from https://search-proquest-com.zeus.tarleton.edu/docview/1015179413/DAE44916583E49E2PQ/1?accountid=7078
*Yavuz, O. (2014). Improving college readiness, pursuit, access, and persistence of disadvantaged students. Retrieved from https://www.cpedinitiative.org/assets/resource-center/docs/yavuz.pdf
How to Cite
Authors who publish with this journal agree to the following terms:
- The Author retains copyright in the Work, where the term “Work” shall include all digital objects that may result in subsequent electronic publication or distribution.
- Upon acceptance of the Work, the author shall grant to the Publisher the right of first publication of the Work.
- The Author shall grant to the Publisher and its agents the nonexclusive perpetual right and license to publish, archive, and make accessible the Work in whole or in part in all forms of media now or hereafter known under a Creative Commons Attribution 4.0 International License or its equivalent, which, for the avoidance of doubt, allows others to copy, distribute, and transmit the Work under the following conditions:
- Attribution—other users must attribute the Work in the manner specified by the author as indicated on the journal Web site;
- The Author is able to enter into separate, additional contractual arrangements for the nonexclusive distribution of the journal's published version of the Work (e.g., post it to an institutional repository or publish it in a book), as long as there is provided in the document an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post online a prepublication manuscript (but not the Publisher’s final formatted PDF version of the Work) in institutional repositories or on their Websites prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work. Any such posting made before acceptance and publication of the Work shall be updated upon publication to include a reference to the Publisher-assigned DOI (Digital Object Identifier) and a link to the online abstract for the final published Work in the Journal.
- Upon Publisher’s request, the Author agrees to furnish promptly to Publisher, at the Author’s own expense, written evidence of the permissions, licenses, and consents for use of third-party material included within the Work, except as determined by Publisher to be covered by the principles of Fair Use.
- The Author represents and warrants that:
- the Work is the Author’s original work;
- the Author has not transferred, and will not transfer, exclusive rights in the Work to any third party;
- the Work is not pending review or under consideration by another publisher;
- the Work has not previously been published;
- the Work contains no misrepresentation or infringement of the Work or property of other authors or third parties; and
- the Work contains no libel, invasion of privacy, or other unlawful matter.
- The Author agrees to indemnify and hold Publisher harmless from Author’s breach of the representations and warranties contained in Paragraph 6 above, as well as any claim or proceeding relating to Publisher’s use and publication of any content contained in the Work, including third-party content.
Revised 7/16/2018. Revision Description: Removed outdated link.