Developmental Outcomes of Service Learning Pedagogies

Josh P. Armstrong, PhD, Director Comprehensive Leadership Program
Gonzaga University

Abstract

This study explored the psychosocial development outcomes of service learning from three distinct models: ongoing continuous service throughout a semester in co-curricular service learning; one time, intensive week-long spring break service learning trips; and ongoing service through a semester of academically-based service learning. A control group of students who had no involvement in service learning was used for comparative purposes. The Student Developmental Task and Lifestyle Assessment (SDTLA; Winston, Miller, & Cooper, 1999b) was administered to college students involved in each of the three types of service learning and the control group. This instrument was administered as a pre-test at the beginning of the academic semester, and then again at the end of the academic semester as a post-test to determine the developmental differences. The findings indicated that there were significant developmental differences among the three service learning pedagogies. In particular, the results suggested that, based on the SDTLA Developmental Tasks, the Spring Break service learning pedagogy had statistically significant psychosocial development gains. The implications for service learning practitioners include further understanding of the developmental outcomes of these service learning types are explored.

Introduction

During the past decade, there has been a marked increase in interest in the pedagogy of service learning. Many postsecondary educators have unitized service learning as part of their curriculum and co-curriculum. Much of the research conducted to date speaks to the degree to which service learning has a positive effect on students’ general personal and cognitive development (e.g., Eyler & Giles, 1999; Jacoby, 1996; Sax & Astin, 1997). However, relatively little is known about whether the various types of service learning are effective tools for developing students, and what the differences may be between these service learning pedagogies. These types of service learning pedagogies have needed further investigation in terms of outcomes for students (Campus Compact, 1998). Accordingly, this study examined the outcomes of service learning from three distinct models to determine their developmental impact on student participants.

For purposes of this study, service learning is defined as ‘a form of experiential education in which students engage in activities that address human and community needs together with structured opportunities intentionally designed to promote student learning and development. Reflection and reciprocity are key concepts of service learning’ (Jacoby, 1996, p.5). This study explored the outcomes of service learning from three distinct models: ongoing continuous service throughout a semester in co-curricular service learning; one time, intensive week-long spring break service learning trips; and ongoing service through a semester of academically-based service learning. A fourth control group of students was used for comparative purposes. This study investigated one particular student outcome, psychosocial development, among college students involved in three different types of service learning by administering the Student Developmental Task and Lifestyle Assessment (SDTLA; Winston, Miller, & Cooper, 1999b). This instrument was devised to measure students on several developmental vectors defined by Chickering and Reisser (1993). In particular, this study examined the Developing Autonomy Task and the Developing Mature Interpersonal Relationships Task, as well as the various subtasks that provide specific components of the larger developmental task. This instrument was given to participants as a pre-test at the beginning of the academic semester, and then again at the end of the academic semester as a post-test to determine the developmental differences gained.

This study explored the question: Do students involved in distinct types of service learning have different psychosocial development outcomes? The following hypothesis was tested in an attempt to answer the stated research question:

  • The ‘SDTLA difference scores’ of traditional college students will significantly differ across the three types of service learning. (‘SDTLA difference score’ is a derived score when a post-SDTLA score is subtracted from a pre-SDTLA score.)

This study employed a classic pre-test/post-test control group design to test the hypothesis whether psychosocial development, the dependent variable, was different among students who participate in co-curricular service learning, academically-based service learning and service learning spring break trips, the independent variables.

(Editor’s Note: All service learning is, or should be, academically-based, otherwise it is simply ‘service’ or ‘volunteer’ work. A spring break service learning experience is not necessarily ‘non-academic’, but it is not held in a traditional classroom setting.)

Study Population and Sample

The population for this study comprised currently enrolled, traditional-age, full-time, degree-seeking students at a private, liberal arts college located in the Midwest. The population was selected using a stratified random sample selection design. The students asked to join this study were already participating in three distinct service learning pedagogies. One group of sixty students who were involved in academically-based service learning was invited to participate in this study. These students were involved in a service learning project connected to their course content. Another group of sixty students involved in co-curricular service learning facilitated through the college’s service learning office was invited to participate. These students were involved in continuous service learning projects throughout the semester at locations such as thrift stores, after-school programs, and homeless shelters. The third group of students was involved in the college’s service learning alternative spring break trips. These sixty students invited to participate traveled during the college spring vacation to a location to serve for a week. A final group of sixty students who were not involved in service learning was chosen at random from the college student population to serve as a baseline group.

In total, four distinct groups of 60 students representing a sample size of 240 participants were invited to participate in this study. Students who completed the first pre-test SDTLA represented 82% of the sample (164 subjects). Of the 164 subjects who completed the pre-test, 112 chose to continue participation in the study by completing the post-test SDLTA. This represented 68% of the pre-test sample group and 47% of the original sample invited to participate in this study.

Statistical Methods

Descriptive and inferential statistics were calculated for the independent variable in this study, service learning type, which was operationalized into three fixed categories, and a fourth baseline control group and for the eight dependent variables, which were the tasks and subtasks of the Student Developmental Task and Lifestyle Assessment (SDTLA; Winston, Miller & Cooper, 1999b). Mean, standard deviation, multiple t tests, an analysis of variance (ANOVA), a multivariate analysis of variance (MANOVA), and Tukey HSD method were used to report the results of the research question.

Findings and Implications

Based on the findings of this study, there is a significant difference in the psychosocial development outcomes between the three service learning pedagogies. In particular, the results show that, based on the SDTLA Developmental Tasks, the spring break service learning pedagogy has the most statistically significant developmental differences. The implications of these findings will be explored further.

The research question asked whether students involved in distinct types of service learning had different psychosocial development outcomes. In order to answer this question, the hypothesis that was tested was whether the ‘SDTLA difference scores’ of traditional college students significantly differed across the three types of service learning. The SDTLA difference score is a score calculated when the raw post-SDTLA score is subtracted from the raw pre-SDTLA score. As shown in Table 1, there appears to be only small differences between the means of the four groups, with exception of the spring break service learning group.

Table 1
Mean and Standard Deviations for
Developing Autonomy and Developing Mature
Interpersonal Relationships Tasks

 

Autonomy

Relationships

N

Control/Baseline

.8584 (4.01)

2.6400 (4.89)

25

Co-curricular SL

-.7767 (3.49)

2.5643 (5.61)

25

Academic SL

.3785 (8.04)

3.6917 (6.67)

31

Spring Break SL

3.6054 (4.99)

4.2707 (4.10)

31

An analysis of variance (ANOVA) was conducted to determine the differences between the four independent variables, three service learning pedagogies and control group, and the SDTLA developmental tasks. The post-hoc procedure employed the Tukey HSD method to investigate the differences within the Developing Autonomy task. The Tukey HSD provides a value that allows the researcher to make comparisons of means after a significant F-value has been observed in an ANOVA. The significant comparison between the spring break service learning group and the Co-curricular Service Learning group is presented in Table 2. The Tukey method showed a statistically significant difference in developing autonomy for students who engaged in the Spring Break Service Learning pedagogy when compared to students who participated in the Co-curricular Service Learning pedagogy. The students involved in Spring Break Service Learning had significantly more development on this SDTLA Task than those involved in Co-curricular service learning.

Table 2
Post-hoc Tukey Results for Developing Autonomy Task

Type

Mean Difference

Std. Error

Sig.

Spring Break Service Learning

Control

2.7469

1.50187

.265

Academic SL

3.2269

1.41913

.111

Co-curricular SL

4.3820*

1.50187

.022

*Significance at the .05 level

While a statistically significant difference was found between the spring break service learning group and the co-curricular service learning group on the Developing Autonomy Task, it seems clear from the mean scores that the difference was due to a strong difference score from the spring break service learning group, rather than a lack of development from the Co-curricular Service Learning group. The students involved in Spring Break Service Learning had significantly more development on this SDTLA Task than those involved in Co-curricular Service Learning.

Discussion

The findings of this study provide some utility for service learning practitioners. Some reasons for the strong difference scores for the SDTLA Tasks by the Spring Break Service Learning type as compared to the other service learning types will be briefly explored. In addition, a brief examination will be presented into the possible reasons the academically-based service learning pedagogy was found to yield the least psychosocial development differences.

Spring Break Service Learning:

First, the importance of providing quality alternative spring break opportunities from service learning offices has been affirmed. The psychosocial development differences for students involved in the spring break service learning trips were greatest when compared to the two other service learning types and the control group. One reason for this difference may be due to the immersion experience of this type of service learning, and the personal and community development aspects of these trips. The power of immersion experiences in service learning was documented by Pompa (2002) who found these educational experiences provide learning dimensions that are difficult to achieve in a tradition classroom. Pompa (2002) writes, ‘different from the idea of service learning as a ‘feel good’ experience, which can be transient and ephemeral, what we are talking about here involves depth, direction, hard work, and a commitment to make change in the world’ (p. 74). Immersion experiences in service learning, such as spring break trips, have the power to turn things upside-down for those engaged in them. It provokes one to think differently about the world, and to consider one’s relationship to the world in a new way (Rhoads, 1997).

Therefore, professionals working in service learning offices should provide opportunities for students to organize alternative spring break projects. Currently, of the Campus Compact member schools, 60% of the service learning offices offer spring break service learning trips as an option (Campus Compact, 2003).

The investment in planning these trips, building community on these trips, and serving with fellow students and community partners during these trips to unfamiliar parts of the country have provided student leaders with important learning and development. Most spring break service learning trips are advised by service learning professionals, but planned by student leaders. This involvement in the design and facilitation of the service learning experience has a powerful effect on student leaders (Astin, 1985). This student empowerment element is unique to spring break service learning, and may account for some of the developmental differences. In planning for spring break service learning trips, students and staff should intentionally facilitate the development of community for those going on the trip. The community that is built during these experiences should be intentionally developed, not just left to chance. This will foster an environment that will accelerate the psychosocial development for those involved.

In Rhoads and Neururer’s (1998) qualitative study of an alternative spring break program, the service learning experience provides some concrete examples of this unique learning opportunity. The intensity of spending a week immersed in a service learning experience can offer a better understanding of self and community for the students involved (Rhoads & Neururer, 1998). While the service interactions at the work site are not as prolonged as the semester-long service performed by the co-curricular or academic service learning groups, the spring break service learning experience offers students an opportunity to ‘truly live’ the service experience 24 hours a day, for seven days. This immersion seems to influence the learning and development of students. It also seems that the sense of community and relationships developed within the service learning group can have profound learning outcomes. One student in Rhoads and Neururer’s (1998) study states that, ‘we really have a community within our group. We’re from really diverse backgrounds yet everybody really got along’ (p. 111). It seems that students learned through the environment they were serving, through both the college group and the people they were assisting. This mutuality, the willingness to receive as well as give, becomes an important aspect of the spring break service learning experience.

The findings of this study provide some legitimacy to the spring break service learning pedagogy. There have been some reservations about affirming this pedagogy by professionals because some students tend to view service learning work as traveling to a destination to ‘save the poor people.’ Some professionals and researchers have questioned whether the money used to send students great distances to participate in spring break service learning could be used more effectively for the community by simply sending them the money (Van Engen, 2000). An example of this perspective is articulated by a community partner in Honduras who wrote, ‘the spring break group spent their time and money painting and cleaning the orphanage in Honduras. That money could have paid two Honduran painters who desperately needed the work, with enough left over to hire four new teachers, build a new dormitory, and provide each child with new clothes’ (Van Engen, 2000, p. 21). Others acknowledge that students have various motivations for serving including guilt, curiosity about different cultures, or peer pressure.

With the strength of this type of service learning affirmed in this study, it is important to return to Rhoads and Neururer’s (1998) concept of mutuality, the willingness to receive as well as to give. They write, ‘students bring multiple agendas and experiences with their enthusiasm to volunteer. Staff members need to be sensitive to the experiences that shape students’ interest in and commitment to service’ (p. 115). Students should be encouraged to reflect on what they are receiving in this experience of serving others. For some service learning professionals, the spring break service learning pedagogy may be seen as the ‘least serious learning experience’ of the three types. However, as this study affirms, there are valuable developmental opportunities in this type of service learning, if it is viewed as more than just ‘fun and games.’

This study also supports the important role that spring break service learning plays in developing autonomy in students. The Developing Autonomy Task represents students who are able to meet their needs and action on their own ideas without the need for continuous reassurance from others; who recognize the reciprocal nature of the relationships between themselves and their community, and who act as a responsible, contributing member. This is an important area of learning for students in postsecondary education, and should be intentionally utilized in the student life professionals’ quest to foster student learning.

Given the previous studies of spring break service learning, this researcher would have expected to see stronger significant differences on the Developing Mature Interpersonal Relationships Task for this type of service learning. This may be due to a small sample size or other factors. The pre-test score for the Peer Relationships subtask was strong (x = 50.30) and did not show significant differences after the post-test on this subtask. One explanation of this could be that the participants who chose to be involved in spring break service learning already possess strong relational skills.

Academically-Based Service Learning:

While academically-based service learning provided some difference scores that were higher than the control group, none were found to be statistically significant. In addition, as compared to the other two service learning methods, academically-based service learning was found to yield the least psychosocial development differences. While this seems contrary to some of the service learning literature, (Astin & Sax, 1998; Markus, Howard & King, 1993; Strage, 2000; Vogelgesang & Astin, 2000), this researcher believes there are some legitimate concerns in regards to the effectiveness of academically-based service learning. These concerns and the possible reasons for the lack of psychosocial developmental differences for those participating in academically-based service learning in this study will now be addressed.

First, some faculty are misinformed about the true nature of academically-based service learning. Inserting a community service requirement onto an otherwise unchanged academic course does not constitute academically-based service learning. While such models are practiced, this interpretation marginalizes the student learning and presents challenges for transforming students’ community experiences into learning. Moving students and the practice of service learning beyond ‘getting credit for doing good,’ requires treating service learning as more than a casual addition to a course. Merely giving credit for a few hours of service, even in conjunction with having students keep a log or journal of their service learning activities, does not lead to broader connections and academic learning. Community service must be considered in the context of, and integrated with, the other planned learning strategies and resources in the course to realize service learning’s full potential as pedagogy (Howard, 2000).

Second, the models given to faculty for constructing academically-based service learning do not take into account the importance of facilitating student development outcomes. For example, one influential model for academically-based service learning offers three criteria as the litmus test for whether a course may be considered service learning by faculty (Howard, 2001). These criteria are: (1) relevant and meaningful service with the community, (2) enhanced academic learning, and (3) purposeful civic learning. The following Venn diagram is given as a model for constructing academic service learning.

Figure 1: Academic Service Learning (Howard, 2001)


All three criteria are necessary for a course to qualify as academic service learning, according to this model. However, this model creates no space for psychosocial or student development outcomes in the service learning process. In fact, according to a course design workbook published by Campus Compact, ‘it is important to note that while service learning courses may have other learning objectives and/or outcomes, such as in the social or affective domains, these are not necessary conditions for academic service learning’ (Howard, 2001, p.13). After performing a search of exemplary syllabi of service learning courses gathered by Campus Compact through a national research study, only twelve of the over one hundred courses mention student development outcomes in the course objectives. With this focus on academic learning objectives, meaningful service, and civic learning, there is an absence of recognition of the importance of student development outcomes. As faculty construct academically-based service learning courses without this awareness, it should come as no surprise that students are not coming away with these psychosocial development outcomes.

Third, the role of community in creating learning experiences should be considered in regards to academically-based service learning. The experience of participating in service and reflecting on this service in the context of a community has provided some powerful learning experiences for students (Eyler & Giles, 1999). This sense of community is more difficult to construct in a classroom setting, especially when compared to the immersion experience of the spring break service learning experience.

Finally, it is the belief of this researcher that student life professionals bear responsibility for the inefficiencies in constructing service learning experiences that further psychosocial development in the academically-based service learning pedagogy. In an effort to construct partnerships between the learning inside and outside the classroom, student life professionals have not advocated for student development objectives within academically-based service learning. The findings and recommendations from this study should embolden student life professionals in the service learning field to advocate for student development outcomes in all forms of service learning. This study affirms other previous research that found performing service as part of a course adds significantly to the benefits associated with community service for all outcomes except interpersonal skills, self-efficacy, and leadership (Astin et al., 2000). This study’s emphasis on researching the psychosocial development of students may not have assessed the true value of academically-based service learning to the academy. The researcher believes the outcomes of academically-based service learning could be enhanced if service learning professionals provided further training for faculty about the importance of reflection, reciprocity and mutuality within the service learning experience. I believe the full potential of this service learning experience could be realized.

With these recommendations in mind, it is the belief of this researcher that academically-based service learning is an important pedagogy in the area of service learning. When done thoughtfully, it provides a much-needed connection of student learning between student life professionals and faculty. The academically-based service learning pedagogy holds great opportunity to collaborate between faculty and student affairs professionals in postsecondary education.

References

       Astin, A. W. (1985). Achieving educational excellence: A critical assessment of priorities and practice in higher education. San Francisco: Jossey-Bass.

       Astin, A.W., & Sax, L. J. (1998). How undergraduates are affected by service participation. Journal of College Student Development 39 (3), 251-263.

       Astin, A. W., Vogelgesang, L. J., Ikeda, E. K., & Yee, J. A. (2000). How service learning affects students. UCLA Higher Education Research Institute: Los Angeles.

       Bringle, R. G., & Hatcher, J. A. (2000a). Institutionalization of service learning in higher education. Journal of Higher Education, 71(3), 273-290.

       Campus Compact. (1998). Special report: Advancing our knowledge of the impacts of service learning. Providence, RI: Author.

       Campus Compact. (2003). Service statistics: Highlights of Campus Compacts’s annual membership survey. Providence, RI: Author.

       Chickering, A. W., & Reisser, L. (1993). Education and identity. (2nd ed). San Francisco: Jossey-Bass.

       Eyler, J. & Giles, D. E. (1999). Where’s the learning in service learning? San Francisco: Jossey-Bass.

       Howard, J. (2000). Academic service learning: Myths, challenges and recommendations. Essays on Teaching Excellence, 12 (3) 12-19.

       Howard, J. (2001). Service learning course design workbook. Ann Arbor, MI: OCSL Press.

       Jacoby, B. A., & Associates (1996). Service learning in higher education: Concepts and practices. San Francisco: Jossey-Bass.

       Markus, G. B., Howard, J., & King, D. (1993). Integrating community service and classroom instruction enhances learning: Results from an experiment. Educational Evaluation and Policy Analysis 15(4), 410-419.

       Pompa, L. (2002). Service learning as crucible: Reflections on immersion, context, power, and transformation. Michigan Journal of Community Service Learning, 9, 67-76.

       Rhoads, R. A. (1997). Community Service and Higher Learning: Explorations of the Caring Self. New York: University of New York Press.

       Rhoads, R. A. & Neururer, J. (1998). Alternative spring break: Learning through community service. NASPA Journal, 35(2), 100-118.

       Sax, L. J. & Astin, A. W. (1997). The benefits of service: Evidence from undergraduates. Educational Record. Summer-Fall, 25-33.

       Strage, A. (2000). Service learning: Enhancing student learning outcomes in a college level lecture course. Michigan Journal of Community Service Learning, 7, 5-13.

       Van Engen, J. (2000). The cost of short term missions. The Other Side, 1, 20-23.

       Vogelgesang, L. J., and Astin, A. W. (2000). Comparing the effects of service learning and community service. Michigan Journal of Community Service Learning, 7, 25-34.

       Winston, R. B. Jr., Miller, T. K., & Cooper, D. L. (1999b). Student Developmental Task and Lifestyle Assessment Manual. Athens, GA: Student Development Associates Inc.

About the Author:

Dr. Josh Armstrong is the Director of the Comprehensive Leadership Program and a faculty member for leadership studies with undergraduate students at Gonzaga University in Spokane, Washington. He holds a Ph.D. in education from Michigan State University, a master’s degree in higher education and student affairs from the University of Vermont, and an undergraduate degree in psychology from Whitworth College. Dr. Armstrong’s research interests include service learning, servant leadership, experiential education and transformational learning. In addition to teaching, Dr. Armstrong provides leadership training for student leaders at Gonzaga. Josh serves on the Board of Directors for Habitat for Humanity-Spokane. You can reach Dr. Armstrong at 502 E. Boone Ave, Spokane, WA 99258, or at armstrongj@gonzaga.edu, or 509/323-6493.

Community College National Center for Community Engagement (CCNCCE) sunsetted October 1, 2015. Mesa Community College hosts content from The Journal for Civic Commitment, published by the CCNCCE, to ensure it remains publicly available.

The important work of the CCNCCE was made possible through the financial support from many civic-minded foundations and organizations, including the Corporation for National and Community Service’s Learn and Serve America-Higher Education program, the Kettering Foundation, Campus Compact (through funding from the Bill and Melinda Gates Foundation), Arizona Community Foundation, Arizona Foundation for Women, Freeport McMoRan Copper and Gold Foundation, and The Teagle Foundation.