Assessment Spotlight

 

fall 2021

Heather Nelson, Logistics Management Program Chair

 

 

 

Logistics Management

Overview:

Heather Nelson, Logistics Management (LGM) Program Chair at the Ozark campus, is improving her student’ achievement in obtaining industry credentials through assessment. The Certified Logistics Technician (CLT)® certification process was incorporated into the LGM capstone course in 2018. After four years of offering the exam, data analysis revealed lower than ideal results. Ms. Nelson’s two-pronged approach to improve outcomes has resulted in a course rewrite and a shift in program timing of the credentialing exam. The results are highly anticipated - read on for the whole story…

Assessment Process:

Program Learning Outcome (PLO) assessed:

Demonstrate the ability to perform demand management to improve efficiency, perform inventory control measures, and optimize warehouse layouts.

Description of Measure:

LGM program learning outcomes are supported by the Certified Logistics Technician (CLT) ® certification program which “recognize(s) through certification, individuals who demonstrate mastery of the core competencies of material handling at the front-line (entry-level to front-line supervisor) through successful completion of the certification assessments.” The goal of incorporating this certification in the capstone course, LGM 2083 Operations Management, was to assess if the curriculum is in line with industry expectations. This certification was chosen due to the direct correlation with the LGM program learning outcomes and more importantly that the industry recognizes this credential, including Walmart using it for training front line workers. The CLT® certification program is also utilized by many other renowned employers including Amazon, Anderson Corporation, and Caterpillar.

Description of Expectations/Target:

The LGM program is offered in 100% online delivery. Students must pass the Foundational-level Certified Logistics Associate (CLA) Certificate exam to qualify to sit for the CLT certification exam. Students are not fully certified until they pass the CLT exam. Both exams have been given to students in the capstone course since 2018 and must be taken at an MSSC-approved proctor site. Prior to 2020, students took the exam in person at the Ozark campus. Since 2020, all students test online via ProctorU, which better aligns with the fully online program delivery.

Expectation of Target:

75% of students in the class will obtain CLT certification.

Findings/Results:

Review of the exams’ scores for four assessment cycles shows a lower than ideal passing rate for the CLT certification (2018: 0%, 2019: 17%, 2020: 80%, 2021: 42%). The chart below shows passing rates for the CLA and CLT exams.

CLT Certification Exam Results Chart

Reflection on Findings:

Year over year, efforts have been made to improve passing rates including recommending students review course materials of select courses in the program and reorganizing and updating content of the CLT study guide. These changes were prompted by a survey item included as part of student’s final assignment for the spring 2019 and 2020 capstone course. The assignment stated, “Include in your Word document what you felt was the most difficult part of the exams, what material you felt you were NOT prepared for, and any recommendations for improvement in preparation/testing site/etc.” Students’ responses pointed to lack of preparation immediately prior to the exam and a large portion of the exam topics being covered in one course, LGM 2033 Warehousing and Inventory, taken in their first year of study. While these initial efforts appeared to have worked, since passing rates jumped from 17% in 2019 to 80% in 2020 despite the onset of the Covid-19 pandemic that spring semester, spring 2021 passing rates fell to 42%.

Plans for Improvement/Next Steps

The student feedback received during the spring 2019 and 2020 semesters had already led to a review of the LGM 2033 Warehousing and Inventory course. In that review, faculty determined that the course needed to be rewritten to more closely align with the CLT exam competencies. Over the last year and with faculty input, the LGM 2033 has been rewritten to not only align with the CLT competencies but also meet Quality Matters™ standards for online courses. Additionally, the credentialing exam has been relocated to the course with students taking the CLA for the midterm exam and the CLT for the final exam.

The redeveloped course is offered this fall 2021 semester and the course will be reviewed for QM approval during the spring 2022 semester. The fall 2021 and spring 2022 certification exam pass rates will be reviewed at the end of the academic year with 2022 annual assessment plan final analysis occuring in January 2023. 

Learn more about the Logistics Management program

 

ASSESSMENT HOME | Assessment Spotlight Archive