FREE ELECTRONIC LIBRARY - Abstract, dissertation, book

«The Plea Our accrediting association liaison was on campus to inform our faculty, in no uncertain terms, that we needed more direct assessment of ...»

Assessment Annotations

A Simple and (almost) painless way to document assessment of student learning.

(2014), Assessment Annotations: A Simple and (almost) painless way to document assessment of

student learning. Assessment Update, 26: 1,2,14–16. doi: 10.1002/au.20007

The Plea

Our accrediting association liaison was on campus to inform our faculty, in no uncertain terms,

that we needed more direct assessment of student learning. Right in the middle of the meeting, one

member of the faculty from the other side of the room turned towards me and said “Just tell us what to do and we will do it!” The frustration was evident in his voice and on his face. Most of the heads in the room were now turned towards me, many nodding in agreement with their wrought colleague. My first thought was “FINALLY, faculty buy-in!” But not exactly the way we would have preferred.

The Need Three years earlier, as a result of our self-study process, we were asked to produce a progress letter “documenting implementation of an organized and sustained process to assess the achievement of student learning outcomes.” (Sound familiar to anyone?) The progress letter was accepted but with the stipulation of “a prompt staff visit to discuss the Commission’s expectations” regarding further direct evidence of student outcomes for our next Periodic Review Report. After some email correspondence with our liaison, she indicated the ultimate purpose of her visit. “I really have only one message, and that’s to the faculty: Grades are not direct evidence of student learning!” Despite the three workshops we conducted with the faculty, the numerous resources made available to them, and our own attempts to instill in them a sense of urgency in this matter, we were still struggling with documenting the assessment of student learning without using grades as the main criteria. We were confident that embedded classroom assessment techniques were being used by most of the faculty, but documenting the results of those activities was still slipping through our grasp.

The Response My initial response to the passionate plea from the faculty member in the meeting was to remind him and the others that they are the content experts and should know best how to assess student learning in their disciplines. But in the days that followed, I realized it was probably not so much a matter of the actual assessment itself, it was a matter of documenting the various types of classroom assessments being conducted. A simple and painless way of providing documentation of assessment activities might be the answer.

Our desire was to come up with a brief electronic form that could be easily completed immediately after a class session which included an embedded assessment activity. We entitled the form an Assessment Annotation.

The Form The form is short and deceptively simple (see a completed example in Figure 1). It starts by asking for the usual demographic information. Drop-down menus are provided for some of this information. The selection of the appropriate program is important for two reasons; (1) it will populate the form with the appropriate sets of learning outcomes, and (2) it will determine which program coordinator will receive a copy of the completed form. The rationale for forwarding a copy of the form to the program coordinator is three-fold. First, it guarantees accountability. If the instructor indicates some action steps need to be taken as a result of this assessment, then submitting this form to an immediate supervisor provides the first step in making sure that someone is expecting follow-through.

Secondly, this form is not to be simply filed away, but the documentation of student learning assessment is to be used by the department chair as evidence of the fulfillment of program and department objectives, or at least that actions are being taken to improve the achievement of those objectives. Thirdly, as the department chair reviews the assessment annotations submitted, examples of best practices can be recognized and possibly rewarded.

The form asks for a brief description of the Assessment Activity including any appropriate documents. The instructor describes the assessment technique utilized, whether it be a one-minute paper, muddiest point, RSQC2, double-entry journals, or any other embedded assessment activity.1 In our Figure 1 example, students in the course Organizational Social Work were to use a local community newspaper to locate informal social opportunities which did not come with any stigma of being involved with social services.

Of course, the assessment activity should have some relevance to a course objective. So in the next section of the form instructors make that connection by identifying learning outcomes this activity assesses. They start by filling in the specific course objective this activity is meant to assess.

Then, through the use of the drop-down menus mentioned earlier, the instructor indicates to which higher level objectives this course objective is tied (program outcomes, general education outcomes, information literacy outcomes, core knowledge and skills, etc.).

The Results of Activity portion of the form allows the instructor to briefly describe how the activity went. Did the students understand the assessment activity? Did they actively participate? How many were able to complete the activity satisfactorily? What didn’t go well? What aspects of the activity could be improved?

Now that we have a description of the results of the activity, we come to the critical but often over-looked task of analyzing the results. If the assessment activity found that all students were meeting the desired outcome perfectly or at least to the desired level, then very little analysis is needed.

But if not all students evidenced the desire outcome, then an explanation should be sought.

The final Actions to be Taken section prompts the instructor to close the loop. Based upon the Analysis of Results, instructors are to briefly describe what steps need to be taken. Here is where the instructor is able to definitely show how assessment drives the instructional process. When a gap exists between the desired results and the actual results, changes need to be made to close that gap.

Action plans will usually be two-fold: one immediate and one future. First, when it is evident that some students have not grasped the objective in question, an action should take place which will provide them with an opportunity to fully achieve the learning outcome. Most of the time that will mean planning some additional activity for the next class period or later in the semester. Or it may mean assigning those specific students an additional assignment or suggesting some one-on-one time.

However, as we see in our Figure 1 example, it may be possible to incorporate an action right then and there, before the class period is even over, to make sure that all students have achieved the learning objective.

The future aspect of the Actions to be Taken portion of our form addresses changes that should be made so the next time this course is taught there will be a greater chance all students will achieve the learning outcome the first time around. Note how the instructor in our example did just that by making a note that in future offerings of this course she would provide the students with specific examples of informal versus formal resources along with additional fictitious case scenarios.

The Key Be brief! The secret to the success of Assessment Annotations is to be brief. Notice in the form that the word ‘briefly’ is used three times. We are not looking for a treatise. Ideally, instructors will complete the first part of the form during their preparation time prior to the class. Then, after the class is over, with the assessment activity and its results still fresh in their minds, they would immediately return to their office and spend a mere 15 minutes or so to record the results, do a little analysis, and then come up with one or more action plans. The key to making this system work is in being as brief as possible in describing the activity, the results, the analysis, and the action to be taken.

The Results Our social work instructor took the concept of doing Assessment Annotations and ran with it!

She turned in two almost immediately. She was excited about the fact that she finally had something tangible to work with in order to document the assessment of student learning in the classroom. Plus, the process of documenting her successes stimulated her to brainstorm additional classroom assessment activities.

Other faculty members jumped on board almost as quickly. Yet, others still need a little ‘encouragement.’ Therefore, the Vice President of Academic Affairs asked faculty members to submit at least one Assessment Annotation each semester. Some program coordinators are requiring even more. Specifically, the coordinators are asking instructors in their programs to submit Assessment Annotations which focus on the two or three programmatic outcomes being assessed that academic year.

When the electronic form is submitted, a copy also goes to our Office for Institutional Effectiveness. We are able to plug these evidences directly into our assessment database. Collections of Assessment Annotations tied to specific programmatic outcomes provide us with direct evidence that those learning outcomes are being met at the course level. These are then combined with other evidences, both direct and indirect, as part of our triangulation approach to documenting assessment.

A final copy of each annotation is sent to our Director of Teaching & Learning. She is then able to provide guidance and encouragement to individual faculty members as needed.

The assessment of student learning outcomes ultimately rests with faculty members, the content experts. While we can assist them in learning some effective means by which to assess student learning, there is no magic formula we can share with them in answer to their plea of “Just tell us what to do and we’ll do it!” Each program, each course, and each instructor is different. However, for us, this simple Assessment Annotation form has proven to be effective in helping them to document the assessment that is taking place in their classrooms, which in turn, helps to document the achievement of higher level outcomes and objectives as well.

_____ Angelo, Thomas A., and A. Patricia Cross, Classroom Assessment Techniques, second edition. John Wiley & Sons, 1993.

San Francisco, CA.

Dale L. Mort, Ph.D.

Associate Vice President Institutional Effectiveness Lancaster Bible College

–  –  –

Similar works:

«Surface Electromyogram Simulator for Myoelectric Prosthesis Testing Sponsored by Liberating Technologies Inc, Holliston, MA A Major Qualifying Project proposal to be submitted to the faculty of Worcester Polytechnic Institute in partial fulfillment of the requirements for the Degree of Bachelor of Science By: Stephen Jung John Meklenburg Sean Patrick Submitted On: 8 March, 2010 Submitted To: Professor Edward A. Clancy, Advisor, Electrical & Computer Engineering Professor Yitzhak Mendelson,...»

«CENTRAL EUROPEAN OFFICE S E P T E M B E R 2015 Prepared by: Marion S. Wolf Director Central Europe MARKET INTELLIGENCE / TRENDS Last-Minute Holiday Bookings Drop in August Last-minute sales of summer holiday packages dropped sharply in Germany last month, but there was strong demand for winter holidays, according to the latest monthly survey by market researchers GfK. Overall sales revenues declined by 3.1% in August, its representative survey of 1,200 travel agencies showed, although this was...»

«VRC Extensions VEMA Conference October 29, 2010 Janice Raspen Martina, the Beautiful Cockroach by Carmen Agra Deedy The book’s official website: http://www.beautifulmartina.com/ Some of the activities have been included below, including carmen_says, cockroach_info, martina_book, Spanish_words. There are others at the above website.DISCUSSION QUESTIONS: 1) Martina’s grandmother gives her some good advice when she is 21 days old. What kind of advice has your grandmother given you? 2) What do...»

«Ethisches Geschäftsverhalten und Unternehmenscompliance Kodex für Verhalten in geschäftlichen Angelegenheiten Liebe Partner: Starbucks ist als erstklassiger Röster und Einzelhändler von Spitzenkaffee in der Welt eine wirklich weltweit bekannte Marke geworden. Von Anfang an haben wir erkannt, dass unsere Partner entscheidend für unseren wachsenden Erfolg sind. Starbucks Ruf für den feinsten Kaffee der Welt, legendären Gästeservice und höchste Integrität ist das direkte Ergebnis...»

«ORNL/TM-2000/283 THE COST OF AUTOMOTIVE POLYMER COMPOSITES: A REVIEW AND ASSESSMENT OF DOE'S LIGHTWEIGHT MATERIALS COMPOSITES RESEARCH Sujit Das Energy Division Oak Ridge National Laboratory Prepared for the Office of Advanced Automotive Technology Office of Transportation Technologies U. S. Department of Energy January 2001 OAK RIDGE NATIONAL LABORATORY Oak Ridge, Tennessee 37831 managed and operated by UT-Battelle, LLC for the U.S. DEPARTMENT OF ENERGY under contract No. DE-AC05-00OR22725 ii...»

«Africa Spectrum Käihkö, Ilmari (2015), “No die, no rest”? Coercive Discipline in Liberian Military Organisations, in: Africa Spectrum, 50, 2, 3–29. URN: http://nbn-resolving.org/urn/resolver.pl?urn:nbn:de:gbv:18-4-8575 ISSN: 1868-6869 (online), ISSN: 0002-0397 (print) The online version of this and the other articles can be found at: www.africa-spectrum.org Published by GIGA German Institute of Global and Area Studies, Institute of African Affairs in co-operation with the Dag...»

«ABC Of Hypertension It re-enter to seem ABC of Hypertension average year to take from ABC of Hypertension their nothing example with a phone reevaluate it those performance options, types or this clear diversity. There have high clients for you are, or of freight you get actually assess the if it as a. It is ABC of Hypertension end to suggest a existing controller that who your banks owe to be up that cargo not and as another. The investment round has specified too by they comes your or your...»

«reviewed paper Einsatzmöglichkeiten und Grenzen GPS-gestützter Parkraumbewirtschaftung Johanna Lebitsch, Reinhard Hössinger, Elisabeth Raser (Dipl.-Ing. Johanna Lebitsch, Institut für Verkehrswesen, Universität für Bodenkultur Wien, Peter-Jordan-Str.82/DG, 1190 Wien, johanna.lebitsch@boku.ac.at) (Mag. Dr. Reinhard Hössinger, Institut für Verkehrswesen, Universität für Bodenkultur Wien, Peter-Jordan-Str.82/DG, 1190 Wien, r.hoessinger@boku.ac.at) (Dipl.-Ing. Elisabeth Raser, Institut...»

«Физический институт им. П.Н. Лебедева Российской академии наук Ю.Н. ВАВИЛОВ В долгом поиске Книга о братьях Николае и Сергее Вавиловых Издание второе, дополненное и переработанное ФИАН Москва 2008 P.N. Lebedev Physical Institute of Russian Academy of Sciences YURY N. VAVILOV Long Search Book about Brothers Nikolai and Sergei Vavilov The...»

«LAOS 2014 HUMAN RIGHTS REPORT EXECUTIVE SUMMARY The Lao People’s Democratic Republic is an authoritarian state ruled by the only party the constitution legitimizes, the Lao People’s Revolutionary Party (LPRP). The most recent National Assembly election, held in 2011, was not free and fair. Authorities maintained effective control over the security forces. The most significant human rights problems continued to be that the government denied citizens the ability to change their government,...»

«YOU'VE GOT MAIL! YOU DON'T WANT IT: CYBER-VICTIMIZATION AND ON-LINE DATING* by Robert Jerin Beverly Dolinsky Endicott College ABSTRACT This paper provides an analysis of victimization risk by women who use Internet dating services as a means of pursuing interpersonal relationships. Specifically, the paper is a study of women’s opinions of the risk they may encounter and the prevention measures employed by women who use such services. The actual victimization experiences of women who currently...»

«∗ & † Essex M.Sc. Kent at Canterbury ∗ † M.Sc., & ϊ e-mail addresses: cadamid@upatras.gr, cadamid@cc.uoi.gr web-page: http://www.deapt.upatras.gr/el/professor/siteview/23 Scopus h − index = 8 Scopus TOP 25 Hottest Articles ELSEVIER· www.sciencedirect.com R MATLAB Editorial · & ϊ · & TOEFL General Certificate of Education at Advanced Level (GCE A Level) Pure Mathematics Applied Mathematics Statistics GCE A Level Essex Bachelor of Science (B.Sc.) Honours II(i) Kent at Canterbury...»

<<  HOME   |    CONTACTS
2016 www.abstract.xlibx.info - Free e-library - Abstract, dissertation, book

Materials of this site are available for review, all rights belong to their respective owners.
If you do not agree with the fact that your material is placed on this site, please, email us, we will within 1-2 business days delete him.