Assessment workshop opening remarks

Introductory comments by Anne Zald, Head, Map Collection & Cartographic Information Services at the University of Washington Libraries, and member of the ACRL Institute for Information Literacy Immersion faculty.

Lunch Discussion Notes: Assessment techniques (Regardless of Technology)

Here are the notes from one of the lunch discussion groups at our recent Putting Assessment into Practice: A Library Instruction Workshop.

The topic of this discussion was: Assessment Techniques (regardless of technology) Thanks to Deb Raftus for moderating this discussion!

Some assessment techniques our group has made use of:

• In-class worksheets with exercises
• Clickers
• End of session satisfaction surveys
• Clear/muddy questions
• End of quarter online form (low response)
• One-minute papers
• Zoho is helpful to provide structure for reporting instruction assessment to administrators (for departmental reporting of assessment results, including stats, strategies used, and informal notes)
• Reflection: one minute papers, research log
• Pre and Post testing -Serves to learn what students know, as well as clue them in that there are things they don't know
• Pre - class surveys of resource knowledge or research strategies: should be anonymous to encourage honesty, also reassure students that you aren't looking for a "right answer."

Individual Challenges:

• Finding assessment techniques that are appropriate for returning students (or graduate students) -- don't want to come off as condescending or insulting.

• Getting students to recognize value of Reference materials...how to assess use? Solution: Mark books and count for use as they are photocopied through Libraries photocopy services.

• If you use a lot of informal assessment strategies, how do you measure and report the results? Recommendations: Incorporate solutions where you can collect results (WebQ, have students email an article citation to you, get bibliographies and/or final projects from faculty, follow up with faculty to see if students found appropriate sources)

• How to find out what students own approach is to research, before teaching them, for the purpose of learning where they start. (How to ask in away that they will be honest?) This will help understand where they are coming from, but could also impact our reference and instruction services.

• How to change mid-class based on evaluation/assessment?

• How to assess students' comfort with technology before the course, in the case of an online course where technology has proven to be a barrier to student learning. Students were reluctant to ask for help during the course, so it would help to find out where students are stumbling before the class, to find alternative ways to provide the information, and assist users in a way that they are comfortable with. (Perhaps survey could also address their learning styles, how they like to learn new technologies?)

Lunch discussion Notes: Learning Outcomes

Here are the notes from one of the lunch discussion groups at our recent Putting Assessment into Practice: A Library Instruction Workshop.

The topic of this discussion was: Learning Outcomes. Thanks to Emily Keller for moderating this discussion!

• Is there a disconnect between the information literacy standards and developmental outcomes? How do we move beyond so much focus on the lower order skills in Bloom’s taxonomy? We may undermine students’ extant capabilities and experiences by only showing them tools, rather than tapping into the other skills and experiences they bring to the classroom.

• Experiments using homework, or interactive pre-library session worksheets, to prepare students before their first library session in a class. Helps bring students up to a certain level and ensure that they’ve already covered some basics, without taking up more class time. Instructors distribute the non-graded 20-minute homework assignment. Plans to build on this work and add a post-test to measure progress through the quarter.

• Struggle with translating the broader institutional outcomes into information literacy outcomes in the classroom. Examples and questions:

• An English department has learning outcomes for their writing classes. How do they ensure consistency of outcomes when instructors have such discretion to teach in their own way?

• If information literacy outcomes are already in a program’s objectives, what’s the next step? Working with individual instructors? How does the program assess those outcomes?

• Challenging to frame information literacy outcomes when working with professional, vocational, and technical programs.

• Instructors want us to teach so much in a one-shot session. Perhaps we can use learning outcomes as a tool for talking with instructors about their course goals, specific competencies that they’d like to see, where they see problems, and using that as starting point to talk about what’s realistic in a one-shot session. It can also be a way to frame what we have to offer in terms of helping instructors achieve THEIR course goals, rather than trying to get time in a class where the instructor doesn’t want to take more time away from the syllabus. Explaining how we’ve found active learning activities to be far more effective in fostering student learning that they will retain and apply, and that will take X amount of time for Z learning outcome. Learning outcomes create new ways to step into the discussion, instead of approaching library instruction as an add-on.

• What about collaboration, engagement, and group work as learning outcomes in themselves? Not just processes or activities, but as the very learning that you’re trying to foster? In one instance, group activities fostered engagement that the librarian and instructor now pursue that as a goal itself.

• Variety of activities to foster better articulation between community college and upper division information literacy outcomes.

• E-portfolios, integrating info lit objectives into the curriculum which we would then expect to see in summative student products such as portfolios.

Lunch Discussion Notes: Assessment Tools & Technology

Here are the notes from one of the lunch discussion groups at our recent Putting Assessment into Practice: A Library Instruction Workshop.

The topic of this discussion was: Assessment Tools & Technology. Thanks to Jennifer Fairchild for moderating this discussion!

Favorite Tools:

• Game Show Software (about $350) and Who’s First (buzzers, about $150). Both are available through Trainer’s Warehouse. http://www.trainerswarehouse.com/default.asp
• TurningPoint Audience Response System, the clickers and the software. http://www.turningtechnologies.com/

Available Tools:

• Survey Monkey: free version and paid
• Quia: includes surveys, quizzes, html coding, web pages, tutorial, games, classroom management. Can be open source or password protected. http://www.quia.com/web
• Blackboard: http://www.blackboard.com/inpractice/highered/index.bb
• Moodle: open source http://moodle.org/
• ANGEL: many higher education institutions are replacing Blackboard with ANGEL http://www.angellearning.com/
  
• E-Portfolio: http://www.eportfolio.org/
• Online Faculty Learning Commons
• WebQ/Catalyst
• “real life” tools (i.e. the catalog or websites) used to compare sources or locate items during a class session for example

Impediments to our instruction and assessment:

• Budget cuts
• Limited classroom time, how do we fit instruction and assessment into one short session with a class?

What could be improved?:

• Resource sharing! It would be wonderful if all of the library communities of Washington State could easily access and share instruction (i.e. online tutorials) and assessment tools with colleagues so that the wheel is not being reinvented over and over again.

Putting Assessment into Practice: Resources

We currently have two sources for additional articles and web sites regarding instruction and information literacy assessment:

del.icio.us: Assessment4Librarians bookmarks - http://delicious.com/assessment4librarians

RefWorks: shared folder - Assessment for Librarians
-- or, if you don't have access to RefWorks, a static page of current resources has been posted at http://faculty.washington.edu/elcoe/assessmentreferences.htm

Putting Assessment into Practice: a Library Instruction Workshop

Sponsored by the Instruction & Information Literacy Working Group at the University of Washington Libraries, this hands-on workshop is for librarians who want to better understand what their students know before, during, and after library instruction sessions. The workshop will introduce accessible concepts, techniques, and technologies for implementing classroom assessment in any setting.

Date: August 18, 2008

Time: 8:30am to 3:00pm

Location: University of Washington, Seattle campus, Mary Gates Hall (MGH) (campus map)

Agenda

8:30-9:00 Check-in and coffee/pastries (MGH 228)

9:00 - 9:30 Welcome and Introductory comments (MGH 228)

Anne Zald, Head, Map Collection & Cartographic Information Services at the University of Washington Libraries, and member of the ACRL Institute for Information Literacy Immersion faculty

9:45 -10:45 Tools for Learning What your Students Have Learned: Outcomes for Classroom Assessment (MGH 228)

Margy Lawrence, Center for Instructional Development and Research (CIDR), University of Washington

11:00 - 12:00 Catalyst WebQ: Applications of Survey Tools for Information Literacy Learning Assessment (MGH Computer Classroom)

Deb Raftus, Romance Languages and Literatures Librarian, University of Washington Libraries, and Catalyst staff.

12:15 - 1:15 Lunch (MGH Commons)

Seeded small group informal discussion. Participants can choose a table/topic that interests them. Topics will be Learning outcomes, assessment tools (technology), assessment techniques (regardless of technology), Working with undergraduates, Working with graduates.

1:30-2:30 Click! Click! in the Classroom: Quick Assessment of Student Learning Using an Audience Response System (MGH Computer Classroom)

Janet Schnall, Information Management Librarian, Health Sciences Libraries, University of Washington

2:30 - 3:00 Wrap up (MGH Computer Classroom)

John Holmes, Undergraduate Services Librarian, Odegaard Undergraduate Library, University of Washington