Assessing the Efficacy of Educational Technology

Three years ago I dove head first into the Web 2.0 pool. I passionately embraced blogging, wikis, podcasting, digital storytelling, RSS, social bookmarking, social networking, and so on.  This has been one of my main areas of professional development, and I have written short-term and long-term professional goals for myself in this area of education.  Furthermore, I have been working very hard to teach these tools to teachers, and I have made it clear that they need to incorporate these technologies into their instruction. We have dedicated many hours of faculty meeting time to discuss the importance of  embedding technology into the curriculum and the necessity for creating authentic units of study.

The other day I had my mid-year evaluation with my district superintendent.  As part of my review, my boss challenged me to “evaluate the effectiveness of the use of the Web 2.0 tools.”  Continuing, she wrote “Mr. Sherman might gain evidence that explains why and how the integration of a wiki or a blog has improved the probability or depth of learning for students.”

She is absolutely correct.  As with any lesson, unit, or instructional strategy, we must collect data to assess what our students have learned.  How will we know if our teaching is successful otherwise?  For three years I have been asking myself if student achievement really is improving with the use of new and innovative technologies.  I can see that students are more interested and engaged when their teachers incorporate authentic uses for technology into instruction, but I have no evidence to prove that students are becoming better readers, writers, thinkers, mathematicians, historians, or scientists through the use of technology.

This has led me to the idea of creating an action research project in my school and across the school district to assess whether the use of Web 2.0 tools is leading to improved student achievement.  I plan on surveying teachers to discover the extent to which they are incorporating technology into their lessons.  I can collect anecdotal information based on teachers’ observations of their students, but I have not discovered an assessment tool that will provide quantitative data to prove (or disprove) my hypothesis that the use of Web 2.0 tools in school will improve student learning as compared to the use of more traditional means of instruction.

In a few months, I will be speaking to a group of principals about new and innovative uses of technology in their schools. I am expecting at least one person to ask me to prove that students learn better through the use of blogs and wikis.  I am not sure I will be able provide any evidence of gains in student achievement and learning.

The majority of educators are not yet convinced that students should be using web-based tools in school (see Scott McLeod’s post from February 2).   Ultimately, our credibility as agents of educational change hinges on providing proof that our students are learning in response to the new and innovative instruction about which we so passionately write and discuss in our blogs.  How do we find the proof to back up the claims?


2 thoughts on “Assessing the Efficacy of Educational Technology

  1. Great article! I just finished writing a post about a web 2.0 course I will be teaching. It seems I am just at the start of the journey you have been traveling in reference to sharing it with your teachers. As an assistant principal I dabbled in it, but now as a principal I want to create more change.

    Do you have any advice or information on how I should begin sharing this with my teachers? The class I am teaching is optonal and I have about 15 teachers signed up.

    If you are interested in the post here is the link.

  2. Mike,
    Look for one or two teachers who are willing to take a risk and try something new. Show them a few really good examples of teacher blogs and wikis. Challenge them to create a free blog, and start posting. They should start by posting homework assignments. It’s a traditional use of a blog, but it is a good way for them to get their feet wet.

    Then, They should post an assignment in which students must reply in a comment. Asking a question or posting an interesting picture for them to write about is an easy start. This is why it’s called the Read/Write web.

    Teachers should then work on a simple podcast where students record themselves reading a poem or short story that they each wrote. This is a great way to publish on the web, and it makes writing very authentic for students. They now have a world-wide audience.

    After mastering these blogging skills, teachers will never see the internet in the same way. If you already have 15 people signed up, then you are well on your way to getting them started. The teachers who are successful should share with the rest of the faculty.

    I hope this is a help. Keep in touch!


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s