New Media Literacies
 

Contact Us!

 
 

Visit the PLAY! Wiki (participatory learning and you)

 
   
 

 
 
www.flickr.com
This is a Flickr badge showing public photos and videos from New Media Literacies. Make your own badge here.
 
 

February 2011 Archives

Measuring New Media Literacies: Towards the Development of a Comprehensive Assessment Tool (Part Two)

|

Results

Although all of our scale items collectively attempt to measure new media literacy levels, and the overall reliability of the scale was high (Chronbach's alpha=.903), we were interested in identifying the specific subcomponents that make up this concept. Our initial research question was whether the subscales of this survey instrument map well onto Jenkins' 12 NMLs. Particularly, we were interested in seeing if, as predicted, the scale would break down into components that were similar to those identified by Jenkins. 

To address this question, we performed a factor analysis on the 60 items, and then assessed the reliability of each separate subscale that emerged from the factor analysis. With the exception of 2 NMLs (collective intelligence and simulation), the factors identified in this analysis mapped well onto Jenkins' 12 NML skills, indicating the definite existence of subcomponents that tap into dichotomous skill sets. Thus, out of the 12 NML skills that make up Jenkins' framework, 10 were identified in the factor analysis of our scale; furthermore, all 10 of these components had adequate reliability. This is a rather impressive and encouraging finding, especially given the fact that all 60 items of the scale were completely randomized and thus the items that made up each of these 12 subscales never appeared in order. The two NMLs that did not distinctly emerged from the factor analysis were collective intelligence and simulation; rather than clustering together as distinct factor components, the items measuring these two dimensions ended up being spread out over the different subscales.

Measuring New Media Literacies: Towards the Development of a Comprehensive Assessment Tool (Part One)

|

The present study was motivated by our observation that, in spite of the increasing popularity and impact of Henry Jenkins' New Media Literacies framework, there was a lack of an appropriate quantitative measurement tool to assess these new media literacy skills. Certainly, existing tools do not capture the full spectrum of skills and propensities suggested by Jenkins. Furthermore, the reliance on qualitative data - which is typical of most studies in this field - means that such assessment projects are not feasibly replicable with larger groups. Therefore, this study aimed to address methodological lacunae within the NML framework by developing and validating a comprehensive quantitative assessment tool that could be used to measure new media literacies (NMLs) in both adult and juvenile populations.

Below, you will find an overview of the survey instrument and a summary of the results. If you would like to see the complete NML questionnaire that was used for this assessment, as well as the full report on the findings of this study (including all the statistical data), please contact me (Ioana Literat) at iliterat@usc.edu.