In assessing the psychometric properties of this new assessment tool, survey data was first factor analyzed in order to assess the reliability of the measure, and determine how these emergent factors compared with Jenkins' original 12 NML skills. If the survey instrument was accurately constructed, we expected to see 12 separate subscales - similar to the 12 NMLs identified by Jenkins - resulting from the factor analysis. In terms of the relationship between media exposure and NMLs, we hypothesized that higher levels of new media literacies would correlate with a higher degree of engagement with media forms - particularly new digital media - and that there would therefore be a significant difference in NMLs between people with low versus high levels of media exposure. An increased degree of digital participation in various Web 2.0 platforms should also relate to high NML levels, with light users scoring lower in media literacy than heavy users of these digital platforms. Finally, we also hypothesized that high NML levels should predict a greater propensity for multimedia creation, and, respectively, civic engagement. 

The sample for this study (N=327) was a convenience sample of normal volunteers over the age of 18, who completed the survey online. In terms of gender distribution, the sample contained 131 male respondents and 187 female respondents. The average age was 33.7 years (SD=11.7). In regards to ethnicity, 83.9% of respondents were white, and 77.3% indicated English as their primary language. Income and education levels were normally distributed.

Survey Design

The survey was structured around 4 main sections: demographics, media use habits, new media literacies (NMLs), and civic engagement. All questions were randomized, so that each participant received them in a different order, to maximize the validity of the findings. 
The section on media use habits queried respondents about their access to a computer and to the Internet, the extent of their exposure to different media forms, their digital memberships and affiliations, and their creative engagement with multimedia. The NML section of the survey - the most extensive and critical part of this instrument - aimed to assess respondents' new media literacy skills (NMLs) by presenting them with a randomized series of 60 statements about their personality, social and cultural modes of engagement, online and offline peer interaction, learning styles, and media consumption and creation patterns. The statements were conceptually built around the 12 NML skills identified by Jenkins (2006): play, performance, simulation, appropriation, multitasking, distributed cognition, collective intelligence, judgment, transmedia navigation, networking, negotiation, and visualization. To ensure an adequate factor analysis while minimizing the duration of the survey, we decided to include 5 items for each NML, for a total of 60 questions. These items addressed both technology-related and non-technology-related behaviors, in accordance with our view that the NML skills are social and cultural competencies that stretch beyond media expertise or technological capability. 

Finally, the last section of the questionnaire contained a set of 5 questions that attempted to measure the respondents' degree of civic engagement, by addressing three principal dimensions of civic engagement: self-efficacy, civic responsibility, and commitment to civic action.

[to be continued - tune in tomorrow for the results!]