Thursday 25 December 2008

edonis research interview II

Gillham states that probes should be "simple, clear, direct and potent" for them to effectively direct and focus the conversation (p46). The interviewer must appreciate that the interviewee is helping them to understand. To this end, clarification shouldn't be used as a device, though reflecting what has been said and asking for justification when a judgment is made can be very effective in gaining deeper understanding (p47). Extending the narrative, by saying "Give me an example" or "Tell me a bit more", can help to contextualise a word and query the internal consistency of what the person is saying (p44). Reflecting can indicate the emotional state behind what has been said and may result in the interviewee developing and linking elements of what they have been thinking or saying (p51). This is a significant difference from the questionnaire where there is an assumption of ready-formed, accessible opinions, which may in fact be vague and ill-defined at that point (p52).


By using Pamela for Skype to automatically save each telephone interview, and storing face-to-face ones on an mp3 recorder, I am not as pressured into transcribing as-I-go. However there is a requirement to back-up and safely store such data. By storing the mp3 files for future transcription, I am missing out on systematically and regularly informing my methodology etc based on what has aired during the interviews, as well as reflection and action which would have resulted during the transcription and categorisation process. Presently, there is no time for me to transcribe and content analyse even one of the pilot interviews. To pay for transcription at this stage would be a waste of funds. The interim solution is to listen-again to each interview and to reflect and implement improvements prior to the January interviews.

Gillham states that content analysis is "about organising the substantive content of the interview" (p59). I will identify the substantive points and then subjectively put them into categories. The derived categories will need to be exclusive and exhaustive; each statement fitting into one category. Gillham suggests transcribing around 350 words per page, using a different typeface for distinct parts.

In the medium-term, I will immerse myself in the detail of the substantive content of the initial series of interviews. I will then begin to see the significance of what people have said, although I need to be aware that while categorising, I am also interpreting (p73). As I publish findings, a purpose of some of the interview content will be to illustrate the narrative being woven through the three years of the study. I will be selective and may need to discard some very relevant quotes. Discrepant quotes, which I have already noticed, will be added to give a qualifying insight. Again subjectively, I will need to reflect general points being made, including contradictions. I am unlikely to quantify patterns of interview statements in tabular form.

When writing-up findings, I should use the introductory paragraph to reinforce a framework for holding the quotations together, then allow the interviewees to 'take over' (p77). If they have made a common point, this should be illustrated by several quotations (p78). This helps to construct an audit trail, should any of my conclusions be inspected or challenged. How I arrived at my conclusions will directly affect the peoples’ perceptions of my judgment and justification (p79).

I am attempting (and in many cases been fortuitous) to keep the study broad in terms of: gender, education sector, experience, location and age. I have not spent time on identifying a sample and there may be some justification needed later on my decision to work with 'learning professionals', which may be considered too broad in relation to the research questions.


One other phenomenon to be aware of, if it exists or comes to exist, is the elite group or elite interview (p81). Where an interviewee has authority in one or more areas of the 'social web' in learning, they have a privileged position; a wide grasp. Their perspective will be different. These participants, many of whom will have signed-up to the edonis Ning site as opposed to those without expertise or prior experience and who predominantly participate via email, possess greater knowledge about the areas, topics and settings (p82). They may have higher expectations about the interview questioning and will be used to being in control when talking about the 'social web'. I will be more likely to get distinctive views and perspectives, with insights into hidden agendas, sensibilities, key documents and records, and formal/informal relationships within the system. The interviewee will need to be carefully consulted beforehand. The evidence will have authority and the respondent may need to be listened to in future directing of the research. However, Gillham warns of respondents becoming too close an ally, which may put distance between myself and others, including those who choose to participate, for example via email, and do not currently possess significant knowledge or experience of the ‘social web’. Gillham values even-handedness (p83), which is a challenge to me, particularly when I find that since November I have been investing great effort in the edonis Ning site and methodology blog, which of course some or many participants will have no interest in utilising during the study.

Technorati Profile

Monday 22 December 2008

edonis research interview I


In advance of the first edonis interviews (four took place during December, of which the edited versions of three will be released at http://edonis.ning.com during January and February) and the Qualitative Analysis course which starts in January, I read ‘The Research Interview’ by Bill Gillham, published by Continuum in 2000.


Gillham is clear that, although an interview is a conversation, there is a controlling relationship which needs to be managed (p1). I will be seeking responses for a purpose; one which may not be for the interviewees benefit, although in committing to my three-year study many participants have already stated desired outcomes for themselves. Having arranged and carried out fifteen interviews over the last three years for my Booruch podcast, I feel experienced enough and competent in managing a weighted conversation.


The research interview is one way for me to obtain information and understanding around the aims and questions of the edonis project (p2). Of the six draft research questions, I chose to use the single interview as part of my research into questions 2, 3 and 4. As I prepared for the first interview (with an ASN teacher in the West of Scotland), I examined striking a balance between the structured and unstructured interviews. In the former, I would know in advance what I wanted to find out (and I could quantify responses) (p2), however I had previously decided that methods such as the now established monthly online survey would be most appropriate for collecting data. There were aspects of each of these questions which I felt could best or only be opened-up by talking to participants (p5).


In advance of the first edonis interviews (four took place during December, of which the edited versions of three will be released at http://edonis.ning.com during January and February) and the Qualitative Analysis course which starts in January, I read ‘The Research Interview’ by Bill Gillham, published by Continuum in 2000.

By moving into the, inadequately termed, semi-structured interview, Gillham suggests an increased likelihood of unexpected discoveries and the creation of new knowledge. This latter consequence becomes more likely if participants listen to edited interviews on the Ning site and are given, make use of, or create their own space to engage with myself, the interviewee and/or other participants; deconstructing, ‘mashing-up’, re-conceptualising, or building-upon interview content. This space may be extended through the yearly group face-to-face or web conference.


Following participants’ responses to Part 1a of the project, I identified those who would be interviewed during December (the pilot period). These participants had given a response to various questions regarding permission and most had responded to my initial open approach (optional question) (p3) of asking them to suggest a couple of examples of interesting, good, or innovative practice that they had been involved in and would be willing to share. This flexible approach to the planning stage would be extended by examining their responses to Parts 1b and 2. I would be able to better explore or understand some of the earlier responses. Although contested, I would be able to back-up study findings (interim and final) with direct quotations (p9). During December, a ‘bank’ of interview questions built-up, comprising at least two versions of questions relating to each substantive area/research question. This ‘bank’ as at 31st December, can be found in Appendix A. The differentiated list (agenda, as such) for each interview was sent to interviewees as part of a longer email regarding arrangements (see Appendix B). This email allows interviewees to respond to my broad, open questions and proposed examples of practice, with deletions, alteration or additions.


At each stage of planning and conducting the interview, I need to be aware of control and power; ensuring that the focus remains on the interviewee (p3). With an eye on the three research questions, I am nonetheless drawing out what matters to the interviewee (p4). This must be kept in mind right through to the conclusion. I am confident that my earlier study of ‘person-centred’ approaches (Carl Rogers), high degree of interview organisation, and at least a degree of familiarity with each interviewee helped to minimize negative connotations around being the subject of an interview. Informal conversations with each person since (including the tail-end of the interview telephone call) did not highlight any issues with my conduct, though I did, on two occasions, apologise for the lack of clarity in the way I asked each of them a particular question.


By necessity, interviews within this international study must take into account the convenience of each interviewee. It is a special occasion, where people will talk more freely in their own setting (p6). They were given the choice of: face-to-face interviews at a negotiated venue, using an mp3 recorder; face-to-face interview at the participants’ workplace; telephone interview at a time of their choosing, recording using Pamela for Skype; or a negotiated alternative.


Gillham writes this at a time when there would be a significant cost involved in arranging to record a telephone conversation. He adds that too much is lost from not sitting in the same room as the interviewee, as well as difficulties around timing, length and responsiveness of the interviewer. Therefore only a short section is dedicated to telephone interviews, and this is largely out-of-date. Due to the international nature of edonis, the ability to efficiently conduct interviews at low-cost and with minimum intrusion is vital. Skype is a Voice-over-IP (VoIP) application, downloadable for free from http://skype.com, which allows users to make calls from their computer or mobile phone. Free calls can be made to other Skype users’ computers (several participants have indicated that they have, or will have, an account and would like to be interviewed via this method), and by buying Skype Out credits, low cost calls to landlines and mobile phones around the world can be made. I have experimented with many call recording applications (both free and premium), such as Pretty May, Hot Recorder and Pamela for Skype. Immediately prior to the first interview, upon realizing that Pamela (free version) records only in 15 minute slots, I purchased Pamela for Skype Premium. This allows unlimited, uninterrupted recording of calls (permission having been sought by email well in advance of placing the call). Both sides of the conversation are recorded in a single mp3 file. This can be edited and tidied-up for publication on the Ning site, if required, using Audacity sound editing software and The Levelator (both free, open-source software). The unedited recording is used within my own research.


Gillham states that interviews offer far more hope of a 100% response rate than a questionnaire (p14). One challenge has been to encourage all participants to indicate a period in one of the following three years when they may be available for interview. Inviting interviewees to use part of the conversation to talk about their involvement in a relevant area of practice is one way of allowing the process to fulfill a human need; that is to: share, receive recognition, and have space to talk and reflect. Offering to host the edited interview (with agreement) on the Ning site should communicate my own interest, concern, and desire to learn from, and with, participants. In placing myself within the study I will be responsive and familiar. Gillham argues that the easier it is to get data, the less valuable they are (p10). With around six broad, open questions, and a commitment from myself and the interviewee, they would be aware, beforehand, that I was expecting extended responses, with my natural prompts and probes (p10). To ensure insight and understanding, there must be trust.


Trust is essential for this to be comfortable and rewarding, as new, public disclosures may be made (p15). Building trust has been given priority from the first emails, so that interviewees are aware of purposes, questions, storage and usage. Mixing methods helps to include the (unknown) participants who are not as comfortable with extended written responses to, for example, emailed questions. However, the interview areas do not replicate any of the questionnaires. Although in first draft, the research questions (and the focus on questions 2, 3 and 4) informed the expanding ‘bank’ of substantive areas covered in the interview. Elaborate, reflective, in-depth responses have been made during the four pilot, semi-structured interviews. During each call, I have logged things said and followed-up insights and hunches at the time. Later, as I systematically log each part of the interview, in relation to my enquiry, there will be need for further elaboration, though this was not made explicit during the signing-up and therefore cannot be guaranteed to happen. During this short pilot phase, I am crafting questions which are distinct, refined, ordered and sensitive, and place me as the reflexive research instrument (p23). I have been economical with my presence during each interview, asking short questions (though not always asked clearly) and have, drawing on my experience, never put words ‘into their mouth’. With respect to future analysis, my lack of developed methodology means that I am unable to state, at this stage, in what ways much of the interview data will be used.


As I moved through the pilot phase, I became more confident in the type of questions I was asking, reducing the chances of anxiety within and around the conversation. I have built-up a prompt list each time; based on points, topics, documents, links and observations stated by the interviewee. I need to be aware of common components as a variation from standard themes will make comparison between interviews during content analysis more difficult (p45). Interviewees have been given time to answer, with ‘pregnant’ pauses condoned on my part. The time and space, or acceptance or promotion of a change of direction leading from a silence, shows a focus on the interviewee. I am comfortable managing this in a virtual space due to my participation in, and occasional facilitation of, a weekly web conference where the technology allows only one person to speak at a time, with extended periods of text-only chat (audio is silent).


Each conversation could be said to have had an “introductory phase, opening development, central core, and closure”, in social and research content terms (p37). Gillham talks of unobtrusive control, ensuring that the key points are covered (p45). Partly due to length, I have missed out reviewing what has been said and allowing further space for additional information to emerge. The social aspect of the call is managed like the rest of the interview. Behaving naturally conveys purpose and respect for the interviewee during their working day and avoids the start and end being more contrived than it need be. Prior to making the call, I make sure that Skype and Pamela are working and communicating with each other. I have, close-at-hand, a copy of the interview schedule (shared with the interviewee), recent emails, and significant responses from them to previous parts of the study. My open, ordered, logical questions and management of the interview allow for later questions to adapt, and for supplementary ones to be asked. Despite the need to develop the ways in which I start and close the interview, I do make use of devices such as, “Now the last thing I want to ask you about…”.


Part II to follow


Appendix A

  • Brief background about you and your career in education
  • your experiences of ICT-related /training/professional development: as a student teacher; during INSET; and as part of CPD
  • your experiences of ICT-related training/professional development
  • your understanding of (and if you are comfortable, thoughts on) web access for learning professionals provided within your authority
  • your understanding of, and thoughts on, web access for learning professionals provided by your employer
  • how you use email and the extent to which this supports your professional development
  • your notion of 'learning network'
  • uses of the 'social web' that you have been attracted to
  • the extent to which you see your use of ICT as a learning professional changing over the next 3 years.


Appendix B


Dear X

I would like to confirm details of the telephone interview that you have agreed to take part in on X

The following are areas that I would like cover during the interview. Some of these areas are based on responses which you have made so far during the project.
  • X
  • X
  • X

Please let me know if there is anything you would like to be added to the list, or have removed.

Please confirm that an interview of around X minutes is OK.

I look forward to speaking with you on X.

Regards

David


Thursday 18 December 2008

edonis project - introduction II

During the summer of 2008 I began work on my thesis. At this time, the working title was, “How are educators using the ‘social web’ to enhance teaching and learning, and their own professional development?” I started to develop a three-year, longitudinal study, entitled edonis (educators online impact study); setting out to have 100 participants by time of commencement at the start of November. The research would consist primarily of: fortnightly emailed questions; monthly online surveys via Survey Monkey; quarterly invited response to some stimulus; yearly extended discussion (online or face-to-face); and a face-to-face or online recorded interview.


After eleven years of teaching and three years communicating online with fellow learning professionals, I was confident that by promoting edonis through several channels, I would attract at least 100 participants. I:


  • Emailed seventy teachers on the mailing list of The Access Network (http://accessnetwork.blogspot.com); an online community that I facilitate. These teachers are typified by their teaching of pupils with Additional Support Needs (ASN) in Scotland
  • created a social network website (http://edonis.ning.com). Networks created at Ning can comprise several communication tools. The aims of the edonis Ning site are to: promote the building of relationships among many of the participants; continue conversations and facilitate a platform for them to post, comment, and influence the methodology and others aspects of edonis; and share research activities and interim data (including some interviews) with those in the study and beyond
  • used a tool within Ning which allowed me to send a mass email invitation to a select list of contacts in my personal/professional email account. This communication invited those interested in the stated research title to email edonis for further details, or to sign-up to the edonis Ning
  • sent a message to those who ‘follow me’ on Twitter (http://twitter.com/parslad)
  • publicised edonis through a special episode of my ‘edtech’ podcast, Booruch (http://booruch.libsyn.com) and through the weekly recorded group conversation at Edtechroundup (http://edtechroundup.com)
  • asked colleagues to mention the study to those within various ‘looked after children’ and residential school networks
  • I invited work colleagues to take part after outlining the research during a brief slot in our Monday education staff meeting.


The edonis Ning was created in July 2008, becoming interactive from the October. On the left-hand side is a media player which initially plays a short audio introduction to the study (and has been downloaded and played over 300 times within the first two months). Around every two weeks from January 2009, this player will be updated with an edited version of an interview with one of the eighty-odd participants who have given consent to their conversation (semi-structured interview) being made available for playing on the site, as well as for download from my Booruch podcast channel. A project badge is available to embed into participants’ own websites; this has been done by around fifteen so far. The badge indicates that a number of members of the Ning community are assisting in different ways in the promotion of edonis. The final area on the left provides hyperlinked names, enabling visitors to the site access to the main websites of some of the participants.


The right-hand side provides a significant attraction, encouraging learning professionals to regularly visit the site. All those who signed-up to the study were asked if they wished to provide a link to their main website, if they had one. Each site’s RSS feed was fed into the edonis project Yahoo Pipe. This collects updates from each of the sites into one RSS feed. This has been embedded into the edonis Ning site (after I set up a monthly payment to Ning for the extra space/removal of GoogleAds). Visitors can easily access the twenty most recent blog posts, social bookmarks, website updates etc by some of the participants. I will explore whether this particular tool can be used directly in my research.


Key event details can be posted by myself in the top-middle of the site. This was used to build up to the launch on 4th November. It provided concise details of the research, participants’ involvement, and how to sign-up. The main body of the site provides space for blog posts. I regularly post information relevant to the study, including: profiles of those who are taking part via email only; the draft research questions; updates, including links to the parts of the study; and stimuli such as Wordle word clouds (http://wordle.net). Any participant who has joined to edonis Ning may create a blog post on their page and offer it to the home page. A variety of purposes have been served so far, such as: outlining initial thoughts on the research questions; creating a wider audience or conversation; and even advertising of vacancies.


Finally, there is a selection of thumbnail images of participants. These link to their own page and profile, and let visitors know if that person is currently visible online. Most created a profile upon signing-up to the Ning which I found useful in constructing the first parts of the study.

Saturday 13 December 2008

edonis project - introduction I


The edonis project is a 3-year study of learning professionals use of the 'social web'.

1 In what ways are learning professionals using the 'social web'? How are these adding to, or challenging, the concept of 'professional development'?

2 How are established approaches to 'professional development' being influenced by the 'social web'?

3 What is meant by 'personal learning network'? Which metaphors are commonly used to support this concept? In what ways is it challenged?

4 As the 'social web' expands, what changes are likely in the ways that learning professionals will access and engage with 'professional development'?

5 To what extent can the 21st Century learning professional utilise the 'social web' within their workplace as well as at home?

6 How can the parts of the 'social web' be categorised in terms of usefulness to learning professionals?

Comments on this 1st draft would be appreciated.

Link to edonis Ning