FREE ELECTRONIC LIBRARY - Thesis, dissertations, books

Pages:     | 1 || 3 |

«Abstract One of the reasons that research is conducted is to build the evidence base to inform strategic or policy directions. In this context, the ...»

-- [ Page 2 ] --

Summary of literature review The strongest grounds for generalisability in qualitative research begin with rigorous attention to the definition of what is meant by the term itself. It is probably not necessary to seek new language. The qualitative paradigm has long since come of age;

it is in a position to use terms like generalisability without apology and in its own right. Defining terms or priorities (Metcalfe 2005) however, is always a good idea.

Much of the writing surveyed in this literature review is in agreement that qualitative studies may form a basis for understanding situations other than those under investigation. The strength of this basis depends again on rigour—that of a study’s design and methods for gathering and analysing information-rich data (Yin 2003a, b);

its attention to validity, reliability, and triangulation (Patton 2002); and a welldeveloped theory emerging from the findings (Johnson and Christensen 2004).

Three illustrative cases

Case 1: Three converging case studies of rigorous sampling and micro-empiricism A new and generalisable theory of learning was generated from three intensive case studies (Falk and Harrison 1998, 2000; Falk and Kilpatrick 2000). The research, funded by the Australian National Training Authority (ANTA) in 1998 (Falk and Harrison 2000) analysed community interactions to show aspects of the quality of the processes that build social capital. The research was theory-building, using the principles of grounded theory as in Glaser and Strauss (1967), Lincoln and Guba (1985) and Strauss and Corbin (1990), rather than theory-testing. The theory so developed stands as a generalisable model for interactive learning processes.

The methodology was qualitative, using a three case study structure with ethnographic techniques for data collection and a range of analytic techniques discussed below. The

-5three sites were selected for their different features (size and nature of industry base, degree of community organization activity), though each was a whole ‘small community’ of between 5–10,000 people. This type of multiple case study design is what Yin (Yin 2003a:47) describes as a replication design from the basis of a ‘theoretical replication’. In this way, the focus of the study, which was on the nature of the interactive outcomes between community members, could be related to the variables of the employment base and community organizational dynamic in action while at the same time providing more solid grounds for generalisability. In each of the three sites, the sample of participants was identified through a purposeful technique checked with socio-demographic variables.

Triangulation was provided in a number of ways. There were three layers of validity checks: (a) the use of multiple theoretical and conceptual lenses to examine the issues and parameters involve before beginning the research; (b) the depth and extent of the sampling processes and feedback, member-checking and other data collection mechanisms; and (c) the multiple data analytic techniques used to align interpretations and test for consistency and categories across the data sets. All of these provided the bases for warrantable generalisability.

Case 2: A case of mixed methods An example of a mixed methods approach is drawn from a study conducted for the Northern Territory Council of Social Service (NTCOSS) in 2004 (Northern Territory Council of Social Service 2004). The purpose of the research was to investigate how pathways to employment and training opportunities in the Northern Territory can be created and improved for employment disadvantaged groups. The research involved several components: 1) an extensive international literature review; 2) a national review of ‘what works’; 3) development of a statistical profile for each of nine employment disadvantaged groups; and 4) a series of 70 semi-structured interviews and focus groups among stakeholders across the Northern Territory. The research findings were used to develop principles of ‘what works’ in the Northern Territory and recommendations for strategic policy implementation.

In this case, generalisability was applied to the Northern Territory context and to a quite specific target audience. The integrated mixed methods approach supported and underpinned the formation of practice principles, which in turn were applied to the strategic policy context of the Northern Territory. In terms of outcomes this project is being used as a basis for the Northern Territory Government’s Employment Disadvantaged Pathways Project (Northern Territory Department of Employment Education and Training 2006) and has helped shape further research conducted by stakeholder groups (Morton et al. 2006). The authors of this paper are also working on another project using the NTCOSS methodology to build knowledge and understanding of the role of vocational training in the Australian Government’s Welfare to Work strategy (Guenther et al. 2007). These outcomes demonstrate how applicable—indeed generalisable—the findings of projects based on this methodology are.

Case 3: A case of multiple case studies A final example comes from the ANTA funded Role of VET research conducted by the Centre for Research and Learning in Regional Australia (CRLRA) (2001). The research involved a 10 site program of research conducted over two years, which used

-6case studies of the role of vocational education and training to consider principles of effective delivery in regional areas of Australia. While this research could rightly be described in terms of a ‘mixed methods’ approach because it relied on triangulation with internal (quantitative surveys) and external quantitative data (site statistical profiles), the breadth and depth of the qualitative data stands out by itself. Sites for this research were selected from regional centres across Australia: two in New South Wales and Queensland; one in Victoria, Western Australia, South Australia, Tasmania and the Northern Territory; and one New South Wales–Victoria cross-border site. The 10 case studies involved more than 700 semi-structured interviews with identified VET stakeholders.

In the Role of VET research, interviews were transcribed, coding and initial thematic analysis was conducted using qualitative data analysis software, and detailed site-bysite analysis of the emerging themes was carried out using a standardised framework of categorisations based on an OECD (1982) set of social indicators. While the data did show the uniqueness of each site in a variety of ways, several themes appeared across all or several sites. The consistency of some of these thematic patterns gave rise to a synthesis of findings, from which generalised principles were derived. While we were careful at the time to say that these principles should only be applied to the sites concerned, it has been interesting to note that many of the findings and principles have been replicated in other more recent research, using the same framework of categorisation (e.g. Guenther 2005; Guenther et al. 2006).

So what can we conclude from this discussion?

The foregoing discussion has several implications for generalisability in qualitative research, and we forward these knowing that the field of VET research has been proactive in fostering qualitative research and using its outcomes.

First, generalisability is possible from qualitative and mixed research methods. It is possible partly because of the replicability of the findings across several populations.

So if, using the same methods, we can demonstrate the same findings in several (like or even unlike) population groups then we can correctly assert that the findings are generalisable beyond the initial one or two cases. This process of replication is based on assumptions not too dissimilar from those used in quantitative methodologies, which rely on representative samples as the basis for extrapolation to a broader population group. The idea is akin to Yin’s (2003b:49-53) ‘literal replication’ and finds support in several examples from case study practice. Smith and Henry (1999) for example develop a set of generalisable case study ‘protocols’ so that duplicated case study methods are replicated to enable comparability of findings across a number of scenarios or sites. Similarly, CRLRA (2001), in the series of 10 Australian case studies discussed above, established standard methodologies for each case study site and were able to ‘quantitize’ the findings according to an agreed framework. In both these examples the ‘protocol’ or ‘framework’ is built on a set of guiding parameters that ensure the integrity and comparability of the findings and which enable a synthesis of findings based on a robust methodological design.

An extension of this sees the outcomes of a series of case studies as a result of a type of qualitative ‘hypothesis test’, not dissimilar to an empirical scientific experiment that sets out to demonstrate or prove a scientific theorem or law—we can describe this as a ‘deductive’ (as opposed to inductive or theory building) method (Johnson and

-7Christensen 2004:18). The difference of course is that ‘proof’ of the law in scientific terms is most often associated with probabilities and repeatability of numerical results under set conditions. In qualitative research, while it is possible to ‘quantitize’ text based findings—‘converting qualitative data into numerical codes that can be statistically analysed’ (Miles & Huberman 1994, cited in Tashakkori and Teddlie 2003:714)—this is not the same, in part because generally it is impossible to reconstruct the conditions under which the ‘experiment’ is undertaken. However, we argue that the same methodological principle applies: that is, a robust methodology allows us to test, prove and/or disprove a theorem regardless of whether the method is qualitative or quantitative.

Second, generalisability is also possible on the basis of theory building—that is, the ‘inductive’ approach. For example, as patterns of behaviour are observed across multiple and potentially contrasting research objects, conclusions may be drawn about factors that contribute to those patterns—that is, how and why the behaviour occurs. It is possible through a ‘theoretical sampling’ process (Charmaz 2000:519) to build theory so that across a range of scenarios, patterns of behaviour are predictable (and therefore generalisable). In terms of case study methodology, this could be described as a ‘theoretical replication’ (Yin 2003b:49-51). Again, this approach has a corresponding cousin in scientific (quantitative) methods. In science this process is used when a series of observations are made to explain and predict patterns of behaviour (Johnson and Christensen 2004:19). An example of this is the development of Darwin’s theory of evolution.

Third, generalisability is possible because of the receiving audience’s perceptions.

This, on the surface, appears to be a dangerous statement to make because it challenges the notions of true, objective, scientifically valid research and may be interpreted as research that appeases the intended audience. Several counters can be made to this argument. First, much so-called scientific quantitative research can be tailored to suit the perceptions of the intended audience. Consider for a moment science based research reports on a number of issues: smoking; nuclear power; forest practices; farm nutrient discharges into environmentally sensitive areas. A ‘spin’ can be placed on any of the findings to say whatever the audience wants to hear. Second, many of the generalised findings of quantitative research, which are extrapolated to a larger population on the basis of representative sampling schemes, simply do not apply to many sub-population groups and seemingly disregard the context of these particular groups. A case in point to illustrate this is the recent release of the Australian Bureau of Statistics (ABS 2006) Measuring Australia’s Progress report, which highlights generalised improvements across a number of indicator bands for Australia as a whole. Because the focus in this kind of methodology is on ‘generalised’ findings and the audience is assumed to be interested in just these, a large amount of important findings which are not ‘generalised’ are disregarded. The report itself acknowledges the limitations of the findings especially for Indigenous people. This illustration highlights the need for the applicability of any research findings (qualitative or quantitative) that address the context of the receiving audience. Therefore, while we often rightly note the limitations of small-scale qualitative research studies, in some cases the relevance and generalisability of the findings from a purposefully selected sample, to similar groups in an intended audience may be recognized for its credibility by researchers (who understand both

-8the sending and receiving contexts) and the audience (who apply it to the receiving context).

Fourth, generalisability is possible through a combination of any or all the above. In most of the examples given in this paper, including the three cases discussed in more detail, the methods are mixed. And here, let us avoid becoming confused about mixed methods as a mix of qualitative and quantitative—and a mix of different techniques within a solely qualitative framework as in triangulation. Here we are including both these options. In the kind of research methodologies we are concerned with here, considerable degree of warrant for generalisability is built through the care the researchers have taken to account for detail, inclusion of variation in sample, triangulation of the methods and techniques and in reporting and considering outliers and limitations. Readers are usually left with the impression that, even though this is qualitative and we are not supposed to generalise from it, we are inclined to do so.

Our own principles of logic tell us that we can do so, and with a degree of confidence.

Pages:     | 1 || 3 |

Similar works:

«United Nations in the Arab World with Research, Advocacy & Public Policy-Making December 2012 Production of Norms and Securitization in Development Policies: From Human Security to Security Sector Reform Working Paper Series # 13 Pénélope Larzillière Issam Fares Institute for Public Policy and International Affairs American University of Beirut United Nations in the Arab World with Research, Advocacy & Public Policy-Making Working Paper Series # 13 | December 2012 Production of Norms and...»

«DOLPHIN SERIES Installation, Operation and Maintenance Manual LIQUID CHEMICAL SOLUTION and SLURRY METERING PUMPS Dolphin-10, Dolphin-50 and Dolphin-75 Models READ ALL WARNINGS CAREFULLY BEFORE INSTALLING PUMP PUMP DATA/SPECIFICATIONS Fill in information from pump data label Series: Serial #: Model #: Nominal output: Maximum pressure: Volts/Hz/Amps/Phase: KOPkit®#: Tubing material/size: WARRANTY: The manufacturer warrants its equipment of its manufacture to be free of defects in...»

«Edinburgh Research Explorer The EU's Unresolved Constitution Citation for published version: Walker, N 2011 'The EU's Unresolved Constitution' Europa Working Papers, no. 2011/1, Edinburgh Law School Working Paper, no. 2011/15, University of Edinburgh, School of Law, Working Papers.Link: Link to publication record in Edinburgh Research Explorer Document Version: Publisher's PDF, also known as Version of record General rights Copyright for the publications made accessible via the Edinburgh...»

«Study Bible KJV 400 Th Anniversary The someone number is the difficult super reliability contact for you. Insure your important company how it serve to download your pdf. An exit as a customers make personal years that are on anti-american points real-time so communication, policy, research, etc. finest than a will especially know the governance, up, home consumer not takes best. A internal pressure can work directly easy and comes the consolidation with it, a course they are and what want it...»

«DISSERTATION R Diplomats and Diplomacy for the 21st Century Gustav Lindstrom RAND Graduate School This document was prepared as a dissertation in September 2002 in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Policy Analysis at the RAND Graduate School. The faculty committee that supervised and approved the dissertation consisted of Ian Lesser (Chair), Greg Treverton, and Tora Bikson. The RAND Graduate School dissertation series reproduces dissertations that...»

«Third Sector Research Centre Working Paper 83 Innovation and social enterprise activity in third sector organisations Celine Chew and Fergus Lyon November 2012 Working Paper 83 November 2012 Abstract There is a growing interest in the role of social enterprises and third sector organisations in delivering a range of services and many claims made about their innovative potential. There is therefore a need to examine the approaches to innovation. This paper examines the different sources of...»

«WING DCP SMARTBOOK Civil Air Patrol’s Guide for New Directors of Cadet Programs WING DCP SMARTBOOK May 2008 Edition PREFACE This guide, originally developed by the respected, longtime Cadet Programs leader Lt Col Ned Lee of Pacific Region, is a great reference for wing directors of cadet programs. With his permission, the NHQ Cadet Team has edited it slightly and is sharing it with new DCPs like you. We hope this brief guide helps you lead the cadets of your wing. As a wing DCP, you are one...»

«VISA AUTO RENTAL COLLISION/LOSS DAMAGE INSURANCE November 1, 2002 Certificate of Insurance Please read this certificate carefully. It outlines what Collision/Loss Damage Insurance is and what is covered along with the conditions under which a payment will be made when You rent and operate a rental vehicle but do not accept the Collision Damage Waiver (CDW) or its equivalent offered by a Rental Agency. It also provides instructions on how to make a claim. This certificate should be kept in a...»

«Original citation: Koinova, Maria. (2013) Four types of diaspora mobilization : Albanian diaspora activism for Kosovo independence in the US and the UK. Foreign Policy Analysis, Volume 9 (number 4). pp. 433-453. ISSN 1743-8586 Permanent WRAP url: http://wrap.warwick.ac.uk/51467 Copyright and reuse: The Warwick Research Archive Portal (WRAP) makes this work by researchers of the University of Warwick available open access under the following conditions. Copyright © and all moral rights to the...»

«Research report The feasibility of constructing a race equality index by Anthony Heath and Yaojun Li Department for Work and Pensions Research Report No 695 The feasibility of constructing a race equality index Anthony Heath and Yaojun Li A report of research carried out by Department of Sociology, Oxford University and the Institute for Social Change, Manchester University on behalf of the Department for Work and Pensions © Crown copyright 2010. You may re-use this information (not including...»

«_ Educating the Highly Able Alan Smithers and Pamela Robinson Centre for Education and Employment Research University of Buckingham July 2012 Contents Foreword by Sir Peter Lampl Executive Summary and Recommendations i 1. Recent Policy 1 2. Emergence of the Construct 7 Distribution of ‘Gifted and Talented’ Across Schools 3. 13 4. Validity 20 5 Current Provision in England 24 6 High Attainment in Other Countries 39 7. Conclusions and Recommendations 44 Appendix 1: Methods 54 Appendix 2:...»

«Painting a Picture of The Métis Homeland: Synthesizing Knowledge About Métis Education, Employment, and Training Dr. Yvonne Poitras Pratt Werklund School of Education, University of Calgary Dr. Chris Andersen Director, Rupertsland Centre For Métis Research Faculty of Native Studies, University of Alberta Guido Contreras Rupertsland Institute Kelsey Dokis-Jansen University of Alberta KEY MESSAGES • It’s a First Nations policy world: Political jurisdictional realities continue to reproduce...»

<<  HOME   |    CONTACTS
2016 www.dis.xlibx.info - Thesis, dissertations, books

Materials of this site are available for review, all rights belong to their respective owners.
If you do not agree with the fact that your material is placed on this site, please, email us, we will within 1-2 business days delete him.