TEAM COOPERATION TO FIGHT EARLY SCHOOL LEAVING

Why is ESL a problem for contemporary (EU) society?

Wednesday 11 February 2015, by Urška Štremfel

EU policy documents stress that ESL holds important long-term economic consequences (economic growth) and macro-social consequences (social cohesion). Research calculating the financial costs of ESL very convincingly supports these arguments, while there are various difficulties in quantifying the social consequences of ESL. According to critical policy approaches, this potentially narrows understanding of the problem of ESL to its economic dimension.

Keywords : EU 


ESL is commonly regarded as an urgent and serious problem for both individuals and EU society as a whole. Taking different classifications into consideration, the article focuses on the medium- and long-term fiscal (economic) and social consequences of ESL. It reviews various economic studies presenting ESL as a huge obstacle to further national and EU economic growth. These studies are chiefly based on a calculation of the estimated costs (including lower tax revenues and/or higher unemployment and welfare payments and/or higher public health expenditures and/or higher police expenditures and/or higher criminal justice expenditure) per individual ESLer lifetime and range from EUR 100,000 to EUR 1 million. Studies presenting aggregate financial gains expected from reducing ESL are also referred to. In addition, the weaknesses of the methodologies used in those studies are identified (e.g. difficulties in scenario-making due to high complexity and the rapidly changing environment; the issue of fully identifying education’s causal impact on various outcomes; the lack of data for estimating both the market-recognised and social costs of ESL), which to some extent question the credibility of their results. Since it is very hard or even impossible to monetise the social effects of ESL, the article exposes this makes them less convincing policy arguments than the economic costs of ESL. Critical policy approaches (wicked problems, governance of problems, problems represented to be) are introduced, showing that policy problems are not neutral but political and social constructs, thereby questioning the dominant (economic) understanding of the ESL problem. Within this framework, the article concludes that investments made in reducing ESL should not be only valued in terms of significant long-term financial savings, but that an essential component of its equally important, albeit in research less convincing, and visible contribution to a socially-cohesive EU society should also be taken into account.

Introduction

Early school leaving in the EU is recognised as being a complex educational, economic and social problem (e.g. Council of the EU, 2011; 2015). The question of what defines ESL as a problem is crucial given that problem structuring is seen as the most critical task in the development of any policy (Dunn, 1981). Therefore, much attention in EU policy documents as well as in research is paid to demonstrating the problems (negative consequences/impacts/effects/costs) ESL brings to individuals, societies, nation-states and the EU as a whole. This level of attention helps EU member states identify and understand problems with education and training at the national level (Ecorys, 2014) and provide a key rationale for tackling ESL among all relevant actors (Ross & Leathwood, 2013).

Typcially, the literature addresses ESL by considering the costs ESL brings to different individual and collective entities (Belfield, 2008; Brunello & De Paola, 2013; Psacharopoulos, 2007). In that framework, Psacharopoulos (2007) distinguishes the following costs brought about by ESL: private (realised by the individual and mostly directly observed in the market); social (impact on society as a whole and not directly observable); fiscal (taking the form of foregone benefits). Noting that the costs of ESL typically last the course of an individual’s lifetime, Dale (2010) and the European Commission (n.d.) explain how these categories may also be understood as the short-term (private costs), medium-term (social and economic costs in the form of lower income, reduced tax revenues and higher costs of public services related, for example, to healthcare, criminal justice and social benefit payments, leading to low economic growth) and long-term consequences of ESL (social and economic development). These discussions closely correspond with discussions on the role of education in contemporary EU society where quality education is defined as a prerequisite for social cohesion and economic growth (Lisbon Strategy) and smart, sustainable and inclusive growth (Europe 2020 Strategy).

Apart from the economic studies that prevail in this area, several other research studies come into play, ranging from sociology to medicine, political and to a limited extent educational science. Hankivsky (2008) explained that, as case studies of such research, the literature is dominated by the USA (e.g. Belfield & Levin, 2007; Chaplin & Lermar, 1997; Cohen, 1998) and to some extent Australia (e.g. Business Council of Australia, 2003; Lamb, Dwyer, & Wynn, 2000) and Canada (e.g. Human Resource Development of Canada, 2000) and that European countries have more or less been absent. Almost a decade after Hankivsky’s review, some studies presenting the consequences of ESL for particular member states and the EU as a whole can be identified (for a review, see Brunello & De Paola, 2013; European Commission, n.d.), yet those from the USA (e.g. Catterall, 2011; Sum, Khatiwada, & McLaughlin, 2009), Australia (e.g. Deloitte, 2012; Lamb & Huo, 2017) and Canada (e.g. Canadian Council on Learning, 2009) continue to prevail. Since ESL is a social phenomenon, also highly influenced by system-level factors, the article elaborates on the consequences of ESL in the EU context. It looks at other countries only to a limited extent in order to make some comparisons or provide valuable data that is missing in the EU setting.

Since the private and social costs of ESL are already addressed in the TITA scientific base from the standpoint of the individual ESLer, this contribution focuses on the medium- and long-term social and fiscal (economic) consequences of ESL. [1] As such, it addresses the question “Why is ESL a problem for contemporary (EU) society?”. After introducing the topic, the article first presents the economic (fiscal) consequences of ESL, second, the social consequences are described, third, different unresolved questions of researching and understanding ESL as a problem of economic and social development are mentioned, while the conclusion summarises the main findings.

Methodology

This article draws on a review of theoretical and empirical evidence. To address the article’s aims, we apply the following methods: (a) an analysis of relevant literature and secondary sources. Here we conducted a literature search of the scientific EBSCOhost, Web of Science and Google Scholar online research databases. The main key words used in searching the relevant scientific literature were: early school leaving, consequences, impact, effect, social cohesion, social development, economic growth, economic competitiveness, economic development; and (b) an analysis of EU-level formal documents and legal sources (Council Resolutions, European Commission Communications, Reports of Expert Networks).

ESL as an obstacle to economic development

Discussions on the economic consequences of ESL arise from general discussions on the importance of education (e.g. quality and attainment levels of individuals) for economic development (e.g. Hanushek & Wößmann, 2010; OECD 2010). For example, it is estimated that in the OECD countries each year of schooling is statistically significantly associated with a 0.30% higher rate of economic growth (Psacharopoulos, 2007).

Studies concentrating on the economic consequences of ESL are mostly based on a calculation of the estimated costs (including lower tax revenues and/or higher unemployment and welfare payments and/or higher public health expenditures and/or higher police expenditures and/or higher criminal justice expenditure) per individual ESLer lifetime and by calculating the returns of an additional year of schooling. Taking into consideration the number of ESLers and the differences between the target (ESLers) and non-target group (non-ESLers), studies then calculate the aggregate costs of ESL at the national/EU level and/or financial gains expected from reducing ESL at the national/EU level (Nevala & Hawley, 2011; European Commission, n.d.).

The estimated costs of an ESLer per lifetime differ widely among the EU member states and studies conducted. Brunello and De Paola (2014) report they range from EUR 33,000 in Ireland to about GBP 56,000 in the UK, from EUR 120,000 in Norway to EUR 157,000 in Estonia. Somewhat different amounts are reported by the European Commission (n.d.), showing that the lifetime costs of an ESLer range from EUR 100,000 through EUR 200,000 up to EUR 1.1 million. A review of studies that estimated the total cost of ESL and financial gains expected from reducing ESL in some European countries is presented in Table 1.

JPEG - 109.7 kb
Table 1: Review of studies presenting financial gains expected from the reduction of ESL
Sources: Calero & Gil-Izquierdo (2014); European Commission (n.d.); Nevala & Hawley (2011)

Due to the different research methodologies used in estimating costs, the range of costs included in the calculations, and differences in national contexts in which studies have been conducted, it is very difficult to make comparisons (Beirn, 1972; European Commission, 2013, n.d.; Van Alphen, 2009).

Among the various national studies, some studies also estimated the costs of ESL for the EU economy as a whole. More than a decade ago, basing the calculation on the assumption that ESLers have 6% lower productivity than qualified leavers, and using the 2005 figure of 23% unqualified leavers, suggested that ESL causes the European economy a productivity loss of 1.4% (European Commission, 2006). The European Commission (n.d.), using Eurofound calculations, shows that the annual cost of NEETs to the 21 EU member states (DK, EL, FI, FR, MT, SE, CRO not involved) is approximately EUR 100 billion (EUR 94 billion in foregone earnings and EUR 7 billion in excess transfers), which corresponds to 1% of their aggregated GDP. Considering the Europe 2020 flagship initiative ’An agenda for new skills and jobs’, the European Commission (2011) estimates that “To reduce the average European ESL rate by just 1 percentage point would provide the European economy each year with nearly half a million additional qualified potential young employees”. Reflecting the estimation that the share of jobs available to low skilled people will drop in the near future from 20% to less than 15%, it is predicted that the economic consequences of ESL in the EU will become even worse. Despite numerous projections, the European Commission (2013) argues that so far it has been difficult to accurately estimate the costs of ESL at the EU level.

Only a few studies in Europe have evaluated anti-ESL measures with regard to their cost efficiency (relationship between the cost of an anti-ESL measure and the estimated benefit of reducing ESL). [2] Existing studies indicate that policies differ in their efficiency, but also that measures have varying impacts on different groups of pupils and in different contexts. Despite their methodological limitations (e.g. the long-term effect of policies is often insufficiently factored in), their results allow the conclusion that the total costs for society created by ESL far exceed the costs of most measures aiming to reduce ESL (European Commission, 2011; 2013; Nevala & Hawley et al., 2001, p. 51).

The studies overviewed above show that the economic consequences of ESL demonstrated as costs of ESL present a huge obstacle to further national and EU economic growth, and vice versa that countries can achieve high total gains from cutting ESL. Accompanied by cost-benefit studies of various interventions already implemented, this underscores the claim that policies addressing ESL continue to be needed and represent a worthwhile investment in the EU’s economic development.

Despite these very convincing research results, deficiencies in their methodologies (cost-benefit, scenario-making, policy and social experimentations) used to estimate the costs of ESL have been identified, which somewhat question the credibility of their results (Brunello & De Paolla, 2013; European Commission, 2013; Green et al., 2004; Hankivsky, 2008; Psacharopoulos, 2007):

  • difficulties in scenario-making due to high complexity and the rapidly changing environment of contemporary society and economy (problems with estimating the medium- and long-term consequences of ESL; predicting and including particular costs in calculations);
  • the issue of fully identifying the causal impact of education on various outcomes (observable and unobservable characteristics of ESLers and the control group on which the benefits of ESL policies are evaluated);
  • the lack of data (a major difficulty in identifying education externalities is that the output, as typically measured in national accounts, only includes market-recognised effects of education and not other costs (e.g. social costs impacting society as a whole and not directly observable).

ESL as an obstacle to social development

The social benefits of education (social cohesion, social inclusion) lie at the heart of the EU’s (Lisbon, EU 2020) policy agenda. The Council of Europe (2008) defines social cohesion as "the capacity of a society to ensure the well-being of all its members, minimising disparities and avoiding marginalisation". Similarly, the OECD (2011) calls a society “‘cohesive’ if it works towards the well-being of all its members, fights exclusion and marginalisation, creates a sense of belonging, promotes trust, and offers its members the opportunity of upward social mobility”.

While various academic studies have discussed the microsocial benefits of education (social and civic engagement), a sense of belonging, trust, equality, inclusion and mobility of individual students), the macrosocial benefits (social development, social cohesion of nation-states, the EU) have been studied to a limited extent. Green, Preston and Sabates (2003) argue that, due to their conceptual differences (level and emphasis on the relational properties and social functioning), the macrosocial benefits of education cannot be simply understood as the aggregation of microsocial benefits. This fact may at least partly explain the high complexity of the macrosocial benefits of education (e.g. social cohesion) and the absence of clarity on what they actually encompass and how education may affect them.

Green et al. (2004) argue that great variations in definitions and various meanings within/between national contexts additionally make researching the relationship between education and social cohesion an extremely difficult task. [3] They (2004, p. 124) add that work relating to the influence of education on social cohesion is often qualitative in nature and that it is difficult to operationalise and test hypotheses related to learning and social cohesion within a positivist framework. The OECD (2006) notes that, while human capital theory links education to economic outcomes and offers a robust framework for scientific investigation and policy analysis, there is to date no widely accepted theory linking education to social outcomes which could at least partly explain the lack of research in this area (Fernandez Gutierrez & Calero Martinez, 2014).

Hankivsky (2008) discusses the social consequences of ESL in terms of intangible costs and non-market effects of ESL. She argues that, although these aspects are crucial for further social development, they are very difficult to quantify. In any case, based on her research she made the assumption that intangible (social) costs are equal to 50% of all tangible (economic) costs of ESL. It has also been estimated that the intangible costs far surpass all other direct and indirect costs of ESL combined.

Psacharopoulos (2007, p. 29) argues that since it is very hard or even impossible to monetise the social effects of ESL, this makes them less convincing policy arguments than the economic costs of ESL. These observations coincide with some other warnings that areas that are more easily measurable attract more (policy) attention than more difficult-to-measure areas. In doing so, there is a fear that areas that do not directly contribute to performativity are in danger of becoming worthless (Ball, 2003; Ozga, 2003).

ESL holds important long-term social consequences in terms of social cohesion and the development of nation-states and the EU. Although they are very hard (if not impossible) to quantify and measure, they should not be overlooked when designing, implementing and evaluating policy measures against ESL.

Challenges in understanding the problem of ESL

Several critical approaches have been developed in policy analysis that challenge the positivist understanding of policy problems as a neutral category. They claim that policy problems are not neutral but represent social constructions and that policy problems do not pre-exist but are actively created and produced. The literature review shows that the ESL problem can also be understood in that framework.

Wicked problems

Haug and Plant (2015) and Smyth (2010) denote ESL as a wicked problem (Rittel & Webber, 1973). Smyth (2010, p. 198) citing the Australian Public Service Commissioner summarised wicked problems as being »difficult to define … have many interdependencies (that) are often multi-causal … often lead to unforeseen consequences … not stable … have no clear solutions … are socially complex … hardly ever sit conveniently within the responsibility of any one organization … (and) involve changing behaviour«. Although arguments exist that wicked problems are difficult or impossible to solve, Roberts (2000) pointed out three possible strategies to cope with them: authoritative, competitive and collaborative. Constraints of the last two open a space for the first one and enable a (specific and narrow) solution to be formed and thus understanding of the problem.

Governance of problems

Problem processing actually starts by searching for problems: governing depends on identifying situations as problematic, acknowledging the expertise in connection with these problems and discovering governing technologies that are considered to be a suitable response (Colebatch 2006, 313). Collective problem-solving means people have common values and jointly identified policy goals (or a desired future situation) (Hoppe, 2011). Grek (2010) argues that international institutions and organisations (European Commission and OECD) are crucial in the construction of specific policy problems in the EU and thus the promotion of particular dispositions to learning (therefore also to ESL) in member states. The process of problematisation is thus the prevailing form of setting new education policy agendas in Europe. Since the very process of problem creation already carries the seed of its solution, a critical approach should be applied when studying problems that are placed high up the EU policy agenda.

Problem represented to be

Oomen and Plant (2014) assert that the ESL problem could be studied through Bacchi’s (2009) WPR (What’s the Problem Represented to be?) approach. The WPR approach starts from the premise that what policy actors propose to do about something reveals what they think is problematic (needs to change). Following this thinking, policies and policy proposals contain implicit representations of what is considered to be the ‘problem’ (‘problem representations’). For example, if educators’ training is recommended to reduce ESL, the implication is that the lack of educators’ competencies is the problem (a factor that causes ESL). Many other potential factors (e.g. at the individual or system level) are then left behind. By applying the WPR approach, Bacchi suggests asking six questions [4] in order to subject every problem presentation to critical scrutiny.

When taking the critical representations of policy problems formation presented above into consideration, it is important to see how the social and economic consequences of ESL are presented as a rationale for understanding ESL as a problem for contemporary (EU) society. Gillies & Mifsud (2016) from a Foucauldian perspective, Grimaldi (2012) by analysing neoliberalism influences and Macedo, Araújo, Magalhães and Rocha (2015) through the lenses of sociology of education define ESL as a political concept, pursuing a specific solution by providing a specific (economic) vision of the problem and their prevalence over social goals. [5] Similarly, Ross and Leathwood (2013, p. 415) refer to the need to evaluate the success of ESL measures according to their contribution to addressing social exclusion, division and inequalities and not solely how they contribute to the overall economic prosperity of society, as is the existing practice.

Conclusion

The perception of ESL holding negative consequences for individuals and society and bringing positive benefits via increased educational attainment sensitises and induces policymakers to design policies in an attempt to take corrective action and address the ESL problem (Brunello & De Paola, 2013; Psacharopoulos, 2007).

The paper overviewed a broad range of academic research and EU policy documents discussing the long-term macro-economic and macro-social consequences of ESL (economic growth and development, social cohesion and development). The overview shows that in identifying education externalities, the output, typically measured in national accounts, most commonly includes economic (market-recognised) effects of education since it is hard or even impossible to quantify the social effects (Psacharopoulos, 2007). ESL is thus generally presented as huge obstacle to further national and/or EU economic growth in terms of the costs of an individual ESLer per lifetime and the financial gains of potentially reducing ESL. According to critical approaches of understanding policy problems (wicked problems, governance of problems, problem represented to be) that were also presented in the paper, this creates the possibility that the social benefits of education and thus the social negative consequences of ESL will become overlooked when designing measures against ESL and opens the question of whether studies that point out the financial costs are not being used to justify a distinct (economically oriented) policy regarding ESL in the EU.

Footnotes

[1Psacharopoulos (2007) explains there is also a considerable overlap among the (private, social and fiscal) consequences of ESL. For example, a low level of education can limit employment opportunities and the earnings potential of ESLers, thereby leading to lower income tax payments and an increased risk of needing social benefits and participating in different welfare programmes (European Commission, n.d.).

[2For example, Levin (2009) demonstrated that delivering successful preventive programmes in the area of completing upper secondary education in the USA brings benefits (USD 209,000) that are up to 2.5 times greater than the cost of intervening per graduate (between USD 59,000 and USD 143,600).

[3Green et al. (2004) report that the macrosocial concept receives much attention in sociological theories but there is a lack of attention to it in educational research.

[41) What’s the ‘problem’ /…/ represented to be in a specific policy or policy proposal? 2) What presuppositions or assumptions underpin this representation of the ‘problem’? 3) How has this representation of the ‘problem’ come about? 4) What is left unproblematic in this problem representation? Where are the silences? Can the ‘problem’ be thought about differently? 5) What effects are produced by this representation of the ‘problem’? 6) How/where has this representation of the ‘problem’ been produced, disseminated and defended? How has it been (or could it be) questioned, disrupted and replaced?

[5The inferior position of the social dimension of education in general is also evident from selected OECD and EU policy documents. The OECD (2011, p. 58) claims that social inclusion is both a desirable end in itself and a means to achieve development outcomes like growth, and question whether social cohesion, beyond its intrinsic desirability, actually has a use, e.g. an economic pay-off. The European Commission (2006) explains that investing in education and training in order to raise efficiency and quality produces social benefits which, in turn, feed economic growth.

(2009). Analysing Policy: What’s the Problem Represented to Be? Frenchs Forest, New South Wales: Pearson Education.

(2003). The teacher’s soul and the terrors of performativity. Journal of Education Policy, 18(2), 215–228.

(1972). Antecedents and consequences of early school leaving. Geneva: International Bureau of Education.

, & (Eds.). (2007). The price we pay: Economic and social consequences of inadequate education. Washington, DC: Brookings Institution Press.

(2008). The cost of early school-leaving and school failure. Research prepared for the World Bank. New York: Queens College, City University of New York.

& (2013). The costs of early school leaving in Europe. EENEE Analytical Report No. 17. Brussels: European Commission.

(2003). The cost of dropping out: The economic impact of early school leaving. Dusseldorf Skills Forum and Applied Economics.

& (2014). Too much to pay: An estimation through microsimulation techniques of the monetary costs of early school leaving in Spain. Journal of Simulation, 8(4), 314–324.

(2009). No “drop” in the bucket: The high costs of dropping out. Retrieved from http://en.copian.ca/library/research/ccl/lessons_learning/no_drop_bucket/no_drop_bucket.pdf.

(2011). The societal benefits and costs of school dropout recovery. Education Research International.

, & (1997). Dropping out: Public and private costs. Washington: The Urban Institute.

(1998). The monetary value of saving a high-risk youth. Journal of Quantitative Criminology, 14(1), 5.

(2006). What work makes policy? Policy Sciences, 39(4), 309–321.

(2008). Report of high-level task force on social cohesion. Towards an active, fair and socially cohesive Europe. Strasbourg: Council of Europe.

(2011). Council Recommendation on policies to reduce early school leaving. Retrieved from http://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32011H0701(01)&from=EN.

(2015). Council conclusions on reducing early school leaving and promoting success in school. Retrieved from http://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52015XG1215(03)&from=EN.

(2010). Early school leaving, lessons from research for policy makers, NESSE Report. Brussels: European Commission.

(2012). The socio-economic benefits of investing in the prevention of early school leaving. Retrieved from http://handsonlearning.org.au/DAE_investing_in_preventing_ESL_via_HOL_September_2012.pdf

(1981). Public policy analysis. Englewood Cliffs, NJ: Prentice-Hall.

(2014). Interim evaluation of the strategic framework for European cooperation in education and training (ET 2020). Retrieved from http://ec.europa.eu/dgs/education_culture/more_info/evaluations/docs/education/et2020_en.pdf.

(2006). Communication from the Commission to the Council and to the European Parliament: Efficiency and Equity in European Education and Training systems. Brussels: European Commission.

(2011). Early school leaving in Europe – questions and answers. Retrieved from http://europa.eu/rapid/press-release_MEMO-11-52_en.htm

(2013). Reducing early school leaving: Key messages and policy support. Final Report of the Thematic Working Group on Early School Leaving. Retrieved from http://ec.europa.eu/education/policy/strategic-framework/doc/esl-group-report_en.pdf

(n.d.). Overview and examples of costs of early school leaving in Europe. Retrieved from http://ec.europa.eu/dgs/education_culture/repository/education/policy/strategic-framework/doc/europe-esl-costs_en.pdf

, & (2014). The non-monetary costs of early school leaving: Estimation in terms of years of good health. Educacion, 17(2), 241–263.

& (2016). Policy in transition: The emergence of tackling early school leaving (ESL) as EU policy priority. Journal of Education Policy, 31(6), 819–832.

, , & (2004). Non-material benefits of education, training and skills at a macro level. In P. Descy and M. Tessaring (eds.), Impact of education and training. Third report on vocational training research in Europe: background report (pp. 119–177). Luxembourg: Office for Official Publications of the European Communities.

, , & (2003). Education, equality and social cohesion: A distributional approach. Compare, 33, 453–470.

(2010). International organisations and the shared construction of policy ‘problems’: problematisation and change in education governance in Europe. European Educational Research Journal, 9(3), 396–406.

(2012). Neoliberalism and the marginalisation of social justice: The making of an education policy to combat social exclusion. International Journal of Inclusive Education, 16(11), 1131–1154.

(2008). Cost estimates of dropping out of high school in Canada. Retrieved from http://200.6.99.248/~bru487cl/files/Costofdroppingout.pdf

, & (2010). Education and economic growth. In P. Peterson, E. Baker, & B. McGaw (Eds.). International Encyclopedia of Education (pp. 245–252). Oxford: Elsevier.

& (2015). The potential role of career guidance and career education in combating early school leaving. Neveléstudomány, 3, 5–15.

(2011). The governance of problems: Puzzling, powering and participation. Bristol: The Policy Press.

. (2000). Dropping out of High School: Definitions and Costs. Ottawa: Applied Research Branch, Strategic Policy. R-01-1E. October, 2000. Retrieved from http://www11.hrsdc.gc.ca/en/cs/sp/hrsdc/arb/publications/ research/2000-000063/page09.shtml.

, , & (2000). Noncompletion of school in Australia: The changing patterns of participation and outcomes. Camberwell, Victoria: ACER.

, & (2017). Counting the costs of lost opportunity in Australian education. Mitchell Institute report No. 02/2017. Melbourne: Mitchell Institute.

(2009). The economic payoff to investing in educational justice. Educational Researcher, 38, 5–20.

, , , & (2015). The construction of early school leaving as a political concept under the lenses of sociology of education. Profesorado, 19(3), 28–42.

, & et al. (2011). Reducing early school leaving in the EU. Study. Brussels: European Parliament.

(2006). Measuring the Effects of Education on Health and Civic Engagement. Proceedings of the Copenhagen Symposium. Retrieved from https://www.oecd.org/edu/innovation-education/37437718.pdf

(2010). The high cost of low educational performance. The long-run economic impact of improving PISA outcomes. Paris: OECD Publishing.

(2011). Perspectives on global development 2012 social cohesion in a shifting world. Paris: OECD Publishing.

, & (2014). Early school leaving & lifelong guidance. ELGPN Concept Note No. 6. Jyväskylä: European Lifelong Guidance Policy Network.

(2003). Measuring and managing performance in education. Edinburgh: University of Edinburgh: Centre for Educational Sociology (CES) Briefing No. 27.

(2007). The costs of school failure – a feasibility study. European Expert Network on Economics of Education.

, & (1973). Dilemmas in the general theory of planning. Policy Science, 4, 155–169.

(2000). Wicked problems and network approaches to resolution. International Public Management Review, 1(1), 1–19.

, & (2013). Problematising early school leaving. European Journal of Education, 48(3), 405–418.

(2010). Adolescent engagement, connectedness and dropping out of school. In J. L. DeVitis, & L. Irwin-DeVitis (Eds.), Adolescent education. A reader (pp. 195–208). New York: Peter Lang.

, , & (2009). The consequences of dropping out of high school: Joblessness and jailing for high school dropouts and the high cost for taxpayers. Center for Labor Market Studieublications. Paper 23. NorthEastern University.

(2009) The educational quality of early school leavers and the cross-national variation of their income disadvantage. Educational Research and Evaluation: An International Journal on Theory and Practice, 15(6), 543–560.