Other learning resources for Discussion 1& 2
Policy Implementation, Street-level Bureaucracy, and the Importance of Discretion.
Street-level bureaucrats implementing public policies have a certain degree of autonomy – or discretion – in their work. Following Lipsky, discretion has received wide attention in the policy implementation literature. However, scholars have not developed theoretical frameworks regarding the effects of discretion, which were then tested using large samples. This study therefore develops a theoretical framework regarding two main effects of discretion: client meaningfulness and willingness to implement. The relationships are tested using a survey among 1,300 health care professionals implementing a new policy. The results underscore the importance of discretion. Implications of the findings and a future research agenda is shown.
Keywords: Discretion; public policy; policy implementation; street-level bureaucracy; quantitative analysis
INTRODUCTION
In his book Street – level bureaucracy : Dilemmas of the individual in public services, Michael Lipsky ([29]) analysed the behaviour of front-line staff in policy delivery agencies. Lipsky refers to these front-line workers as ‘street-level bureaucrats’. These are public employees who interact directly with citizens and have substantial discretion in the execution of their work (1980, p. 3). Examples are teachers, police officers, general practitioners, and social workers.
These street-level bureaucrats implement public policies. However, street-level bureaucrats have to respond to citizens with only a limited amount of information or time to make a decision. Moreover, very often the rules the street-level bureaucrats have to follow do not correspond to the specific situation of the involved citizen. In response, street-levelbureaucrats develop coping mechanisms. They can do that because they have a certain degree of discretion – or autonomy – in their work (Lipsky [29], p. 14). Following the work of Lipsky, the concept of discretion has received wide attention in the policy implementation literature (Brodkin [ 6]; Buffat [ 8]; Hill and Hupe [19]; Sandfort [51]; Tummers et al. [58]; Vinzant et al. [61]).
However, scholars have not yet developed theoretical frameworks regarding the effects of discretion, which were subsequently tested using large-scale quantitative approaches (Hill and Hupe [19]; O’Toole [41]). This study aims to fill this gap by developing a theoretical framework regarding two effects of discretion.
The first effect, which is often noted, is that a certain amount of discretion can increase the meaningfulness of a policy for clients (Palumbo et al. [43]). An example can clarify this. A teacher could adapt the teaching method to the particular circumstances of the pupil, such as his/her problems with long-term reading, but ease when discussing the material in groups. The teacher could devote more attention to the pupil’s reading difficulties, thereby providing a more balanced development. More generally, it is argued that when street-levelbureaucrats have a certain degree of discretion, this will make the policy more meaningful for the clients. Client meaningfulness can thus be considered a potential effect of discretion. Here, we note that client meaningfulness is highly related to concepts such as client utility or usefulness.
Furthermore, it can be argued that providing street-level bureaucrats discretion increases their willingness to implement the policy (Meyers and Vorsanger [39]; Sandfort [51]). Tummers ([56]) showed this effect while studying ‘policy alienation’, a new concept for understanding the problems of street-level bureaucrats with new policies. One mechanism underlying this relationship between discretion and willingness to implement seems to be that a certain amount of discretion increases the (perceived) meaningfulness for clients, which in turn enhances their willingness to implement this policy (Hill and Hupe [19]; Lipsky [29]). This is expected as street-level bureaucrats want to make a difference to their clients’ lives when implementing a policy (Maynard-Moody and Musheno [32]). Hence, when street-level bureaucrats perceive that they have discretion, they feel that they are better able to help clients (more perceived client meaningfulness), which in turn increases their willingness to implement the policy. This is known as a mediation effect. This effect is often implicitly argued, and has yet to be studied empirically.
Based on this rationale the central research question is: To what extent does discretion influence client meaningfulness and willingness to implement public policies , and does client meaningfulness mediate the discretion -willingness relationship?
This brings us to the outline of this article. We will first develop a theoretical framework, outlining the relationships between discretion, client meaningfulness, and willingness to implement. The ‘Methods’ section describes the operationalization of the concepts and research design, which is based on a Dutch nationwide survey among 1,300 psychologists, psychiatrists, and psychotherapists implementing a new reimbursement policy. The ‘Results’ section shows descriptive statistics and discusses the hypotheses. We conclude by discussing the contribution of this article to policy implementation literature with a particular emphasis on the importance of discretion of street-level bureaucrats.
THEORETICAL FRAMEWORK
Background on discretion
This article focuses on the discretion of street-level bureaucrats during policy implementation. Due to the abundance of literature and the intrinsic difficulties with the discretion concept (such as the different interpretations attached to as well as criticisms of these interpretations), we will provide only a short overview of the term discretion (for elaborate overviews, see Evans ([13]), Hill and Hupe ([19]), Lipsky ([29]), Maynard-Moody and Portillo ([35]), Meyers and Vorsanger ([39]), Saetren ([50]), and Winter ([63])). For a recent critique on discretion, see Maynard-Moody and Musheno ([33]).
Evans ([13]) has noted that for employees, discretion can be seen as the extent of freedom he or she can exercise in a specific context. Related to this, Davis ([ 9], p. 4) states ‘a public officer has discretionwhenever the effective limits on his power leave him free to make a choice among possible courses of action or inaction’ (see also Vinzant et al. [61]). Lipsky ([29]) focuses more specifically on the discretion of street-level bureaucrats. He views discretion as the freedom that street-level bureaucrats have in determining the sort, quantity and quality of sanctions, and rewards during policy implementation (see also Hill and Hupe [19]; Tummers [57]). We then define discretion as the perceived freedom of street-level bureaucrats in making choices concerning the sort, quantity, and quality of sanctions, and rewards on offer when implementing a policy; for instance, to what extent do policemen experience that they themselves decide whether to give an on-the-spot fine? To what extent do teachers feel they can decide what and how to teach students about the development of mankind, i.e. evolution or creationism (Berkman and Plutzer [ 3])?
As can be seen from the previous paragraph, we focus on experienced discretion. This is based on Lewin’s ([28]) notion that people behave on the basis of their perceptions of reality, not on the basis of reality itself (Thomas Theorem). Street-level bureaucrats may experience different levels of discretion within the same policy because, for example, (a) they possess more knowledge on loopholes in the rules, (b) their organization operationalized the policy somewhat differently, (c) they have a better relationship with their manager which enables them to adjust the policy to circumstances, or (d) the personality of the street-level bureaucrat is more rule-following or rebellious (Brehm and Hamilton [ 5]; Prottas [48]).
In both top-down and bottom-up approaches of policy implementation, the notion of discretion is important (DeLeon and DeLeon [11]; Hill and Hupe [19]). From a top-down perspective, discretion is often not welcomed (Davis [ 9]; Polsky [45]). Discretion is primarily seen as a possibility that street-level bureaucrats use to pursue their own, private goals. This can influence the policy programme to be implemented in a negative way, which undermines the effectiveness and democratic legitimacy of a programme (Brehm and Gates [ 4]). In order to deal with this issue, control mechanisms are often put in place in order to achieve compliance.
In the bottom-up perspective, discretion is assessed differently. Discretion is seen as inevitable in order to deploy general rules, regulations, and norms in specific situations, which helps to improve the effectiveness of policy programmes and the democratic support for the programme. Moreover, given the limited time, money, and other resources available and the large number of rules, regulations, and norms that have to be implemented, it is important that street-level bureaucrats are able to prioritize what rules to apply, given the specific circumstances in which they operate in (Brodkin [ 6]; Maynard-Moody and Musheno [32]; Maynard-Moody and Portillo [35]).
From a top-down and bottom-up perspective it can be argued that discretion has a different meaning for citizens as a client. In the top-down perspective, discretion could possibly harm the position of a citizen because private considerations and interpretations of the goals of the policy programme by the street-level bureaucrat prevent citizens being treated equally. In the bottom-up perspective, discretion will help to strengthen the value/meaningfulness of a policy for clients, as policy programmes can be targeted to their specific situation. Hence, from a bottom-up perspective discretion might increase the client meaningfulness, that is, the value of the policy for clients (Barrick et al. [ 2]; Brodkin [ 6]; May et al. [30]; Maynard-Moody and Musheno [34]; Tummers [56]). Client meaningfulness can be defined as the perception of street-level bureaucrats that their implementing a policy has value for their own clients. Client meaningfulness is therefore about the perception of the street – level bureaucrat that a policy is valuable for a client (the client may not feel the same way). For instance, a social worker might feel that when he/she implements a policy focused on getting clients back to work, this indeed helps the client to get employed and improves the quality of life for this client. Granting street-level bureaucrats discretion during policy implementation can increase client meaningfulness as several situations street-level bureaucrats face are too complicated to be reduced to programmatic formats. Discretion makes it possible to adapt the policy to meet the local needs of the citizens/clients, increasing the meaningfulness of the policy to clients.
It seems that discretion could also positively affect the street-level bureaucrats’ willingness to implement the policy . Willingness to implement is defined as a positive behavioural intention of the street-levelbureaucrat towards the implementation of the policy (Ajzen [ 1]; Metselaar [38]). Hence, the street-level bureaucrat aims to put effort in implementing this policy: he/she tries to make it work. Policyimplementation literature, especially the studies rooted in the bottom-up perspective, suggests that an important factor in this willingness of street-level bureaucrats is the extent to which organizations are willing and able to delegate decision-making authority to the front line (Meier and O’Toole [37]). This influence may be particularly pronounced in professionals whose expectations of discretion and autonomy contradict notions of bureaucratic control (Freidson [15]).
To conclude, it seems that discretion can have various effects. In this article, we specifically examine two possible positive effects of discretion: enhanced client meaningfulness for clients and more willingness to implement the policy . These effects are chosen given their dominant role in the policy implementation debate (Ewalt and Jennings [14]; Riccucci [49]; Simon [53]; Tummers et al. [59]).
The effects of discretion on client meaningfulness and willingness to implement
Given the arguments stated previously, we first expect that when street-level bureaucrats experience high discretion, this positively influences their perception of client meaningfulness. Sandfort ([51]) illustrates this by describing a case in United States public welfare system (Work First contractors). Regardless of the specifics of the local office, street-level bureaucrats are given the same resources to carry out their tasks: standardized forms, policy manuals, complex computer programmes, etc. Such structures cause the street-level bureaucrats to be isolated from other professionals and unable to adapt existing practices to altering demands. Hence, it reduces their discretion and this could result in less client meaningfulness. We will study this same process using a quantitative approach, bringing us to the first hypothesis.
H1: When street-level bureaucrats experience more discretion, this positively influences their experienced client meaningfulness of the policy
Next, we expect that when street-level bureaucrats feel that they have enough discretion, this positively influences their willingness to implement a policy. Maynard-Moody and Portillo ([35], p. 259) note, ‘Street-level workers rely on their discretion to manage the physical and emotional demands of their jobs. They also rely on their discretion to claim some small successes and redeem some satisfaction’. Examining this more generally, the mechanism linking discretion to willingness to implement can be traced back to the human relations movement (McGregor [36]). One of the central tenets of this movement is that employees have a right to give input into decisions that affect their lives. Employees enjoy carrying out decisions they have helped create. As such, the human relations movement argues that when employees experience discretion during their work, this will positively influence several job indicators by fulfilling intrinsic employee needs. Next to this, self-determination theory (Deci and Ryan [10]) argues that three psychological needs must be fulfilled to foster motivation: competence, relatedness, and autonomy. In short, they argue that when people perceive to have autonomy, they are more motivated to perform.
H2: When street-level bureaucrats experience more discretion, this positively and directly influences their willingness to implement the policy
Furthermore, we expect that when street-level bureaucrats experience more discretion, this positively influences their client meaningfulness, which in turn positively influences their willingness to implement a policy. Hence, client meaningfulness could influence the willingness to implement a policy. This is expected as street-level bureaucrats want to make a difference to their clients’ lives when implementing a policy. May and Winter ([31]) found that if the front-line workers perceive the instruments at their disposal for implementing a policy as ineffective, in terms of delivering to clients, this is likely to add to their frustrations. They do not see how their implementation of the policy helps their clients, so wonder why they should implement it.
Technically speaking, we expect a mediation effect to occur (Zhao et al. [65]). Mediation is the effect of an independent variable (here, discretion) on a dependent variable (willingness to implement) via a mediator variable (client meaningfulness). Hence, besides hypothesizing the direct effect of discretion on willingness to implement, we expect that part of this effect is caused by increasing client meaningfulness. This can be considered a partially mediated effect: part of the effect of discretion on willingness to implement is mediated by client meaningfulness. Full mediation is not expected. Some of the influence of discretion on willingness to implement is explained by factors other than increasing client meaningfulness, i.e. peoples’ intrinsic need for autonomy in their work (Wagner [62]).
H3: The positive influence of discretion on willingness to implement is partially mediated by the level of client meaningfulness
This mediation effect can be related to established job design theories like the job characteristics model of Hackman and Oldham ([17]). Hackman and Oldham noted that autonomy (related to discretion) is one of the core job characteristics, enhancing experienced responsibility for outcomes. This influences the critical psychological states, such as experienced meaningfulness of work (related to client meaningfulness). In turn, experienced meaningfulness of work fosters individual and organizational outcomes, such as high internal motivation (related to willingness to implement). Hence, important similarities between their line of reasoning and ours can be found. An important difference is that we focus on the level of policy implementation instead of the general job level.
Based on these three hypotheses, a theoretical framework is constructed as shown in Figure 1.
Graph: Figure 1: Proposed theoretical framework regarding two main effects of discretion
METHODS
Case
To test the theoretical framework, we undertook a survey of Dutch mental health care professionals implementing a new reimbursement policy (Diagnosis Related Groups). First, a short overview of this policy is provided.
In January 2008, the Dutch government introduced Diagnosis Related Groups (DRGs, DiagnoseBehandelingCombinaties (in Dutch), or DBC’s) in mental health care. The DRGs are part of the new Law Health Market Organization. The DRGs can be seen as the introduction of regulated competition into the Dutch health care market, a move in line with new public management (NPM) ideas. More specifically, it can be seen as a shift to greater competition and more efficient use of resource (Hood [20], p. 5).
The system of DRGs was developed as a means of determining the level of financial exchange for mental health care provision. The DRG-policy differs significantly from the former method in which each medical action resulted in a financial claim. This meant that the more sessions a professional caregiver (a psychologist, psychiatrist or psychotherapist) had with a patient, the more recompense could be claimed. This former system was considered inefficient by some (Kimberly et al. [25]). The DRG-policy changed the situation by stipulating a standard rate for each disorder. For instance, for a mild depression, the mental health care professional gets a standard rate and can treat the patient (direct and indirect time) between 250 and 800 min.
The DRG-policy these professionals have to implement is related more to service management than to service delivery. However, this policy does have effects on service delivery. Professionals have to work in a more ‘evidence-based’ way and are required to account for their cost declarations in terms of the mental health DSM (Diagnostic Statistical Manual) classification system. As a result, it becomes harder to use practices that are difficult to standardize and evaluate, such as psychodynamic treatments. Discretion regarding the length of treatment is arguably also increasingly limited. Whereas, in the former system, each medical action resulted in a payment (this was not the case under the DRG-policy). Under the DRG-policy, a standard rate is determined for each disorder, meaning it has become more difficult to adjust the treatment to the specific patient needs. Hence, the number of treatments for a patient is often limited due to the DRG-policy, thereby changing service delivery. It is interesting to study how much discretion street-level bureaucrats really experienced during implementing this policy, and what effects this has.
We noted that we focus on experienced discretion. Even within the same policy, some street-level bureaucrats will perceive more discretion than others. Indeed, in the open answers of the survey we witnessed that some respondents felt that they had substantial discretion when implementing this policy, while others felt very limited. Illustrative quotes from different respondents are (all from open answers in the survey, which is reported next):
The DRG-policy does not force me into a certain choices. I examine the funding scheme of the treatment only ‘in second instance’.
I do my work first and foremost according to professional standards and hereafter just attach a DRG-label which I think fits but best.
With the DRG-policy, I am being forced into a straitjacket.
You are bound by the rules. So that’s a harness.
Sampling and response
Our sampling frame comprised of 5,199 professionals who were members of two nationwide mental health care associations (the Dutch Association of Psychologists (Nederlands Instituut van Psychologen (NIP)) and the Netherlands Association for Psychiatry (Nederlandse Vereniging voor Psychiatrie (NVvP)). They were all members of those associations which could, in principle, be working with the DRG-policy. Using an email and two reminders, we received 1,317 answers of our questionnaire, i.e. a 25 per cent response.
Our sampling frame comprised of high-status professionals: psychiatrists, psychologists, and psychotherapists. Most research analysing discretion focuses on traditional street-level bureaucrats, such as welfare workers and police officers (Maynard-Moody and Portillo [35]). However, these mental health care professionals are a specific group of highly trained professionals who traditionally, due to their professional training, have substantial autonomy. Furthermore, they also have to implement governmental policies (in this case, DRGs). Hence, it seems worthwhile to analyse such professional groups using the theoretical lens of street-level bureaucracy (see also Hupe and Hill [23]).
Of the valid respondents, 36 per cent were men and 64 per cent were women which is consistent with Dutch averages for mental health care professionals, where 69 per cent of the workforce are female (Palm et al. [42]). The respondents’ ages ranged from 23 to 91 years (M = 48), which is slightly older then the Dutch national average for mental health care professionals (M = 44). Hence, respondents’ mean age and gender distribution are quite similar to those of the overall mental health care sector. To rule out a possible non-response bias, we conducted non-response research where we contacted the non-responders for their reasons for non-participation. Common reasons for not participating were: lack of time, retirement, change of occupation, or not working with the DRG-policy. Some organizations, including some hospitals, were not yet working with this policy. The large number of respondents, their characteristics in terms of gender and age, and the results of the non-response research indicate that our respondents are quite a good representation of the population.
Measures
This section reports the measurement of the variables. Unless stated otherwise, the measures were formatted using five-point Likert scales, ranging from strongly agree to strongly disagree. For the items tapping discretion, client meaningfulness and willingness to implement, we used templates. Templates allow the researcher to specify an item by replacing general phrases with more specific ones that better fit the research context (DeVellis [12]). For example, instead of stating ‘the policy’ or ‘professionals’, the researcher can rephrase these items using the specific policy and group of professionals being examined. Here, ‘the DRG-policy’ and ‘health care professionals’ replaced the template terms. Items are therefore easier for professionals to understand, since items are better tailored to their context and this, in turn, increases reliability and content validity (DeVellis [12], p. 62). All items are shown in Appendix 1.
Discretion
Discretion concerns the perceived freedom of the implementer in terms of the type, quantity and quality of sanctions, and rewards delivered (Lipsky [29]). The scale is based on the validated measurement instrument of policy alienation, specifically the dimension ‘operational powerlessness’ (Tummers [57]). Three items were used based on confirmatory factor analysis (CFA; see section ‘Results’). Cronbach’s alpha = 0.78.
Client meaningfulness
Client meaningfulness (or meaninglessness) was also conceptualized as a dimension of policy alienation (Tummers [57]). It refers to the perception of professionals about the benefits of implementing the DRG-policy for their own clients. For instance, do they perceive that they are really helping their patients by implementing this policy? Three items were used based on CFA. Cronbach’s alpha = 0.77.
Willingness to implement
Willingness to implement was measured using Metselaar’s ([38]) four-item scale. All items were used based on CFA. Cronbach’s alpha = 0.83.
Control variables
Commonly used individual characteristics were included: gender, age, and management position (yes/no). We also distinguish between psychiatrists and others, because the former belong to a medical profession. Psychologists and psychotherapists are non-medical professionals, which possibly influenced their perceptions.
Statistical method
We used CFA followed by structural equation modelling (SEM). The CFA and SEM techniques are often used in psychology research, but quite new to most public administration scholars (see for instance Wright et al. [64]). We therefore discuss a number of the analyses’ characteristics in detail.
CFA is a technique used to test the factor structure of latent constructs based on theory and prior research experience. This is appropriate in our case given that prior analyses have already explored the variables discretion, client meaningfulness, and willingness to implement. It has several advantages over exploratory factor analysis, such as more stringent psychometric criteria for accepting models, thereby improving validity and reliability (Brown [ 7]).
Using CFA, a measurement model is specified. The measurement model specifies the number of factors and shows how the indicators (items) relate to the various factors (Brown [ 7], p. 51). Hence, it shows for instance how the items asked to measure discretion relate to the latent construct of discretion. This measurement model is a precursor for the SEM analysis. In the SEM analysis, a structural model is constructed showing how the various latent factors relate to each other. For instance, it shows how discretion is related to willingness to implement. In this analysis, a complete model can be tested where variables can be both dependent and independent. This is an advantage over regression analyses. Given that we hypothesize that client meaningfulness is both dependent (influenced by discretion) and independent (influencing willingness to implement), this was appropriate for our model. For mediation models, as is our model, SEM is preferred over regression analysis (Zhao et al. [65]).
The latent variable programme Mplus was used for the analyses (Muthén and Muthén, [40]). Mplus (http://www.statmodel.com/) is suited for handling non-normally distributed data, which is often the case when employing surveys. As our data were (mildly) non-normally distributed, this was an advantage. Robust maximum likelihood was used, which works well in these circumstances (Brown [ 7], p. 379).
Measurement model
Before analysing the structural model (see section ‘Results’), the measurement model is analysed.
Based on the analyses for the measurement model, some modifications were made to improve the model. The only modifications were to delete a number of items for the latent factors: three for discretion, one for client meaningfulness, and one for willingness to implement. This was based on theoretical grounds, fit of item content with definition of concept/latent factor, and the minimization of the Akaike information criterion (AIC). This fit index can be used to compare competing models. As suggested we selected the model with the lowest AIC, thereby taking into account theoretical plausibility (Schreiber et al. [52]). More specifics about the measurement model are described in Appendix 2.
RESULTS
Descriptive statistics
Table 1 shows the means and variances/covariances for all items used. A number of interesting results can be seen. First, many street-level bureaucrats are psychiatrists and these often occupy management positions. Next, the means for discretion are quite low, showing that the street-level bureaucrats do not feel that they have a lot of autonomy in this policy. We also found low scores for willingness to implement and even lower scores for client meaningfulness. Hence, in general, the street-level bureaucrats were quite negative about this policy. The covariances for the items linked via our hypotheses are in the anticipated direction. For example, items regarding willingness to implement are positively related to discretion.
1 Mean and variance/covariance matrix (variances on the diagonal)
Structural model
The structural equation model is shown in Figure 2.Table 2 shows the results, including control variables. First, an effect of discretion on client meaningfulness was found (standardized coefficient 0.33, p < 0.01). Hence, we do not reject Hypothesis 1. Second, the empirical tests show a cascading effect from discretion to willingness to implement through the mediating variable client meaningfulness. The effect (standardized coefficient) of discretion on client meaningfulness was 0.33 (p < 0.01), while the effect from client meaningfulness on willingness to implement was 0.49 (p < 0.01). The total indirect effect was therefore 0.16 (0.33*0.49, p < 0.01). Based on this, we do not reject Hypothesis 3. Furthermore, the direct effect was also significant (β = 0.27, p < 0.01), thus Hypothesis 2 is not rejected. The total effect of discretion on willingness to implement is the sum of its direct and indirect effects: 0.27 + 0.16 = 0.43. This means that – all other things being equal – when the perceived discretion of the street-level bureaucrat increases by 1, the willingness to implement increases by 0.43. As there is both a direct and an indirect significant effect, there is evidence of partial mediation which was also hypothesized. This (partially mediated) model proved to be a good fit of the data: root mean square error of approximation (RMSEA) = 0.04 (criterion ≤ 0.08), comparative fit index (CFI) = 0.97 (criterion ≥ 0.90), Tucker–Lewis index (TLI) = 0.96 (criterion ≥ 0.90).
2 Results from structural equation modelling
Model
Meaningfulness for clients (standardized scores)
Meaningfulness for clients (unstandardized scores)
Willingness to implement (standardized scores)
Willingness to implement (unstandardized scores)
Control variables
Gender
NS
NS
NS
NS
Age
−0.092
−0.006
NS
NS
Managing position
NS
NS
0.144
0.212
Psychiatrist
NS
NS
NS
NS
Direct influences
Discretion
0.330
0.334
0.278
0.302
Meaningfulness for clients
–
–
0.491
0.527
Indirect influence
Discretion via meaningfulness for clients
–
–
0.162
0.176
R2
0.135
–
0.446
–
Notes: NS = Not significant. All shown scores are significant at p < 0.01.
Graph: Figure 2: Structural equation model for relationships between discretion, client meaningfulness, and willingness to implement (control variables not shown)
To shed more light on the mediating mechanisms, we conducted additional SEM analyses to test the validity of two alternative models: a model without mediation and a model with full mediation. The model without mediation did not fit as adequately as the partially mediated model, given that the AIC was higher compared to the partially mediated model, and the fit indexes showed a worse fit. The fully mediated model also had a higher AIC, and worse scores on RMSEA, CFI, and TLI than the partially mediated model, although differences were small.
We used bootstrapping to test the indirect effect of discretion on willingness to implement via client meaningfulness. It is the preferred method for testing mediated effects (Preacher and Hayes [47]; Zhao et al. [65]). It presents estimates and confidence intervals so that we can test the significance of the mediation effect. The 99 per cent confidence interval for the standardized indirect effect (which was 0.16) is between 0.11 and 0.22, meaning the indirect effect is not equal to 0 (p < 0.01).[ 1] Hence, a mediation effect is clearly present here. In the discussion and conclusion, we discuss the implications of these results for both theory and practice.
CONCLUSION
The central goal of this article is to understand the mechanisms at work between discretion, client meaningfulness, and willingness to implement. Based on a literature review, a theoretical model was constructed linking discretion, client meaningfulness and willingness to implement. This model was tested in a survey among 1,317 mental health care professionals implementing a new policy. The model worked adequately in that discretion, together with conventional control variables, indeed partly explained client meaningfulness (R2 = 14 per cent). Furthermore, willingness to implement was indeed explained by discretion, client meaningfulness, and the control variables (R2 = 45 per cent). Fit criteria were very good for the measurement model and the structural model, thereby strengthening the reliability and validity of the study. As such, we can conclude that the approach worked satisfactorily and adds to the literature on street-level bureaucracy. Having reached this conclusion, we can summarize the results, highlight limitations, and develop a future research agenda on discretion.
We found that the discretion of street-level bureaucrats influences the willingness to implement in two ways. First, discretion influences client meaningfulness because street-level bureaucrats are more able to tailor their decisions and the procedures they have to follow to the specific situations and needs of their clients. Hence, discretion gives street-level bureaucrats the possibility to apply their own judgements when dealing with the needs and wishes of citizens. Our results strengthen the claim made by several authors that discretion could indeed have positive effects for clients (Handler [18]; May and Winter [31]).
At the same time, the positive effect that discretion has on the bureaucrat's perception of client meaningfulness can be seen as a condition for the second effect: more willingness to implement the policy. When street-level bureaucrats perceive that their work is meaningful for their clients, this strongly influences their willingness to implement it. This is in line with the notion that street-level bureaucrats want to make a difference to their clients' lives (Maynard-Moody and Musheno [34]). Furthermore, the results also point to another, more autonomous, effect that discretion directly influences willingness to implement; hence, discretion is inherently valued by bureaucrats.
The results have interesting implications for the theory and practice of policy implementation. From a theoretical point of view, it contributes to the long-lasting discussion about the validity of a more top-down or bottom-up perspective on policy implementation. Discretion indeed seems to have a positive effect on the effectiveness of policy programmes, as it reduces resistance. At the same time it adds to the legitimacy of the policy implementation process, because it enables street-level bureaucrats to meet the needs and wishes of citizens (in the eyes of the street-level bureaucrats). These implications of the findings are strengthened by the large-scale quantitative analysis and sophisticated techniques. The arguments that are put forward in the bottom-up perspective on the positive role that discretion plays in the effectiveness and democratic legitimacy of public policy programmes are being confirmed.
For practitioners, it is important to note that when drafting policy programme it can be beneficial to give the implementing street-level bureaucrats some (perceived) freedom to adjust the policy programme in order to be effective and legitimate. This has also important consequences for the role of performance and risk management in the implementation of these programmes. The central role that detailed performance indicators and risk reduction rules play in the implementation process often leads to a broad variety of detailed norms and guidelines that the street-level bureaucrats involved must obey (Power [46]).
Next to this, the results show that client meaningfulness, in itself, proved to be very important, something which is not often mentioned in the street-level bureaucracy literature or in more general management literature, which focuses often on influence, autonomy, and discretion (Green [16]; McGregor [36]; Sowa and Selden [54]; Spence Laschinger et al. [55]). For instance, Judson ([24]) argues that providing employees with influence is the most powerful lever in gaining acceptance for a change. However, given the results of this study, we urge practitioners and scholars to also consider the perceived meaningfulness of the policy for clients, rather than to restrict their focus on discretion and influence aspects.
This brings us to the limitations and future research suggestions. First, the results found could be dependent on this research context. This study addresses high status professionals: psychologists, psychiatrists, and psychotherapists. Furthermore, the specific policy context (DRG-policy, focused on cost-cutting and transparency) could influence the results. It would be interesting to conduct studies using the same theoretical model which focus on other groups of street-level bureaucrats who have other types of professional training or who are a part of government service bureaucracy. Related to this, an interesting venue for research would be to analyse cases which are more directly related to service delivery and less to service management. Here, stronger effects of discretion on client meaningfulness could be found. Furthermore, it would be worthwhile to analyse the developed model in a situation where there was in general high discretion, client meaninglessness and willingness to implement, contrary to the case analysed. Are the effects of discretion and client meaningfulness also important in such rather different policy contexts?
Second, further research could use multiple sources to measure the indicators, and measure new effects of discretion. It would be worthwhile to measure client meaningfulness by asking the clients themselves. Furthermore, other indicators could be linked to discretion, such as objective indicators such as the percentage of people getting a job when implementing re-integration policies. Does granting street-levelbureaucrats discretion in such a policy heighten the 'success' of such a policy? Linked to this, we should note that we have looked at only two possible positive effects of discretion. We have largely ignored its negative side, such as discrimination of clients or the ways discretion can break public trust (Sandfort [51]).
Third, future research could investigate other factors influencing client meaningfulness and willingness to implement, including other control variables. Scholars could, for instance, examine the influence of organizational factors such as the level of trust between professionals and management, incentive systems which promote or stymie implementing a policy or the way the policy has been implemented (top-down, bottom-up) within an organization. Next to this, personality characteristics could be taken into account, such as optimism, self-efficacy beliefs, and locus of control.
To conclude, this study provides important insights that help to understand the effects of granting street-level bureaucrats discretion in their work. It underscores the importance of studying discretion. Embracing and further researching this should prove to be a timely and productive endeavour for both researchers and practitioners alike.
Acknowledgement
The authors would like to thank the anonymous reviewers for their insightful comments on earlier versions of this article.
Appendix 1
Items used for the scales
As indicated in the main text, we used templates to specify the policy. Templates allow the researcher to specify an item by replacing general phrases with more specific ones that better fit the research context. Template words are underlined. The templates are in this case:
Policy: DRG-policy
Clients: Patients
Professionals: Health care professionals
Organization: Institution
Note: Item 4–5 (client meaningfulness) and Item 1–3 (discretion) are not used in the final model as they negatively influenced fit indices in the CFA.
Client meaningfulness
· 1. The policy is harmful for my clients' privacy
· 2. With the policy I can better solve the problems of my clients
· 3. The policy is contributing to the welfare of my clients
· 4. Because of the policy, I can help clients more efficiently than before
· 5. I think that the policy is ultimately favourable for my clients
Discretion
· 1. I have freedom to decide how to use the policy
· 2. While working with the policy, I can be in keeping with the client's needs
· 3. Working with the policy feels like a harness in which I cannot easily move
· 4. When I work with the policy, I have to adhere to tight procedures
· 5. While working with the policy, I cannot sufficiently tailor it to the needs of my clients
· 6. While working with the policy, I can make my own judgements
Willingness to implement
· 1. I intend to try to convince employees of the benefits the policy will bring
· 2. I intend to put effort into achieving the goals of the policy
· 3. I intend to reduce resistance among employees regarding the policy
· 4. I intend to make time to implement the policy
Appendix 2
Measurement model
This Appendix describes some additional reliability and validity checks on the measurement model. Several authors suggest reporting RMSEA, TLI and CFI statistics when describing model fit (Schreiber et al. [52]; Van de Schoot et al. [60]). The RMSEA – a widely recommended fit index which tests the absolute fit of the model – was 0.048. This indicates good fit as Hu and Bentler ([22]) suggest that values ≤0.06 indicate good fit (≤0.08 average fit). The Tucker–Lewis index (TLI) is a comparative fit index that compares the fit of the model with the baseline model. The TLI here was 0.98, which is considered excellent (≥0.90, better ≥0.95). The comparative fit index was 0.98 in our final model showing good fit (≥0.90, better ≥0.95). Note that – based on the recommendations of Hooper et al. ([21]) – we have not used correlated error terms.
In the final model, each item loaded significantly onto its appropriate latent variable. For instance, an item tapping discretion loaded onto the variable discretion. The values of the standardized factor loadings were all relatively high (minimum 0.51, maximum 0.91, average 0.75). This shows evidence of convergent validity: items that tap the same latent construct are related to each other (Kline [26]).
We should also discuss the possibility of common method variance. Self-reported data based on a single application of a questionnaire can result in inflated relationships between variables due to common method variance, i.e. variance that is due to the measurement method rather than the constructs themselves (Podsakoff and Organ [44]). Although a recent study showed that 'in contrast to conventional wisdom, common method effects do not appear to be so large as to pose a serious threat to organizational research' (Lance et al. [27], p. 450), we conducted a test to analyse whether common method bias was a major concern. We compared the three-factor structure (discretion, client meaningfulness, and willingness to implement) with a one-factor model. The fit indices show that the one-factor model had a much poorer fit than the three-factor model. The AIC was higher, and the RMSEA (0.16), CFI (0.58) and TLI (0.54) indicated much poorer fit. Hence, common method variance does not seem to be a major problem in this study.
Notes
Footnotes
1 1. Bootstrap 5,000 times, maximum likelihood estimation is used as robust maximum likelihood is not available for bootstrapping.
References
Ajzen, I.1991. The Theory of Planned Behavior. Organizational Behavior and Human Decision Processes, 50(2): pp179–211.
2 Barrick, M., Mount, M. and Li, N.2012. The Theory of Purposeful Work Behavior: The Role of Personality, Job Characteristics, and Experienced Meaningfulness. Academy of Management Review, 38(1): pp132–53.
3 Berkman, M. and Plutzer, E.2010. Evolution, Creationism, and the Battle to Control America's Classrooms, Cambridge: Cambridge University Press.
4 Brehm, J. and Gates, S.1999. Working, Shirking, and Sabotage: Bureaucratic Response to a Democratic Public, Ann Arbor, MI: University of Michigan Press.
5 Brehm, J. and Hamilton, J. T.1996. Noncompliance in Environmental Reporting: Are Violators Ignorant, or Evasive, of the Law?. American Journal of Political Science, 40(2): pp444–77.
6 Brodkin, E. Z.1997. Inside the Welfare Contract: Discretion and Accountability in State Welfare Administration. The Social Service Review, 71(1): pp1–33.
7 Brown, T. A.2006. Confirmatory Factor Analysis for Applied Research, London: The Guilford Press.
8 Buffat, A.2011. Pouvoir Discrétionnaire Et Redevabilité De La Bureaucratie De Guichet: Les Taxateurs D'une Caisse De Chômage Comme Acteurs De Mise En Oeuvre, Lausanne: Université de Lausanne.
9 Davis, K. C.1969. Discretionary Justice: A Preliminary Inquiry, Baton Rouge, LA: Louisiana State University Press.
Deci, E. L. and Ryan, R. M.2004. Handbook of Self-Determination Research, Rochester: University of Rochester Press. NY:
DeLeon, P. and DeLeon, L.2002. What Ever Happened to Policy Implementation ? An Alternative Approach. Journal of Public Administration Research and Theory, 12(4): p467
DeVellis, R. F.2003. Scale Development: Theory and Applications, Thousand Oaks, CA: Sage.
Evans, T.2010. Professional Discretion in Welfare Services: Beyond Street – Level Bureaucracy , London: Ashgate.
Ewalt, J. A. G. and Jennings, E. T.2004. Administration, Governance, and Policy Tools in Welfare Policy Implementation . Public Administration Review, 64(4): pp449–62.
Freidson, E.2001. Professionalism: The Third Logic, Cambridge: Cambridge University Press.
Green, F.2008. "Work Effort and Worker Well-Being in the Age of Affluence". In Effects of Working Hours and Work Addiction: Strategies for Dealing with Them, Edited by: Burke, R. and Cooper, C. L.pp115–36.. London: Elsevier.) '' in (eds)
Hackman, J. R. and Oldham, G. R.1980. Work Redesign, Reading, MA: Addison Wesley.
Handler, J. F.1990. Law and the Search for Community, Philadelphia, PA: University of Pennsylvania Press.
Hill, M. and Hupe, P.2009. Implementing Public Policy , 2nd ed., Thousand Oaks, CA: Sage.
Hood, C.1991. A Public Management for All Seasons. Public Administration, 19(1): pp3–19.
Hooper, D., Coughlan, J. and Mullen, M.2008. Structural Equation Modelling: Guidelines for Determining Model Fit. Electronic Journal of Business Research Methods, 6(1): pp53–60.
Hu, L. and Bentler, P. M.1999. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria Versus New Alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1): pp1–55.
Hupe, P. and Hill, M.2007. Street – Level Bureaucracy and Public Accountability. Public Administration, 85(2): pp279–99.
Judson, A. S.1991. Changing Behavior in Organization: Minimizing Resistance to Change, Cambridge, MA: Basil Blackwell.
Kimberly, J. R., De Pouvourville, G. and Thomas, A. D. A.2009. The Globalization of Managerial Innovation in Health Care, Cambridge, MA: Cambridge University Press.
Kline, R. B.2010. Principles and Practice of Structural Equation Modeling, London: The Guilford Press.
Lance, C. E., Dawson, B., Birkelbach, D. and Hoffman, B. J.2010. Method Effects, Measurement Error, and Substantive Conclusions. Organizational Research Methods, 13(3): pp435–55.
Lewin, K.1936. Principles of Topological Psychology, New York: McGraw-Hill.
Lipsky, M.1980. Street – Level Bureaucracy , New York: Russell Sage Foundation.
May, D. R., Gilson, R. L. and Harter, L. M.2004. The Psychological Conditions of Meaningfulness, Safety and Availability and the Engagement of the Human Spirit at Work. Journal of Occupational and Organizational Psychology, 77(1): pp11–37.
May, P. J. and Winter, S. C.2009. Politicians, Managers, and Street – Level Bureaucrats: Influences on Policy Implementation . Journal of Public Administration Research and Theory, 19(3): p453
Maynard-Moody, S. and Musheno, M.2000. State Agent or Citizen Agent: Two Narratives of Discretion . Journal of Public Administration Research and Theory, 10(2): p329
Maynard‐Moody, S. and Musheno, M.2012. Social Equities and Inequities in Practice: Street ‐ Level Workers as Agents and Pragmatists. Public Administration Review, 72(s1): pp16–23.
Maynard-Moody, S. and Musheno, M. C.2003. Cops, Teachers, Counselors: Stories From the Front Lines of Public Service, Ann Arbor, MI: University of Michigan Press.
Maynard-Moody, S. and Portillo, S.2010. " Street – Level Bureaucracy Theory". In Oxford Handbook of American Bureaucracy , Edited by: Durant, R.pp. 252–77.. Oxford: Oxford University Press.) '' in (ed)
McGregor, D.1960. The Human Side of Enterprise, New York: Wiley.
Meier, K. J. and O'Toole, L. J.2002. Public Management and Organizational Performance: The Effect of Managerial Quality. Journal of Policy Analysis and Management, 21(4): pp629–43.
Metselaar, E. E. (1997) Assessing the willingness to change: Construction and validation of the DINAMO. Doctoral dissertation, Free University of Amsterdam.
Meyers, M. K. and Vorsanger, S.2003. " Street – Level Bureaucrats and the Implementation of Public Policy ". In Handbook of Public Administration, Edited by: Guy Peters, B. and Pierre, J.pp245–54. London: Sage.) '' in (eds)
Muthén, L. and Muthén, B.1998–2010. Mplus User's Guide, 6th ed., Los Angeles, CA: Muthén & Muthén.
O'Toole, L. J.2000. Research on Policy Implementation : Assessment and Prospects. Journal of Public Administration Research and Theory, 10(2): pp263–88.
Palm, I., Leffers, F., Emons, T., Van Egmond, V. and Zeegers, S.2008. De GGz Ontwricht: Een Praktijkonderzoek Naar De Gevolgen Van Het Nieuwe Zorgstelsel in De Geestelijke Gezondheidszorg, Den Haag: SP.
Palumbo, D. J., Maynard-Moody, S. and Wright, P.1984. Measuring Degrees of Successful Implementation . Evaluation Review, 8(1): pp45–74.
Podsakoff, P. M. and Organ, D. W.1986. Self-Reports in Organizational Research: Problems and Prospects. Journal of Management, 12(4): pp531–44.
Polsky, A. J.1993. The Rise of the Therapeutic State, Princeton: Princeton University Press. NJ:
Power, M.1997. The Audit Society: Rituals of Verification, Oxford: Oxford University Press.
Preacher, K. J. and Hayes, A. F.2004. SPSS and SAS Procedures for Estimating Indirect Effects in Simple Mediation Models. Behavior Research Methods, 36(4): pp717–31.
Prottas, J. M.1979. People Processing: The Street – Level Bureaucrat in Public Service Bureaucracies , Lexington, MA: Lexington Books.
Riccucci, N. M.2005. How Management Matters: Street – Level Bureaucrats and Welfare Reform, Georgetown: Georgetown University Press.
Saetren, H.2005. Facts and Myths About Research on Public Policy Implementation : Out‐of‐Fashion, Allegedly Dead, but Still Very Much Alive and Relevant. Policy Studies Journal, 33(4): pp559–82.
Sandfort, J. R.2000. Moving Beyond Discretion and Outcomes: Examining Public Management From the Front Lines of the Welfare System. Journal of Public Administration Research and Theory, 10(4): pp729–56.
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A. and King, J.2006. Reporting Structural Equation Modeling and Confirmatory Factor Analysis Results: A Review. The Journal of Educational Research, 99(6): pp323–38.
Simon, W. H.1987. Ethical Discretion in Lawyering. Harvard Law Review, 101(6): pp1083
Sowa, J. E. and Selden, S. C.2003. Administrative Discretion and Active Representation: An Expansion of the Theory of Representative Bureaucracy . Public Administration Review, 63(6): pp700–10.
Spence Laschinger, H. K., Finegan, J. and Shamian, J.2001. The Impact of Workplace Empowerment, Organizational Trust on Staff Nurses' Work Satisfaction and Organizational Commitment. Health Care Management Review, 26(3): p7
Tummers, L. G.2011. Explaining the Willingness of Public Professionals to Implement New Policies : A Policy Alienation Framework. International Review of Administrative Sciences, 77(3): pp555–81.
Tummers, L. G.2012. Policy Alienation of Public Professionals: The Construct and Its Measurement. Public Administration Review, 72(4): pp516–25.
Tummers, L. G., Bekkers, V. J. J. M. and Steijn, A. J.2009. Policy Alienation of Public Professionals: Application in a New Public Management Context. Public Management Review, 11(5): pp685–706.
Tummers, L. G., Steijn, A. J. and Bekkers, V. J. J. M.2012. Explaining Willingness of Public Professionals to Implement Public Policies : Content, Context, and Personality Characteristics. Public Administration, 90(3): pp716–36.
Van de Schoot, R., Lugtig, P. and Hox, J.2012. A Checklist for Testing Measurement Invariance. European Journal of Developmental Psychology, 9(4): pp37–41.
Vinzant, J. C., Denhardt, J. V. and Crothers, L.1998. Street – Level Leadership: Discretion and Legitimacy in Front-Line Public Service, Washington, DC: Georgetown University Press.
Wagner, J. A.1994. Participation's Effects on Performance and Satisfaction: A Reconsideration of Research Evidence. Academy of Management Review, 19(2): pp312–30.
Winter, S. C.2007. " Implementation Perspectives, Status and Reconsideration". In The Handbook of Public Administration, Concise Paperback Edition, Edited by: Guy Peters, B. and Pierre, J.pp131–141. New York: Sage.) '(eds)
Wright, B. E., Moynihan, D. P. and Pandey, S. K.2012. Pulling the Levers: Transformational Leadership, Public Service Motivation, and Mission Valence. Public Administration Review, 72(2): pp206–15.
Zhao, X., Lynch, J. G. and Chen, Q.2010. Reconsidering Baron and Kenny: Myths and Truths About Mediation Analysis. Journal of Consumer Research, 37(2): pp197–206.
~~~~~~~~
By Lars Tummers and Victor Bekkers
Reported by Author; Author
Lars Tummers is Assistant Professor in Public Management and Public Policy at the Erasmus University Rotterdam. His research focuses on policy implementation, public leadership, and public innovation. He developed the innovative concept of 'policy alienation', which can be used to examine the problems the civil servants experience during policy implementation. This is shown in his new book: Policy Alienation and the Power of Professionals: Confronting New Policies (Edward Elgar, 2013).
Victor Bekkers is Professor of Public Administration at the Erasmus University of Rotterdam and dean of the Erasmus Graduate School of Humanities, Social & Behavioural Sciences. He is also academic director of the Centre of Public Innovation. His chair concentrates on the empirical study of public policy and public policy processes. His research interests are related to the introduction and use of new information and communication technologies in policy processes within public administration and the innovation challenges which emerge in its slipstream.