Showing posts with label selection. Show all posts
Showing posts with label selection. Show all posts

Friday, March 4, 2016

Laboratory Evidence of the Effects of Sponsorship on the Competitive Preferences of Men and Women

Many competitive career fields exhibit a gender gap in advancement. While entry cohorts may be balanced, there are far fewer women than men in senior positions. Sponsorship has become an increasingly popular solution to this gender gap. While mentors provide guidance and emotional support, sponsors go a step further. Sponsors take an active stake in their protégé’s success and advocate for their advancement. If their protégé is successful, both the protégé and sponsor benefit. Observational evidence indicates that sponsorship increases competitiveness, risk taking, and confidence among protégés. However, there is little direct evidence about the effects of sponsorship, and the evidence that does exist may suffer from a selection bias. It could be that the best employees are the ones that are most likely to be sponsored, but these individuals would have been successful without sponsorship. This selection problem is difficult to disentangle based on real-world data alone!

In this week’s WAPPP seminar, Professor Katherine Coffman discussed her research on a lab experiment designed to isolate the effectiveness of two key features of sponsorship. (Professor Coffman is being heavily recruited for a position at HKS, so we’re hoping that she enjoyed the talk as much as we did!) While working in a lab setting allows researchers to resolve the selection problem, it does narrow the focus to certain measurable aspects of sponsorship. In this case, Professor Coffman focused on what she calls the Belief Channel – that being sponsored is a vote of confidence in the protégé’s abilities that may increase their competitiveness – and the Payment-Tying Channel, which illustrates the link between the protégé’s success and the sponsor’s. These two features, competitiveness and earnings, are important for real-world outcomes, are easy to incentivize, and are easy to measure in a lab setting. It could be that the observed positive effects of sponsorship are due to something other than these two factors. However, if we see an effect of the Belief Channel and the Payment-Tying Channel, we may want to formalize these in sponsorship programs.

Professor Coffman’s experimental design parallels a famous study on competitiveness. Participants go through four rounds of a basic math task. In each round, they are given four minutes to solve as many addition problems as possible. The incentives for solving these problems vary across each of the rounds. In the first round, participants receive 50¢ for each problem they solve correctly. In the second round, researchers compare the performance of each participant. The top 25% earn $2 per problem solved, while the bottom 75% get nothing.

In round 3, participants get a series of choices about their incentives for the round. Over 9 binary-choice questions, participants are asked whether they’d rather get a guaranteed 50¢ per solved problem, or whether they’d rather get a certain dollar amount per problem for being in the top 25%. By varying the dollar amount, researchers are able to see what incentive level is enough to get participants to opt into the riskier competition-style incentive. Critically, participants have not gotten feedback on their performance in round 1 and round 2 and don’t know whether they placed in the top 25% in round 2.

Up to this point, all participants have had the same experience. After round 3, three participants are chosen at random to be sponsors, and all other participants become potential protégés. The key challenge here is balancing the selection effect (maybe only the best are chosen to be sponsored) with wanting sponsorship to be a meaningful vote of confidence. Professor Coffman strategically addressed this problem by creating a series of “matched pairs” for sponsors to choose from. This way, the sponsored and unsponsored groups had relatively equal ability, but the impact of being “chosen” was still meaningful.

All in all, there were four protégé treatments:

  • Belief Signal participants were chosen by sponsors, but their sponsors did not earn money based on their performance.
  • Payment-Tying participants were randomly assigned to a sponsor, but the sponsors earned 25¢ for every problem their protégé answered correctly if their protégé chose to compete and was in the top 25%.
  • Belief Signal and Payment-Tying participants were chosen by sponsors, and their sponsors earned money based on the protégé’s performance. 
  • Unsponsored participants were either never presented to a sponsor to be chosen or were not chosen by a sponsor. 

Participants were then asked to repeat the procedure from round 3—making a series of judgments about the necessary wage rate for them to opt into competition and then completing the task. The researchers examined differences in competitiveness and performance between rounds 3 and 4 to better understand the effects of sponsorship.

The three key metrics in the findings were the cutoff, the lowest wage at which a person was willing to compete, their performance, and their earnings.

In round 3, the average men's cutoff was $1.86, compared to $2.02 for women, which indicates a greater appetite for competition for men. Indeed, men were more willing to compete than women at every given wage rate. Men also outperformed women in round 3, solving about one more problem on average. As such, men outearned women in round 3 (average $11.25 versus $7.94). Conditional on performance, men outearned women by $1.03, which suggests that 1/3 of the gender gap is driven by choices about competition rather than performance.

In round 4, the unsponsored exhibited a smaller gender gap than in round 3. However, for each of the sponsored groups, the gender gap grew wider in round 4 than in round 3. While each group decreased their cutoff by about 20 cents, which shows that they became more willing to compete, cutoffs changed more for men than for women. Indeed, sponsorship increases the gender gap from 13¢ in round 3 to 37¢ in the Belief Signal group, 27¢ in the Belief Signal and Payment-Tying group, and 44¢ in the Payment-Tying group.

What makes this gender gap bigger? Sponsorship is intended to encourage talented but underconfident participants to make more competitive choices. It could be that this version of sponsorship isn’t having the intended effect for this target population. To test this, Professor Coffman examined participants’ beliefs about their abilities in rounds 3 and 4.

In the baseline data, both men and women are somewhat overconfident. More than half of men rate themselves in the top quartile! (In fairness, so do 34% of women). In general, the confidence gap between men and women is driven by women being underconfident, more likely to rate themselves below their true ability level.

Sponsorship treatments with the Belief Signal, the vote of confidence that a sponsor chose you, do increase participants’ confidence. Compared to the unsponsored groups, participants in the Belief Signal group rank themselves 0.2 quartiles higher, and participants in the Belief Signal and Payment-Tying Group rank themselves 0.17 quartiles higher. These changes in beliefs don’t vary with gender—everyone reacts to a vote of confidence in a similar way.

However, the group that was most likely to change their willingness to compete in round 4 was overconfident men. Women showed very little movement in their willingness to compete, whether they were overconfident, properly calibrated, or underconfident. This finding is a bit discouraging—improving confidence doesn’t impact those who need it most, but instead concentrates on those who already have plenty of confidence.

Professor Coffman also examined the effect of the sponsorship treatment on performance. In the real world, sponsorship is intended to have the biggest impact on the best performers. However, in this data, the strongest increase in willingness to compete came from men in the bottom three quartiles. There was very little change in willingness to compete for top-quartile men or for women at any performance rank. Participants in a Payment-Tying condition showed additional increases in their performance: having their sponsor’s compensation tied to their performance provides an additional incentive to do well. For women, the effect on performance was small, but for men it was significant. Not only was this group more willing to compete, but they were also improving their performance. This improvement in performance increased men’s earnings, while women’s earnings were not significantly impacted by any sponsorship treatment.

Sponsorship, therefore, is mainly reaching overconfident, low-ability men, and in this lab setting sponsorship fails to close the gender gap in competitiveness or earnings. Talk about unintended effects! The key takeaway, according to Professor Coffman, is that we’re not studying the parts of sponsorship that really matter for women. Other channels (like access to professional networks or sponsor advocacy in promotional meetings) may have a much greater impact. What features of sponsorship programs haven’t been examined that may be critical for closing gender gaps?

Friday, February 12, 2016

New Evidence Against a Causal Marriage Wage Premium

“It is a truth universally acknowledged, that a single man in possession of a good fortune must be in want of a wife.” Or is a man with a wife more likely to earn a good fortune? Many social scientists have observed a “marriage premium” for men, where their wages increase with marriage. Some policymakers have tried to encourage marriage in order to increase social welfare. But is the relationship between marriage and higher pay causal? In this week’s WAPPP seminar, Professor Alexandra Killewald, John L. Loeb Associate Professor of the Social Sciences at Harvard University, discussed her work casting doubt on the causal marriage wage premium.

The most common explanation for the marriage premium is specialization. Once married, the theory goes, couples are able to divide up the work that they previously had to do alone. If one partner is particularly good at laundry but terrible at doing the dishes, they can do laundry while their partner does the dishes. This division of labor is an efficient use of each partner’s talents and cuts down on the overall time spent doing housework. In Gary Becker’s original theory, men were thought to have a comparative advantage for work outside the home, while women specialized in domestic work. Adjusting for these specializations meant that married men would spend more time on paid labor, which would increase their wages.

However, there are many other possible explanations for the marriage premium. Professor Killewald focused on two: the reverse causation explanation and the transition to adulthood explanation. It could be that causation between marriage and higher wages actually works in reverse. Men anticipating marriage may seek out better-paying jobs to enhance their financial stability before they get married. Alternatively, it could be that most adults get married in a period of great personal growth in many areas, including work. Wage increases and marriage may be two entirely separate phenomena that tend to happen around the same time, which leads us to infer causation.

Using data from the NLSY79, a representative sample of individuals who have been surveyed from 1979 through the present day, Professor Killewald set out to empirically adjudicate between these competing explanations. She presented four tests for our three proposed explanations. However, she noted, it was unlikely that we would discover one perfect alternative explanation for the observed marriage premium. Instead, this work is meant to question the presumed causal relationship that marriage leads to higher wages.  

Test 1: How far in advance of marriage do wages increase?

If the causal marriage wage premium existed, we would expect a sharp spike in wages immediately after marriage. On average, men’s wages increased starting five years before marriage, continued to increase for three years after marriage, and then flattened out. This pattern seems to rule out specialization, as we don’t see a shift in wages at the point of marriage. (Similarly, the timeline for increasing wages doesn’t fit with discrimination: if employers were inclined to pay married men more than unmarried men, it is unlikely that we’d see that effect beginning five years before marriage!) Instead, this pattern fits much better with a reverse causation argument—that men seek out high-paying jobs in anticipation of marriage—or a transition to adulthood explanation, as a young man’s wages increase from the early stages of his career, around the same time he chooses to marry.

Test 2: What happens around divorce?

If marriage causally affected wages, we would expect to see a decline in wages immediately after divorce. Instead, wages begin to decrease about 1-2 years prior to divorce and continue to decrease thereafter. This evidence is most consistent with a reverse causation argument: anticipating divorce may mean that financial stability isn’t as important, so men are more willing to take on riskier jobs with lower pay. Alternatively, a decrease in financial stability may be a key factor leading to divorce.

Test 3: Does age of marriage matter?

Based on a causal argument, we would expect wages to increase with marriage regardless of timing. By contrast, a reverse causal or transition to adulthood explanation would predict that wages increase the most for those who get married young. Splitting the data into three groups, we find large wage increases for men who get married at 22 or under and from 23-26. However, men who marry at age 27+ show very little change in wages. At minimum, this suggests that anticipation of marriage doesn’t help men who get married late, and lends some support to the transition to adulthood hypothesis.

Test 4: What about shotgun weddings?

The reverse causal explanation rests on men anticipating marriage and seeking out higher-paying jobs ahead of time. But what about marriages that are less likely to be anticipated? Professor Killewald examines marriages in the dataset where the couple’s first child was born within seven months of the wedding. In this data, we still see a wage increase in the years leading up to marriage even when the marriage was not anticipated. This is consistent with the transition to adulthood hypothesis rather than either of the causal theories.

Based on these four tests, the evidence provides support for the reverse causal explanation and particularly for the transition to adulthood hypothesis. None of these tests validated the causal specialization explanation: being and staying married is not directly related to higher wages for men. This study should make us cautious about using marriage as a policy lever.