Analysing the value of Draft-Day Trades in the NFL

One of the most exciting and hotly debated topics at every NFL Draft is the trading of picks. Teams will make these trades for many reasons: moving up before the draft starts to get a Quarterback i.e. The Rams and Eagles, or jumping ahead a few picks to ensure that the apple of the GM’s eye doesn’t get taken just before their selection. For this reason, understanding the value of a certain pick number could really benefit a decision maker for an NFL team, and help take away the bias in every GM’s head that they are intrinsically better at picking than everyone else. This article will use similar methods to my article analysing the benefits of tanking in the NBA, but will instead focus on the value of a particular pick than whether or not the top picks lead to winning. Fair warning seeing as this is a basketball site: This is about the NFL. You have been warned.

The first thing that needs to be done when quantifying the value of historical picks is determining what metric should be used for evaluating players. Using yards or touchdowns would work for only skill-position players and tackles might work for defensive players, but we’d have no way of comparing between positions, and stats for offensive linemen are almost non-existent. Career earnings might be an effective measuring stick but this is already skewed by scaled rookie contracts and has no way of accounting for a player who fails to live up to their second contract. Pro-bowls and All-Pro selections might work, but these don’t tell the whole story, as a player can be greatly valuable to their team without earning any pro-bowl selections. Luckily, pro-football-reference has thought about this problem before, and devised their own method for measuring the career value of players called Approximate Value (AV). You can read about how it’s developed here. It properly accounts for many factors that end up with an accurate assessment of a player’s value.

Click here to view interactive versions of all of the tables which follow, as well as access the source data or download the workbook yourself.

The first and most simple relationship to look at is Approximate Value vs Pick position. The following graph will contextualise the availability of talent over the course of the draft, with every player drafted since 1996 being used as the sample size for this investigation.

Screenshot 2016-05-09 15.34.50

It’s clear that the best players mostly go at the top of the draft, which is a good thing. We also see the number 1 pick adding the most value, which is a reasonable result, seeing as it’s the best pick to find a home-run hall-of-fame talent. We can also see that there are a lot of excellent players that get drafted deep into the final day of the draft, stories which most of us have probably heard about. However, there isn’t a great deal that can be taken from this graph because it is an absolute mess. We can’t simply attribute the value of each pick to its average AV, because it would be ignorant to say that the 199th pick is more valuable than the 80th pick because of a few lucky players including Tom Brady. We need some way of removing the outliers and looking at the sort of player you can expect to draft at a particular position.

The best way to do this is to instead look at the median AV for each pick position. This removes the outliers which are busts and steals. It also provides a great measure for the expected AV from a particular pick because 50% of historical picks were better than the median, and 50% were worse.

Screenshot 2016-05-12 10.10.38

We now see that we have a much less noisy graph from which we can gather some more information. Obviously there is still a lot of noise, as we have a fairly bumpy line, but with a simple trend line which has been plotted in grey, we have developed a formula which estimates the expected AV of a particular pick. A polynomial formula was chosen as it provided the best fit with the relatively high value of early picks and the steadily decreasing value of late round picks, finally tapering off to 0 with the so-called irrelevant picks at the end of the draft. The formula is of the n^3 type and is a bit messy, but looks like this:

Approximate Pick Value = -6.60394e-06*Pick^3 + 0.00362413*Pick^2 + -0.670325*Pick + 45.424

We also need to develop an estimate for the value of future draft picks, because we don’t know where a team’s pick will fall until the conclusion of the next season. By simply taking the median AV for all players selected in a particular round, we can get a fair approximation for the value of future picks. The main weakness of this calculation is that it includes supplementary picks at the end of particular rounds, which are not included in future trades, which would slightly negatively affect the value of particular rounds. But the effect is almost negligible due to the randomness of all picks.

Screenshot 2016-05-12 10.33.54

We see a similar shape to the pick-by-pick graph, so we know this is a reasonable graph. From here we are able to reasonably approximate the value gained or lost for some of the biggest trades in the 2016 draft.

The two that are most meaty to analyse are the trades made by the Rams and the Eagles to move up to the top of the draft to select Jared Goff and Carson Wentz. in the Goff trade that was completed first, the Rams received: 2016 – #1, #113, #177, and the Titans received: 2016 – #15, #43, #45, #76 and 2017 – 1st round, 3rd round.

Rams Receive: Pick Value
2016, #1 44.75729252606
2016, #113 6.42498575582
2016, #177 3.69645775198001
Total Value 54.87873603386
Titans Receive: Pick Value
2016, #15 36.1622659525
2016, #43 22.77598191242
2016, #45 21.9964542175
2016, #76 12.51330371456
2017, Round 1 36
2017, Round 3 10
Total Value 139.44800579698

So one can conclude that the Rams sacrificed 139.45 points of value to the Titans in return for 54.88 points of value. Now that’s not to say that the Rams strictly lost 85 points of value, all of this is entirely dependent on the specific situation a team is facing with regards to their roster. From the Ram’s point of view, they already have a pretty stacked roster everywhere outside of the Quarterback, so for them, adding a bunch of players at positions that they already have would suggest those players are less likely to add a lot of value to the Rams. Additionally, they’re expected to add 44.8 points of value with one player, their rookie quarterback, which is exactly the hole in the roster they need filled. So from the Rams perspective, it might be worth it to sacrifice 140 points of AV in return for 44.8 points of AV at one spot in the roster that needs filling. From the Titan’s perspective, however, this is an absolute slam dunk. Gaining a net 85 points of AV is a huge haul, which could turn into some very valuable players.

Let’s look at the other big trade of the offseason, the Eagles trading up with the Browns to select Carson Wentz.

Eagles Receive: Pick Value

2016, #2

44.09779368848

2017, Round 4

7

Total Value

51.09779368848

Browns Receive: value

2016, #8

40.28996310272

2016, #77

12.28152522998

2016, #100

8.02886

2017, Round 1

36

2018, Round 2

21

Total Value

117.6003483327

This trade isn’t as lopsided as the trade for the number 1 pick, which isn’t a big surprise considering the perceived greater value of the number 1 pick. However, it’s a considerable haul for the browns who have the opportunity to add 3 players with +20 AV. There’s plenty of picks which could be analysed, including countless draft-day trades where teams move up a couple of spots, most of which are not that interesting. For that reason, I created a spreadsheet that quickly calculates the AV traded in a particular swap of draft picks, which can be found here. Simply download your own version to edit the highlighted input areas and see how your team fared on draft day when it came to trades.

My analysis to this point has simply been on the amount of expected total value added or lost in a particular trade, but this somewhat misses the essence of trading draft picks for half of the league. While total AV is a great measure for teams looking to improve their entire roster like the Titans or Browns, it overlooks the desires of a team aiming to move up in the draft like the Eagles or Rams. For them, they’re more interested in trading a lot of players with reasonable AV for one player to fill one spot on the roster with as much AV as possible. For this reason, I thought it necessary to add another element of analysis to the calculus for trading picks.

While simply looking at which team got the pick with the highest estimated AV might provide some clarity here, it doesn’t tell the full story. It might be that a team moves up for the number 1 pick but in turn gives up a couple of picks which, combined, give a better chance at picking up a Pro-Bowl calibre player. The way to properly investigate this is to take the distribution of players which can be taken with a certain pick, by measuring the standard deviation of AV taken at a certain pick. Then, one can calculate the odds that a particular pick will result in a player with AV greater than a certain amount, say 60 AV (which is roughly the minimum value for an All-Pro player). Then, by taking the probability for all of the traded picks, one can quite easily calculate the odds that one of the picks turns into a +60AV player. Using this calculation, one can take another look at the two biggest trades analysed earlier and see if it more accurately reflects what the Eagles and Rams were aiming to gain from the trade.

In the Rams/Titans trade for the number 1 pick, it was pretty clear that the Titans pulled off an absolute heist when it came to total AV, which was their goal, as they need to put as much talent as possible around Marcus Mariota moving forward. But if we look at the odds of either team earning themselves a pro-bowl talent, the story changes slightly.

AV Titans Rams
total 139.4480058 57.2120127
40 0.7681549095 0.5579975043
50 0.5086942213 0.4446985388
60 0.3091670338 0.3405035364
70 0.1912181388 0.2478980144
80 0.1198511853 0.170811554
90 0.07298295843 0.1110815966
>100 0.04217354009 0.06802947466

We see that when it comes to gaining a player with AV greater than 40 or 50, the titans are still in front, which is expected, as these are scores for quality starters, the type of players the Titans were looking to add. But for earning a player with AV greater than 60, the ledger swings in favour of the Rams, who have increased their chances of finding themselves an All-Pro level talent at Quarterback. So it would seem that both the Rams and Titans have achieved their goal with the trade.

Now let’s look at the Carson Wentz trade, and see if we see a similar result with the Eagles.

AV Eagles Browns
total 51.09779369 117.6003483
40 0.5838220646 0.8030838151
50 0.421429454 0.579078266
60 0.2770324051 0.3653103498
70 0.1645533065 0.218933875
80 0.08754859688 0.1308536876
90 0.04140852509 0.0769407191
>100 0.01731490997 0.04345448672

Bad news for Eagles fans, your team got fleeced in the trade. Not only do the Browns pick up more total AV than the Eagles, but they also happen to have a higher chance of their picks turning into a difference maker. This demonstrates the reason why the Browns would be willing to gain less total AV from the trade, compared with the number 1 pick, because they seem to be aware of the fact that they’re gaining more picks that could be difference makers in the NFL. Aside: Normally with results like this I assume that the decision makers had their own reasons and opinions that happen to coincide with an analytical view-point, but given that the Browns have hired Paul DePodesta as Chief Strategy Officer, pioneer of moneyball in the MLB, I have a sneaky feeling that the Browns’ decision makers were looking at almost exactly the same numbers as I have here when deciding to accept the Eagles’ trade offer. Most likely they had a differing strategy to valuing picks than AV, but it no doubt would have yielded similar results.

There were dozens of other trades that went down on draft day that are worth looking, but it’s not worth putting them all in this article, so I encourage readers to play around with the spreadsheet here and see how the numbers shape up with the analysts’ opinions on the trades. There are a lot of unique situations to play around with, like teams moving up a couple of spots which has mixed results. Overall it appears to be that the negotiation skills of GMs can have a great swing on how much value a team earns in the trading process, as well as teams that are in the fortunate position of not needing to make blockbuster deals to stay competitive, i.e. the Packers, Steelers, Patriots or Cardinals. Overall, this tool should serve as one more method for evaluating the success of the trading of picks. Additionally, if any GMs are reading this, feel free to use the model to your advantage.

  • An Article By Jack Neubecker
  • Read about a similar article on tanking in the NBA
  • Read about how AV was developed here
  • Click here for interactive versions of the graphs used or to download the data
  • Use the interactive Spreadsheet to experiment with other trades
  • Statistics sourced from pro-football-reference

Who Are the Best 3 Point Shooters?

The 3 point shot is quickly becoming one of the most important plays to perfect on the offensive end. Coaches are beginning to realise the untapped potential of the long-range shot, and are starting to focus more of their offensive plays on getting good shooters open for 3 point shots, especially in the corner, which is becoming the most efficient play in basketball. Players are spending more time practicing the 3 point shot, and we’re seeing a lot more 4s and 5s working on the craft and floating around the perimeter, an almost unheard-of concept only a decade ago.

The league average for 3 point shots in the 2015-16 season was 35.4%, for an expected points per attempt of 1.062, vs the 2 point shot which is made at a league average of 49.1%, for expected points per shot of 0.982. The concept of Nash Equilibrium would suggest that there is an inefficiency in the shot selection of offenses, so we can only expect 3 point attempts to increase in the future. For those who don’t know, Nash Equilibrium is the idea that strategy selections in a game will eventually even out as better strategies are chosen more by players, and countered more often by their opponents. Applied to basketball, it suggests that offenses will continue to shoot more 3s, and defenses will focus more attention to 3s, until the expected points for 3s v 2s is the same, a state of equilibrium. For this reason, a good understanding of where these extra shots should come from, and who the best 3 point shooters are is an important factor to any decision maker on the basketball court.

Currently, there exist a handful of incomplete metrics for measuring the effectiveness of a 3 point shooter. 3 point percentage is nice, it gives you a good idea of the likelihood of one of their shots getting in the hoop, but as with any rate statistic, it comes with flaws. Most of them stem from the fact that shot selection and volume account for so much of the minute differences between good and great shooters. The best 3 point shooter of all time according to 3P% is Steve Kerr, who had a career rate of 45.4%. That’s great, but he only made an average of 0.8 3s per game. Contrast this with Steve Nash, who shot at a lower 42.8% but made 1.4 3s per game. Shooting at a great click is useful, but only if you use it. Having a high 3 point percentage is good, but it’s useless if you don’t use it as much as a player with a slightly lower percentage. So 3 point percentage can’t be our only metric for deciding 3 point effectiveness.

So if pure efficiency isn’t going to cut it, let’s try a volume stat instead. 3 Pointers per game should be a good measure. If 3 points are worth more than 2, the more made 3s the better, right? Wrong. If you go by 3P/G, LeBron James (1.4) is just as good of a 3 Point shooter as Steve Nash (1.4). But LeBron James’ career mark is a meagre 34.0%, as opposed to Steve Nash at a much better rate of 42.8%. Nash (3.2 3PA/G) takes 0.8 less attempts than LeBron (4.0 3PA/G) to make his 3s, so Nash is clearly a better shooter, and going purely off volume metrics isn’t going to be very helpful either. What is needed is a metric that effectively combines efficiency with a volume of efficiency.

The ultimate mark of a good 3 point shooter should be the amount of points that they score greater than the expected points off every possession which they end with a 3 point shot. Simplified, this is “points off threes subtract expected points”. The method for determining expected points off a possession was to take the average Offensive Rating for the league (Points/100 possessions) and divide by 100. This gives an expected points per possession for the 2015-16 season of 1.064. The formula for calculating how much better than 1.064 points per possession each 3 point shooter was, is 3*3P – 1.064*3PA. Now we have our formula, we can apply it to every player in the league to judge their 3 point effectiveness. All we need is a name — I started using 3PTEPA for 3PT Expected Points Added as a tip to some of Baseball’s divisive sabremetrics, and eventually settled on 3PTx, 3PT Expected. Plus, 3PTx sounds pretty edgy so I went with it.

So let’s dive right in and have a look at the results when applied to player data for the 2015-16 season.

 

If your browser isn’t displaying the embedded graphs above, click here to view the interactive graphs on tableau.com. Scroll over data points for information about that player. To zoom in on a particular area, highlight that area, then hold the mouse over it until a box appears, and click “Keep Only”. Use the tabs up the top to switch between graphs.

First, let’s simply look at 3PTx. To nobody’s surprise, Steph Curry is head and shoulders above the rest of the cohort, adding 263.3 points this season on 3 point shooting alone. More than 100 points behind we have our second tier of shooters, Klay Thompson and JJ Redick, followed by our third tier of CJ McCollum, Kawhi Leonard and JR Smith.

At the other end of the graph, we can see which shooters have been hurting their team with every 3 point attempt this season. At the bottom, with -97.9 points is Kobe Bryant. It’s no surprise, because only Kobe has the respect to keep chucking up low percentage shots and not get benched, and this is a single-season number we may not see again for a long time. Zooming in on the bottom end shows us some of the other players with the worst shooting seasons, including names like Marcus Smart, Russell Westbrook, Corey Brewer, Jerami Grant and Kentavious Caldwell-Pope all garnering scores below -50.

So what can we learn about this graph in general? Well, for those at the very top of the graph, shoot more. For those at the very bottom, shoot less. But for the majority of players clumped into the middle of the graph, it’s a little more complicated. In the middle, it’s best to split our graph along a diagonal line like so:

Screenshot-2016-04-28-16.07.28

For those who fall above and to the left of the line, they can attribute their negative score mostly to just being bad shooters. For those who fall below and to the right of the line, their score can be attributed primarily to putting up a volume of bad shots. Additionally, for players who, over the entire season, have a score of -20 or better, it’s worth considering that those attempts might not be that much of a negative influence. For example, players like John Wall or Gordon Hayward, who had season 3PTx scores of -4.0 and -7.2 respectively. Part of the 3 point shot is forcing the defense to respect you on the perimeter. If Wall or Hayward had shot considerably less from 3 this season, they probably would have a harder time getting to the rack as opponents sag off, as well as spreading the floor less for their team mates. So sometimes with players you need to take the good with the bad. However, if Wall had chosen not to take only 4 extra attempts this season, he would have broken even, so players with negative scores should still learn from that statistic when deciding to force a possibly ill-advised 3 point shot.

It’s very interesting to look at where a lot of players lie on this graph, some of the most interesting ones I’ll note here. Marvin Williams is on the same level of shooters as players like Kyle Lowry, Kevin Durant, and Kyle Korver, right at the top of the main pack, proving once again how much of an underrated season he’s having for the Hornets. Players considered by most to be good shooters who had a terrible season: Monta Ellis (-39.0), Nik Stauskas (-27.8), Danny Green (-23.3) and Paul Pierce (-32.5). Also, more proof of how poor LeBron James’ shooting has become this season, costing his team 39.0 points on the 3 ball for only 87 makes on the season. Stop shooting 3s LeBron. Please. Continuing on the stars who shoot 3s too much, Carmelo Anthony (-14.8) hasn’t had a great season. There are also a lot of players considered to be stretch fours or shooting bigs that find themselves with negative scores. Serge Ibaka (-15.8), Kristaps Porzingas (-15.6), Al Horford (-8.4) some of the biggest names, however as discussed before, the floor-stretching they provide may be worth the lost points.

Finally, it’s worth noting that the watershed mark for good or bad 3 point shooting is right around the 35% to 36% mark, which seems to gel with the consensus opinion around the league, which shows that our perception of 3 point shooters is reasonably consistent with game theory.

The 3PTx statistic provides a good look at the overall impact of a player’s 3 point shooting on the season, but a per-shot perspective might give us a better look at which players cause the most damage with every shot, and which players can afford to take more threes to up their efficiency. The next tab on tableau.com displays 3PTx. plotted on total 3 pointers taken. 3PTx. is simply calculated by 3PTx divided by 3 Pointers attempted.

Simply looking at where players fall along a ladder of 3PTx. scores would be interesting enough, but fleshing out the points by looking at total 3s gives us a good idea of how much of a player’s 3PTx. score can be attributed to low sample size, and if so, how many more shots they can afford to take.

Here, we get a better look at some players who have been neglected on the 3 point line. The players we see at the top of the graph with only a handful of attempts can obviously be ignored, because their percentages came off a very small sample size. This metric suffers from a lot of the same flaws as simple 3PT%, but it does benefit from at least giving a reference point of whether a given rate is a good or bad percentage.

For players who find themselves below the 0 3PTx. line, it’s better for them to additionally be found with less 3 pointers made, because the more that come off a bad rate, the more a player is hurting their team. For those above the line, they should want to find themselves with as many 3 pointers made as possible, because each attempt is good for the team. Information about individual players can’t be explored as much as with the previous graph.

The third graph plots 3PTx/36, a measure of how many points a player adds through 3 pointers per 36 minutes of court time. Steph Curry finds himself highest amongst high volume players, to no surprise, but we also find a few players around his range whose value on the court may have been overlooked when it comes to the 3 pointer. Steve Novak and Troy Daniels stand out the most, but obviously these players have bigger flaws in their game which force coaches to sit them, despite their good 3 point shooting. This measure is best for judging players in the middle of the pack and comparing similar players, just like other /36 statistics.

The final graph plots 3PTx/Game, another metric which provides a good equaliser, however this stat is more effective for multi-season comparison, or contextualising a number. This graph will be much more interesting when comparing historical players, whereas for single-season data it looks almost exactly the same as the first graph which simply plots 3PTx.

It should be seen from this rudimentary exploration of the results how effective 3PTx is as a measure of 3 point shooting. This statistic would be a good advanced stat to use in analysis of a player’s shooting, and provides a single number on the level of box-plus-minus or Win Shares which immediately allows one to make conclusions about whether a player’s shooting is a negative or a positive. In my next article, I will be applying this data to historical 3 point shooters and subsequently judging the best and worst players of all time when it comes to long-range shooting. Further down the road, I am looking to try and implement a similar strategy to a player’s entire scoring output, to discover who the best all around scorers of all time are. But until then, enjoy the use of this metric for analysing 3 point shooters. Contact me if you’ve got any suggestions for how this metric could be improved, or your general thoughts.

  • statistics provided by Basketball Reference
  • Graphs provided by Tableau.com
  • Read about how this statistic applies to all-time 3 point shooters here
  • twitter: @jackneubecker
  • email: pointforwardpod@gmail.com
  • An Article by Jack Neubecker