(11-10-2021, 03:03 PM)NYC4jags Wrote: My primary gripe with their system is that it assumes intent and assignment for OL, DB and LB play.
Makes the grading of those positions flawed IMO.
They can't get those assumptions right consistently enough for those grades to be accurate on their own or in comparison to one another.

I've got no idea of they are right or wrong. I never even look at the stats except when someone else posts them somewhere.  They do claim, however, that intent is usually very easy to determine on review and that in the few instances when they cannot reasonably determine what a player should have done then they mark the play neutral.  They grade on a scale from done really well to done really poorly and that the number of times they must mark something neutral because they are unable to judge it accurately is so rare as to be statistically irrelevant.

Again, I have no idea if they are good or bad.  I'm merely pointing out that they have reasoned answers to your objection.

---

(11-10-2021, 02:39 PM)The Real Marty Wrote:

(11-10-2021, 02:09 PM)OzJohnnie Wrote: They actually explain their method in some detail here and address your objections.

https://www.pff.com/grades

---

That doesn't refute a thing I said, in fact it reinforces what I said.  

"Each grade is reviewed at least once, and usually multiple times, using every camera angle available, including All-22 coaches’ tape."

So of the ~50,000 individual player-plays per week, they are "reviewing them multiple times using every camera available. "  That means they're not doing 50,000 reviews per week; they're doing 150,000 or more reviews per week!

"PFF employs over 600 full or part-time analysts, but less than 10% of analysts are trained to the level they can grade plays."

So they have 60 people who are actually qualified to review 50,000 to 150,000 player-plays PER WEEK.  

"Only the top two to three percent of analysts are on the team of "senior analysts" in charge of finalizing each grade after review."

2 or 3% of 600 is 15.  They have 15 guys who finalize the grades on 50,000 to 150,000 plays PER WEEK.   If they only take 20 seconds per play, that adds up to 277 to 831 hours per week.  There are only 960 hours in a week.  When do they sleep?  

A) I never said that they refuted your argument, I said they addressed it.

B) You present the task as impossible and yet they publish the numbers.  So either they are lying or you're figuring wrong.  Given they are contractually obligated to provide their product as described and I imagine are also independently audited, I would lead toward their claims being defensible and you're back-of-the-envelope calculation being flawed in some way.

---