(11-10-2021, 02:39 PM)The Real Marty Wrote:

(11-10-2021, 02:09 PM)OzJohnnie Wrote: They actually explain their method in some detail here and address your objections.

https://www.pff.com/grades

---

That doesn't refute a thing I said, in fact it reinforces what I said.  

"Each grade is reviewed at least once, and usually multiple times, using every camera angle available, including All-22 coaches’ tape."

So of the ~50,000 individual player-plays per week, they are "reviewing them multiple times using every camera available. "  That means they're not doing 50,000 reviews per week; they're doing 150,000 or more reviews per week!

"PFF employs over 600 full or part-time analysts, but less than 10% of analysts are trained to the level they can grade plays."

So they have 60 people who are actually qualified to review 50,000 to 150,000 player-plays PER WEEK.  

"Only the top two to three percent of analysts are on the team of "senior analysts" in charge of finalizing each grade after review."

2 or 3% of 600 is 15.  They have 15 guys who finalize the grades on 50,000 to 150,000 plays PER WEEK.   If they only take 20 seconds per play, that adds up to 277 to 831 hours per week.  There are only 960 hours in a week.  When do they sleep? 

Complete supposition, but I imagine a guy watches a game, and if a player blows a coverage, or misses a block, they get a minus. If they break a tackle, or break up a deep pass, they get a plus. everyone else gets a blank, and move on to the next play.

It's the only plausible way to say every play/player is reviewed.

Otherwise, that's 66 reviews of each PLAY in game. I imagine by the 2nd q you'd be so brain-numb that evaluations would be worthless.

---

(11-10-2021, 03:03 PM)NYC4jags Wrote: My primary gripe with their system is that it assumes intent and assignment for OL, DB and LB play.
Makes the grading of those positions flawed IMO.
They can't get those assumptions right consistently enough for those grades to be accurate on their own or in comparison to one another.

....like the pirouette block that was by design!



(apologies to all who had successfully repressed that memory)

---