Not “Stable Genius” Again, Or Please Stop Making Us Run This Analysis

The Headline

Donald Trump’s grade level, on Day 986 of his Presidency, declined slightly from the first two analyses, dropping from a grade level of 4.6 to 4.5. In all three analyses, he consistently has the lowest score of all U.S. Presidents since Herbert Hoover, regardless of methodology or sample size.

The Details

So a little known fact: companies need to make money. It requires PowerPoints, more PowerPoints, presentations, sales calls, and all sorts of things that are not why data nerds started data nerding. It’s been busy in the Fact Cave. We track every word spoken by Donald Trump… but we’re also three weeks behind fully launching Factba.ses for all Presidential candidates… all 47,141 of them (47,141 is a rough estimate, plus or minus 47,129).

On the side, we transcribe and analyze every word spoken in the U.S. Congress: all the committees, floor speeches, the whole shebang, for our clients, whom we worship and thank daily (דַּיֵּנוּ).

Because that just seems like we’re slacking, we also do the same on 3,000+ earnings calls every quarter for a whole different set of clients (ever watch Billions…? Like that, except non-fictional firms. Unfortunately, also less Taylor Mason, the current reigning übernerd). So our AI Margaret’s been busy. Her meatspace human staff are busy too.

Of course, in the thick of all this business-ing… Donald Trump pulls out “Stable Genius.”  In a press conference. In the middle of all this. And the requests start coming in again for us to re-run the analysis of his grade level.

So, okay, fine. We have a responsibility. But that doesn’t mean we can’t whine about it. Thought we’d make it easy for you?

Previously, on “Stable Genius”…

So Donald Trump first pulled out “stable genius” on January 6th, 2018 @ 7:30 am on Twitter…

It got a lot of press and interrupted a perfectly calm weekend in the Fact Cave, where we’d fallen asleep two hours earlier. It led to cursing (7:30 am on a Saturday?) and a thought experiment in trying to measure intelligence using the words in our database. We’re not going over that again. The blog post is linked here and goes through the replay, including the methodology. Have a question? It’s answered in there.

original.jpgThe long and the short is: you can’t measure IQ, but you can, as a crude proxy, measure vocabulary use with, among other methods, the Flesch-Kincaid Grade Level. We like this for a number of reasons: it’s public, peer-reviewed, been around since the 1970s and perhaps, most important, was developed for the U.S. Government to measure the readability of written materials to ensure it could be understood. It’s the same test the government still uses to this day to make sure text can be readily understood. So we measure using the U.S. government’s own scoring mechanism.

Because things like speeches are scripted, and may more accurately be a reflection of a speechwriter’s vocabulary, we narrow the sample to just interviews, press conferences, Q&As… settings where someone is least likely to be on-script. This gets much closer to a person’s true vocabulary.

Since data without a cohort comparison is without context, we compare Donald Trump to his cohort… other Presidents in the 20th and 21st centuries.

There. You’re caught up. Still want more? Read the earlier post. So there.

And Now, On Part Two Three of “Stable Genius”…

Donald Trump has used the phrase publicly seven times since that first tweet: in three other tweets (one deleted), in three press conferences and in one Q&A session after delivering remarks. But it got noticed again quite visibly when it was raised during a press conference with Sauli Niinistö, President of Finland (and man most likely to annoy our spelling bot), on October 2, 2019, where it was put in the context of “those that think” Trump is a stable genius.

There are those that think I’m a very stable genius. Okay? I watch my words very, very closely. — Donald Trump, 10/2/19

Given some of the D.C. hoopla, it kicked off the aforementioned round of “Hey Factba.se, can Margaret re-run the data?”
margaret[Disclosure: no one outside the Fact Cave anthropomorphizes our AI by calling her Margaret. We do, because, well, because we’re scared of her coming sentience so we’re very nice to her. We respect our AI overlords. There’s a new Terminator movie coming out after all. She’s gonna get ideas if Trump mentions Arnold Schwarzenegger ever again.]

Previously, we ran it on Day 354 of his Presidency (January 8, 2018) and Day 683 (December 3, 2018). In the first case, we chose the first 30,000 words of everyone’s Presidency, so each President had the same amount, though statistically, it didn’t make a difference. On Day 683 and in this analysis on Day 986 (October 3, 2019), we use all non-scripted remarks — press conferences, interviews, gaggles and so forth, from inauguration up through that day of their respective presidencies (see disclaimer on Gerald Ford, who only made it 895 days).

This yielded a range of 45,244 words for Richard Nixon, up through 859,711 words for George H. W. Bush (if you saw the man’s schedule, you’d know why there’s so many words). Trump had 847,334 words in the analysis.

Statistically, we didn’t expect much of a change, and we weren’t disappointed. Some numbers moved around, but by-and-large, not much movement. We were surprised, however, to see a slight shift downward in Donald Trump’s score. But the data is the data.

Full data tables and a pretty chart below.

Chart-FKRL-20191003-crop

Flesch-Kincaid Grade Level Scores

Compares scores run on Day 354 (January 8, 2018), Day 683 (December 3, 2018) and Day 986 (October 3, 2019) for each U.S. President in the cohort.

PresidentDay 986Day 683Day 354
Donald Trump4.54.64.6
Barack Obama8.79.29.7
George W. Bush8.18.17.4
Bill Clinton9.09.19.3
George H. W. Bush7.47.66.7
Ronald Reagan8.58.78.0
Jimmy Carter9.99.910.7
Gerald Ford9.59.59.4
Richard Nixon10.210.69.4
Lyndon B. Johnson8.58.67.6
John F. Kennedy9.69.88.8
Dwight D. Eisenhower9.39.49.4
Harry S. Truman6.26.35.9
Franklin D. Roosevelt8.17.97.4
Herbert Hoover11.111.211.3

Other Metrics

Different scoring mechanisms, counts and statistics for the Day 986 analysis on October 3, 2019. Notes with links:

Pres.FK-GFK-RG-FC-LSMOGARID-CSentencesWordsW/SSyllablesS/W
Donald Trump4.581.47.28.28.73.13.079,348847,33410.681,143,9011.35
Barack Obama8.762.911.310.611.98.14.646,918792,90616.901,189,3591.50
George W. Bush8.163.410.210.811.37.34.812,951193,49314.94294,1091.52
Bill Clinton9.064.411.59.911.98.64.338,562729,97218.931,065,7591.46
George H. W. Bush7.469.39.89.610.86.64.156,154859,71115.311,237,9841.44
Ronald Reagan8.565.211.010.211.68.14.411,789206,78117.54301,9001.46
Jimmy Carter9.957.512.411.212.09.55.17,515140,75018.73216,7551.54
Gerald Ford9.559.211.910.612.08.84.94,19476,49918.24117,0431.53
Richard Nixon10.258.312.710.612.010.04.92,20745,24420.5068,3181.51
Lyndon B. Johnson8.563.910.810.311.97.74.66,01099,52416.56148,2911.49
John F. Kennedy9.660.712.110.612.09.34.85,567107,10919.24160,6641.50
Dwight Eisenhower9.362.911.99.912.08.94.26,022117,18319.46172,2591.47
Harry S. Truman6.270.28.210.510.05.14.78,11588,93810.96131,6281.48
Franklin D. Roosevelt8.167.810.79.411.37.43.62,99851,75117.2674,5211.44
Herbert Hoover11.153.713.911.112.010.74.83,96484,31121.27130,6821.55

Leave a Reply

Your email address will not be published. Required fields are marked *