9 Comments

much as you are appreciative of the deflators in your life (whose ranks i count myself among) i am appreciative of posts like this that let me believe something incredible *is* happening. thank you frank!

Expand full comment

I might be misreading, but it kind of sounds like the problem, such as it is, is not that the deflators are wrong, but that the arguments they make sometimes have the side effect of downplaying how cool and amazing this all is.

I think it's possible to be a deflator who still finds these breakthroughs meaningful and significant (in fact, that describes me pretty well), though. Just meaningful and significant along some other axis than doom/AGI.

The meaningful and significant thing, to me, is that we've actually managed to inject a teeny tiny bit of structure into the giant frothing pot that is Big Data. And the reason I find this cool rather than concerning is that this last crucial bit, this spark, is still coming from us.

Expand full comment

my god, man. you're a poet. keep writing, please. absolutely wonderful stuff. i can relate.

Expand full comment

I first understood "the ethnomethodological flip" as an insight into the workings of my own intelligence, but lately I see it as evidence in favor of your position here (which I certainly share). I often think of that book chapter about learning board game rules, which perhaps paints a picture of how a predictive mess can come to approximate/emulate symbolic logic.

Are you going to brand your position a la "unpluggers"/"deflators"? Is that a spoiler for the post series?

Expand full comment

I think I am likely to end up a reluctant member of the last camp, the reckless goofballs who are trying to build stuff out of AI. I won't know for sure until I write that part.

Expand full comment

I'd argue there WAS one big , huge, insight that marked the absolute inflection point in these things. Attention. If you look at the history of these things, they just didnt start getting good until that "Attention is all you need" paper that gave us transformers, then everything clicked into place and bam, I can now argue with a robot about Kirk vs Picard (the answer, by the way, is Picard).

What bakes my noodle, is what Heidegger said about consciousness, that consciousness is always being conscious OF something. Ie, its just "paying attention". No, I dont happen to think these things are 'conscious' in any way phenomenologically recognizable to our experience of it, but SOMETHING is happening here. I feel we are on the brink.

Expand full comment

I wholeheartedly agree. that moment -- June 12ish, 2017 -- was the true turning point. I spent a significant amount of time trying to grok it. Here are my investigations, for those interested: https://gregoreite.com/attention-is-all-you-need-the-beginning-of-agi/

Expand full comment
Comment deleted
Mar 12, 2023
Comment deleted
Expand full comment

> what journalists had to say about personal computers in the early 1980's...

It would be nice to get a little of that Whole Earth Catalog / Mondo 2000 spirit going again!

Expand full comment

Mondo 2000! Hells to the yeah! That's a name I haven't heard... in a long, long time. (Obi Wan reference)

Expand full comment