Discussion about this post

User's avatar
Joanne Strasser's avatar

This is a great article. I never thought much about the accessibility aspect of Ai and how it can give rise to voices we may not be as likely to hear. Seems important these days, especially in the bubble of academia where new info often fails to permeate the discourse… Also, when I was a grad student (100 years ago) at the New School, lugging the books from Bobst library wasn’t ideal ;-)

Tom's avatar

Very interesting! Love this kind of first-principles thinking, and it's especially cool when it leads to unbundling concepts we implicitly treated as the same thing, but only because historically there happened to always be a correlation between them. In times like these of dramatic change of circumstances, it's important to do this kind of analysis of what still makes sense.

A point that worries me about this new world, I think, is that the deep skill that remains once we strip away the superficial things that used to be attached to it — which is, as you wrote, something in the realm of judgment/taste/understanding/depth of knowledge — isn't very tangible. It's certainly real, and it's what actually matters in the big picture, but it's hard for a person to measure it even in themselves (maybe even in some sense *especially* in themselves — AI makes all of us much more prone to Dunning-Kruger).

Like, it was always hard to distinguish statements that are actually true from ones that are merely plausible, but there were proxies — for instance, checking the speaker's credentials, or even the way they speak or write, which on one hand is ad hominem but on the other hand is also a kind of chain of trust; two things might seem equally plausible, but if you know one comes from someone with proven experience and thinking — even if you can't observe that directly — that's a convenient shortcut for raising the probability it's correct.

It's well known that charlatans have always been the people who succeed at sounding authoritative, at passing the pattern-matching for people with expertise and confidence, and at mimicking that style — and we're very bad at telling the difference. So in a sense, we've now lowered the barrier to entry for charlatanism.

And as you wrote, if it's easier to produce an opinion that's hard to *know* is correct, but not necessarily more likely to actually *be* correct, then that creates a lot of noise — "the ratio will be dismal."

And in that context, I'm not sure whether "cheap production, expensive judgment" is actually an efficient model, practically speaking. That is, whether filtering, top-down, from within the space of "everything that could be said" is more efficient than going bottom-up and generating claims from scratch.

Beyond all that, personally, as someone who has to read a ton of AI-written content daily, I just suffer from the prose style it produces. I can't even fully define it, because it goes well beyond the repetitiveness of clichés like em dashes or "It's not X, it's Y" — it's something about the overly "uniform texture" of the writing, or the way every paragraph and section carries the same "weight." Which becomes exhausting when you have to read paragraph after paragraph after paragraph written that way.

This also connects to the fact that the writing simply tends to be much longer (not in terms of micro-level phrasing, which sometimes actually gets tighter, but in terms of how much content gets packed in at the macro level). It creates a kind of inversion, where the effort/cost required to read becomes much more expensive than to write/edit, so nothing forces writers to make the hard choices about what to leave out — even things that are valuable but not fully critical are still better cut for reasons of economy.

Although one could argue that in many kinds of writing this was always a problem. "I would have written a shorter letter, but did not have the time," etc.

By the way, another point you mentioned that I thought was very interesting was why we like eureka stories like that. I think you're touching on something true — that the fact the path of discovery was very non-traditional, and didn't come from orderly academic work, somehow makes it more... accessible, or exceptional, or something. It would be interesting as a topic in itself to understand that further.

And one more point toward the end, which remains partly an open question: what traits do we actually want to reward, in an academia that is in part indeed a race. And not just any race, but one where, to a large extent, whoever wins first place in the early heats also gets to start the next heats ahead of everyone else; presumably, being accepted into/getting accredited by prestigious institutions is a huge part of what not only predicts but actually determines success later on the path — even when this happens arbitrarily among people whose traits/starting point are completely identical.

In a sense this is just the question you address explicitly: if we practically want to maximize the advancement of knowledge/human progress as a whole, then which people have the traits such that, if positioned in the prestigious spots and given the limited resources (like public attention), would achieve the best results (of course, given a world where all these AI tools etc. exist). But I wonder whether there's also a question embedded here of: if we want to reward merit, then what actually is merit...

---

(Translated by AI 🙂)

2 more comments...

No posts

Ready for more?