My additional 2¢ is that if you have a free text “notes” field handling the mess with comments like “name unreliable; also goes by Childers or Chidders” … that may actually be just fine these days. 10 years ago those would’ve been harder to use at scale.
bsky.app/profile/tedu...
bsky.app/profile/tedu...
bsky.app/profile/tedu...
bsky.app/profile/tedu...
People do pay more for frontier models than open ones — but the differences they're paying for, at this point, come from post-training.
At this point pretty much everything that was gained from the initial pre-training is in fact, universally shared. Differences between models that people pay for are now all post training.
https://web.archive.org/web/20251207001422/https://honk.tedunangst.com/u/tedu
#honk #azorius #tedunangst
https://web.archive.org/web/20251207001422/https://honk.tedunangst.com/u/tedu
#honk #azorius #tedunangst
https://web.archive.org/web/20250408034245/https://honk.tedunangst.com/about
https://web.archive.org/web/20250408034245/https://honk.tedunangst.com/about
People do pay more for frontier models than open ones — but the differences they're paying for, at this point, come from post-training.
At this point pretty much everything that was gained from the initial pre-training is in fact, universally shared. Differences between models that people pay for are now all post training.
Code: github.com/Historical-A...
Team: Ted Underwood, Ziliang Qiu, Laura K. Nelson @lauraknelson.bsky.social, Sarah Griebel @sgriebel.bsky.social, Edwin Roland @teddyroland.bsky.social, Wenyi Shang @wenyishang.bsky.social , Matthew Wilkens @mattwilkens.bsky.social.
People do pay more for frontier models than open ones — but the differences they're paying for, at this point, come from post-training.
At this point pretty much everything that was gained from the initial pre-training is in fact, universally shared. Differences between models that people pay for are now all post training.
bsky.app/profile/tedu...
Prohibitions on copying were a late invention, and a narrowly tailored one. They do not express a general ethical law that all information ought to be priced and paid for.
bsky.app/profile/tedu...
I think we’re right to say “good knowledge production is reflective about what has been discovered, how, and how that relates to previous inquiry.” But that will not stop our fields from being transformed.
I assume that OpenAI and Anthropic are constantly spying on everything the other does so that they can do it first or simultaneously, so it did not even occur to them that it was wrong
However, I don't think that's the social norm in math or science.
I assume that OpenAI and Anthropic are constantly spying on everything the other does so that they can do it first or simultaneously, so it did not even occur to them that it was wrong
Rather: in primate society, lots of roles can only be filled by primates.
1776: First commercial Boulton and Watt steam engine
1813: Robert Owen, A New View of Society
1848: Marx and Engels, Communist Manifesto
---
---
But, knowing your brother, is there any chance that he's planning to transform himself into Spiderman's nemesis, The Scorpion?
RIP tedu
they still doing weird shit with mastodon
we still out here
RIP tedu
they still doing weird shit with mastodon
we still out here