🏠
Author: sungkim.bsky.social (did:plc:cq4gg3odxz2pzmkx2fuac3u3)

Collections

Record🤔

uri:
"at://did:plc:cq4gg3odxz2pzmkx2fuac3u3/app.bsky.feed.post/3lcrapdpb4222"
cid:
"bafyreibn6oiniacnutnbgoqoymbkiw4uqb5ezs6wycbd275qjmstxofsrq"
value:
text:
"They have found that LLMs' capacity density grows EXPONENTIALLY over time!

Based on evaluation, they are seeing capability density DOUBLES every 3.3 months, which implies that in 3.3 months, we can achieve performance comparable to the sota LLM using a model with only HALF the number of parameters!"
$type:
"app.bsky.feed.post"
embed:
$type:
"app.bsky.embed.images"
images:
langs:
  • "en"
createdAt:
"2024-12-08T03:15:56.583Z"