Quelle surprise!
The ChatGPT folks lied about the bar exam performance.
From the abstract:
"Fourth, when examining only those who passed the exam (i.e. licensed or license-pending attorneys), GPT-4’s performance is estimated to drop to 48th percentile overall, and 15th percentile on essays.
_________________________________
In other words, it failed spectacularly. Most states you have to be in 64th percentile to pass.
And the essays? Those are the money ... that's where everyone trips up on the bar exam ... the essays. 15%.
Fucking. Frauds.
#AI #TechBroGrift
https://link.springer.com/article/10.1007/s10506-024-09396-9
Leftist Lawyer /
npub1v7…05j80
2024-05-31 13:35:58
Author Public Key
npub1v7x9jq0k4tqdk405d2t94cuf7cl97fxyeu55dags8a2wf8lwucrs905j80Published at
2024-05-31 13:35:58Event JSON
{
"id": "e5c9b5e8278291b281603a3525884e06ddbee7b5515b75980428c9e12ecce47a",
"pubkey": "678c5901f6aac0db55f46a965ae389f63e5f24c4cf2946f5103f54e49feee607",
"created_at": 1717162558,
"kind": 1,
"tags": [
[
"t",
"ai"
],
[
"t",
"techbrogrift"
],
[
"proxy",
"https://kolektiva.social/@LeftistLawyer/112535965448847800",
"web"
],
[
"proxy",
"https://kolektiva.social/users/LeftistLawyer/statuses/112535965448847800",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://kolektiva.social/users/LeftistLawyer/statuses/112535965448847800",
"pink.momostr"
]
],
"content": "Quelle surprise!\nThe ChatGPT folks lied about the bar exam performance. \n\nFrom the abstract:\n\n\"Fourth, when examining only those who passed the exam (i.e. licensed or license-pending attorneys), GPT-4’s performance is estimated to drop to 48th percentile overall, and 15th percentile on essays. \n_________________________________\n\nIn other words, it failed spectacularly. Most states you have to be in 64th percentile to pass. \n\nAnd the essays? Those are the money ... that's where everyone trips up on the bar exam ... the essays. 15%. \n\nFucking. Frauds.\n\n#AI #TechBroGrift\nhttps://link.springer.com/article/10.1007/s10506-024-09396-9",
"sig": "9ae8de840bdf09f9fef8c6f3bce69c681235b7673724efbbdf075474e13d44f56676b3c7e064feef0b0e75e369c4ad9112e3116d570de93eedf7189ed23a0fe6"
}