Independent test of #OpenAI’s o1-preview model achieved near-perfect performance on a national #math exam (landing in the top .1% of the nation’s students).
o1 also outperformed 4o on the math test, but took about 3 times longer to do so (10 minutes vs. 3 minutes).
Preprint: https://www.researchgate.net/publication/384071542_System_2_thinking_in_OpenAI's_o1-preview_model_Near-perfect_performance_on_a_mathematics_exam/figures
#teaching #assessment #AI #LLM #edu #higherEd
Nick Byrd, Ph.D. /
npub1ju…5cy93
2024-10-01 13:15:02
Author Public Key
npub1jufzy5vnxxrts98w8tue257k87lfvfamfqszacxxal9nxdyhrgksk5cy93Seen on
wss://relay.momostr.pinkPublished at
2024-10-01 13:15:02Event JSON
{
"id": "ac8036b622943d3b066f1d4a368cb12907be25cb3fdab423a50dfdb000a78613",
"pubkey": "97122251933186b814ee3af99553d63fbe9627bb48202ee0c6efcb3334971a2d",
"created_at": 1727788502,
"kind": 1,
"tags": [
[
"t",
"openai"
],
[
"t",
"math"
],
[
"t",
"ai"
],
[
"t",
"assessment"
],
[
"t",
"highered"
],
[
"t",
"llm"
],
[
"t",
"teaching"
],
[
"proxy",
"https://nerdculture.de/@ByrdNick/113232340805717342",
"web"
],
[
"t",
"edu"
],
[
"proxy",
"https://nerdculture.de/users/ByrdNick/statuses/113232340805717342",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://nerdculture.de/users/ByrdNick/statuses/113232340805717342",
"pink.momostr"
],
[
"-"
]
],
"content": "Independent test of #OpenAI’s o1-preview model achieved near-perfect performance on a national #math exam (landing in the top .1% of the nation’s students).\n\no1 also outperformed 4o on the math test, but took about 3 times longer to do so (10 minutes vs. 3 minutes).\n\nPreprint: https://www.researchgate.net/publication/384071542_System_2_thinking_in_OpenAI's_o1-preview_model_Near-perfect_performance_on_a_mathematics_exam/figures\n\n#teaching #assessment #AI #LLM #edu #higherEd",
"sig": "f678605860cf82ee95d4b7b9de935b5e79429e4d50b206cc9c27ead1aff8e9d9181d80bade396a3af2cd0ebb0028864f12c002d4916dd1eba77c594ba9860ad1"
}