OEI on Nostr: Running Mistral 7B on my Mac I’m getting 2mins - 3 mins latency for summarization ...
Running Mistral 7B on my Mac I’m getting 2mins - 3 mins latency for summarization tasks I have the front end in type script and back end in python. #AISTR #Tinkering
Published at
2023-11-15 03:27:09Event JSON
{
"id": "1ec46adbf8d44797a990e4cd9d212408598a2b931a2a8c361f674d83c2ce9e87",
"pubkey": "6ac85b0ffea8b33b6dce9515246112bdaa0bd2e94a6499cdef2117838d69e90f",
"created_at": 1700018829,
"kind": 1,
"tags": [
[
"t",
"aistr"
],
[
"t",
"tinkering"
]
],
"content": "Running Mistral 7B on my Mac I’m getting 2mins - 3 mins latency for summarization tasks I have the front end in type script and back end in python. #AISTR #Tinkering",
"sig": "f7a81772e9da333f99dca402501ddf2541a86049f0d52e8997970efe1b6528554fa483d00bea15c7e43183cec1a2d02a5604122f35b0d3b3fa484b2c7a60bea2"
}
