Maybe Apple’s Natural Language framework could help here. It can tokenize text in many languages and determine word boundaries.
https://developer.apple.com/documentation/naturallanguage
montzstar / Montzstar
npub1ql…vyayc
2023-05-15 02:20:37
in reply to nevent1q…7qe8
Author Public Key
npub1qlk0nqupxmlyxravg0aqscxmcc4q4tq898z6x003rykwwh3npj0syvyaycPublished at
2023-05-15 02:20:37Event JSON
{
"id": "8d17bd442b56d6598c043c0816a7c7c54847e749855292a96d12079eb963bec9",
"pubkey": "07ecf9838136fe430fac43fa0860dbc62a0aac0729c5a33df1192ce75e330c9f",
"created_at": 1684117237,
"kind": 1,
"tags": [
[
"e",
"729ae5e471d87abad1489cb98d6cc98c9e85c6adfbd0f819f17d8d1275804668"
],
[
"e",
"ebe0ac88694b420ca4a1a67a174a3e4a18dd3aa040802dea94ac34223044b3e1"
],
[
"p",
"17c18fce2db435a93f25d90385bd37159a199affc7b4e92c06d2a0372fda85bd"
],
[
"p",
"3356de61b39647931ce8b2140b2bab837e0810c0ef515bbe92de0248040b8bdd"
],
[
"p",
"de688dac753fb178fc3b1fe617661f9d2bbad7998533364c3f9b77051ba1ad8c"
],
[
"p",
"1577e4599dd10c863498fe3c20bd82aafaf829a595ce83c5cf8ac3463531b09b"
],
[
"p",
"facdaf1ce758bdf04cdf1a1fa32a3564a608d4abc2481a286ffc178f86953ef0"
],
[
"p",
"7f5c2b4e48a0e9feca63a46b13cdb82489f4020398d60a2070a968caa818d75d"
],
[
"p",
"c094ccc6b3b3f969bc37a900a01a3c69c692532fedab909aaa6cce8bf5f06a03"
],
[
"p",
"17538dc2a62769d09443f18c37cbe358fab5bbf981173542aa7c5ff171ed77c4"
],
[
"p",
"2779f3d9f42c7dee17f0e6bcdcf89a8f9d592d19e3b1bbd27ef1cffd1a7f98d1"
]
],
"content": "Maybe Apple’s Natural Language framework could help here. It can tokenize text in many languages and determine word boundaries.\n\nhttps://developer.apple.com/documentation/naturallanguage",
"sig": "15d75ed8b1eff660c52b699b3c6905072bd70ca43c81d7d97302789bb7a1bc02e0f5fa162ff3602ff463f07a2737b98a1f3a643155e2d4aab3dd2f6d7498c747"
}