I wanted to extract diagrams from youtube lectures. Had no idea how to go about it.
i said:
"i don't know what it is, but if you think about frames in a video, and the screen shows the speaker vs showing a diagram - something is different because the diagram is static, has less movement and less colors. What is it?"
"ahh. I see what you are talking about is entropy. There is more randomness in a frame with movement or a person than a frame with a diagram. here is a function that plots the frame entropy over time for a video..."
and then i wen't back and forth with it to build a whole workflow and make the analysis tool be interactive. So even though it was just a text conversation, by writing the visual features i wanted, it was able to implement it for me. Pretty wild.
https://habla.news/u/liminal@gitcitadel.com/1729213258345
liminal
npub1m3…qa5sf
2024-10-25 16:23:59
in reply to nevent1q…ug9v
Author Public Key
npub1m3xdppkd0njmrqe2ma8a6ys39zvgp5k8u22mev8xsnqp4nh80srqhqa5sfSeen on
wss://nostr.winePublished at
2024-10-25 16:23:59Event JSON
{
"id": "74ed1ad688b97aacddc472f8b082f49303b289add8ea154dd4476409c7fbe1a7",
"pubkey": "dc4cd086cd7ce5b1832adf4fdd1211289880d2c7e295bcb0e684c01acee77c06",
"created_at": 1729873439,
"kind": 1,
"tags": [
[
"e",
"c293a5dfdfea5215ba13158515c67ced7e8020d534f4df9c06d756a59bb334e6",
"",
"root"
],
[
"e",
"296a6bbb812ed8eb695ebdc93948700aa398fdbf2645488321859348e5270acd"
],
[
"e",
"01ba82020a72d1bba96c40d0f5a5fd2a0bc63a7ee8694d28e0767693ce227599",
"",
"reply"
],
[
"p",
"7c765d407d3a9d5ea117cb8b8699628560787fc084a0c76afaa449bfbd121d84"
],
[
"p",
"dc4cd086cd7ce5b1832adf4fdd1211289880d2c7e295bcb0e684c01acee77c06"
],
[
"r",
"https://habla.news/u/liminal@gitcitadel.com/1729213258345"
]
],
"content": "I wanted to extract diagrams from youtube lectures. Had no idea how to go about it. \ni said:\n\n \"i don't know what it is, but if you think about frames in a video, and the screen shows the speaker vs showing a diagram - something is different because the diagram is static, has less movement and less colors. What is it?\"\n\n\"ahh. I see what you are talking about is entropy. There is more randomness in a frame with movement or a person than a frame with a diagram. here is a function that plots the frame entropy over time for a video...\"\n\nand then i wen't back and forth with it to build a whole workflow and make the analysis tool be interactive. So even though it was just a text conversation, by writing the visual features i wanted, it was able to implement it for me. Pretty wild.\n\nhttps://habla.news/u/liminal@gitcitadel.com/1729213258345",
"sig": "02443c446d9061a03839cdcb3ae4610bb08f24d369df2aa6a494cc4cdc8d9ec43240ade175aa24f2e6fce5ca080691304eaa9fe7297b8d9a3ee6efdb61b2fc13"
}