this post was submitted on 21 Apr 2024
1 points (100.0% liked)
TechTakes
1580 readers
13 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I think there is in fact a notion of continuous entropy (essentially just the Kullback-Leibler divergence from a uniform distribution) where that is actually true, and it does appear to be used in statistical mechanics (buit I am not a physicist). But there are clearly a lot of technical details which have been scrubbed away by the LW treatment.
The fact that the naive continuous version of the Shannon entropy (just replacing the sum with an integral) can go negative is one reason why statistical physicists will tell you not to do that.
yea i did try to read the lecture notes and got reminded very fast why i don't try to read physics writing lol