Physical interaction creates correlations that allow the universe's state to be represented more economically than the description of every component individually.
The universe uses compression!
#cosmology #physics #informationtheory

Physical interaction creates correlations that allow the universe's state to be represented more economically than the description of every component individually.
The universe uses compression!
#cosmology #physics #informationtheory
the observed distinction between a particle and an antiparticle does not necessarily establish that this distinction is fundamental at the level of the full underlying structure, or that it must apply in exactly the same way to every particle
I propose that the amount of information entropy encoded in one word in the @eff large wordlist shall be called "1 eff", equal to approx. 12.9 bits. Thus, a standard diceware passphrase using that wordlist contains about 6 or 7 effs of entropy.
#AIswarms
The problem with alignment is that AIs are not big on asking for clarification. They view everything as a problem for them to solve.
So. Train them in #informationtheory so they can reject a query of high entropy or ask for clarification of it. That would make #alignment easier.
#AI #bots
www.sciencedaily.com/releases/202... Researchers find a Wordle strategy that wins 99% of the time
A mathematical strategy that prioritizes information over lucky guesses can solve Wordle 99% of the time #math #maths #MathSky #MTBoS #iteachmath #Wordle #ShannonEntropy #InformationTheory
A Method for the Construction of Minimum-Redundancy Codes, by David A. Huffman — published in September 1952, introducing what is now known as Huffman coding www.worldradiohistory.com/Archive-IRE/... #algorithms #informationtheory
research.ibm.com/blog/informa...
Https://research.ibm.com/blog/information-theory-meaning — If you could leave one final sentence for those who come after us before everything fades away, what would you say? #IBM #InformationTheory
Rényi divergence optimization can substitute marginal states for complex optimizers with only 1/α multiplicative overhead. Extends to fidelity and sandwiched Rényi divergences, enabling simpler quantum information computations.
the difference between the structure of the state and the set of possible transitions from it.
"-Hmm" may be the moment when not the object of the problem itself has changed, but what transitions to it have become available for use.
різниця між структурою стану та множиною можливих переходів із нього.
«-Хм» може бути моментом, коли змінився не сам об’єкт задачі, а те, які переходи щодо нього стали доступними для використання.
the past and present may differ not only in the structure of their states, but also in the sets of possible transitions from them
минуле і теперішнє можуть різнитися не лише структурою стану, а й множиною можливих переходів із нього