ThatQuiz Elenco di test Affronta questo test adesso
Information theory - Quiz
Con il contributo di: Haynes
  • 1. What are pseudorandom number generators in computer language libraries almost universally unsuited for?
A) Cryptographic use
B) Bioinformatics
C) Gambling
D) Seismic exploration
  • 2. What must cryptographically secure pseudorandom number generators have to work as intended?
A) High Shannon entropy
B) Analog processing methods
C) Integrated neural clusters
D) Random seeds external to the software
  • 3. How can random seeds for pseudorandom generators be obtained?
A) Via digital noise
B) By using semiotic signs
C) Through Shannon entropy
D) Via extractors
  • 4. What is the measure of sufficient randomness in extractors?
A) Effective information
B) Min-entropy
C) Free energy
D) Dynamic core hypothesis
  • 5. Min-entropy is related to Shannon entropy through which other type of entropy?
A) Conditional entropy
B) Thermal entropy
C) Algorithmic entropy
D) Rényi entropy
  • 6. Where is Rényi entropy also used?
A) In minimizing free energy
B) In seismic oil exploration
C) In semiotic code control
D) In evaluating randomness in cryptographic systems
  • 7. Does a random variable with high Shannon entropy guarantee it is satisfactory for use in an extractor?
A) Only in cryptographic systems
B) Only for pseudorandom numbers
C) No
D) Yes
  • 8. What was one early commercial application of information theory?
A) Seismic oil exploration
B) Search for extraterrestrial intelligence
C) Bioinformatics
D) Black hole analysis
  • 9. What did information theory make it possible to do in seismic exploration?
A) Minimize free energy in the brain
B) Strip off and separate unwanted noise from the desired seismic signal
C) Decode dominant social messages
D) Generate secure pseudorandom numbers
  • 10. What methods offered a major improvement of resolution and image clarity over previous analog methods in seismic work?
A) Information theory and digital signal processing
B) Cryptographically secure pseudorandom number generators
C) Free energy principles
D) Extractors and Rényi entropy
  • 11. Which semioticians considered Charles Sanders Peirce as having created a theory of information?
A) Gerald Edelman and Giulio Tononi
B) Doede Nauta and Winfried Nöth
C) Karl J. Friston and Andrey Kolmogorov
D) Umberto Eco and Ferruccio Rossi-Landi
  • 12. How did Doede Nauta define semiotic information theory?
A) The minimization of free energy in a self-organized system
B) The separation of unwanted noise from seismic signals
C) The measurement of sufficient randomness in extractors
D) The study of the internal processes of coding, filtering, and information processing
  • 13. Which semioticians used concepts like redundancy and code control to explain ideology?
A) C.E. Shannon and R.V.L. Hartley
B) Doede Nauta and Winfried Nöth
C) Gerald Edelman and Karl J. Friston
D) Umberto Eco and Ferruccio Rossi-Landi
  • 14. In semiotic explanations of ideology, how does a dominant social class emit its message?
A) Through digital signal processing of seismic signals
B) By utilizing cryptographically secure pseudorandom seeds
C) By using signs that exhibit a high degree of redundancy
D) By applying the free energy principle
  • 15. Where have quantitative information theoretic methods been applied in cognitive science?
A) To analyze the integrated process organization of neural information
B) To study black holes and bioinformatics
C) To explore seismic oil deposits
D) To extract random numbers for cryptography
  • 16. What neurological problem is linked to the analysis of neural information organization?
A) The binding problem in cognitive neuroscience
B) The paradox of extraterrestrial intelligence
C) The problem of algorithmic complexity
D) The issue of seismic noise filtering
  • 17. Whose functional clustering model and dynamic core hypothesis define an information-theoretical measure in neural processing?
A) Doede Nauta and Winfried Nöth
B) R.V.L. Hartley and C.E. Shannon
C) Umberto Eco and Ferruccio Rossi-Landi
D) Gerald Edelman and Giulio Tononi
  • 18. What is Giulio Tononi's integrated information theory (IIT) of consciousness based on?
A) Effective information
B) Seismic signal processing
C) Shannon entropy
D) Min-entropy
  • 19. What underlies the definition of measures in the context of neural information organization?
A) A high degree of redundancy in signs
B) External cryptographic random seeds
C) A reentrant process organization
D) Analog methods of data transmission
  • 20. What does a reentrant process organization refer to?
A) The coding and filtering processes studied in semiotics
B) The synchronization of neurophysiological activity between groups of neuronal populations
C) The filtering of unwanted noise from desired seismic signals
D) The generation of pseudorandom numbers using extractors
  • 21. Whose free energy principle (FEP) states that every adaptive change leads to a minimization of free energy?
A) Charles Sanders Peirce
B) Karl J. Friston
C) Giulio Tononi
D) Gerald Edelman
  • 22. What type of system does the free energy principle apply to?
A) A cryptographic random number generator
B) An analog seismic receiver
C) A dominant social class
D) A self-organized system
  • 23. Along with the free energy principle, what other hypothesis is mentioned in relation to statistical methods in the brain?
A) The Bayesian brain hypothesis
B) The integrated information theory
C) The dynamic core hypothesis
D) The semiotic information theory
  • 24. Which field, aside from cryptography and seismology, has applications in information theory?
A) Search for extraterrestrial intelligence
B) Phrenology
C) Alchemy
D) Astrology
  • 25. Which physical phenomenon is listed alongside extraterrestrial intelligence as having applications for information theory?
A) Seismic waves
B) Black holes
C) Tectonic plates
D) Neural clusters
  • 26. What life-science field is mentioned as having applications in information theory?
A) Biochemistry
B) Biomechanics
C) Bioinformatics
D) Biophysics
  • 27. What recreational activity is listed as an application of information theory?
A) Cipher creation
B) Crosswords
C) Gambling
D) Chess
  • 28. Who is listed in the history section alongside C.E. Shannon and Andrey Kolmogorov?
A) Gerald Edelman
B) R.V.L. Hartley
C) Doede Nauta
D) Umberto Eco
  • 29. Who is mentioned in the history section alongside R.V.L. Hartley and Andrey Kolmogorov?
A) Giulio Tononi
B) C.E. Shannon
C) Winfried Nöth
D) Ferruccio Rossi-Landi
  • 30. Who is listed in the history section alongside R.V.L. Hartley and C.E. Shannon?
A) Karl J. Friston
B) Charles Sanders Peirce
C) Andrey Kolmogorov
D) Winfried Nöth
  • 31. What is the historical figure H.P. Yockey associated with in the text?
A) History of information theory
B) Integrated information theory
C) Free energy principle
D) Dynamic core hypothesis
  • 32. What do physiological systems use information theory to exchange, process, and integrate as?
A) A brute force attack
B) A block cipher
C) A network
D) A single organ
  • 33. What do physiological systems generate alongside functions in health and disease?
A) Symmetric keys
B) Unicity distances
C) Distinct physiological states
D) Information theory units
  • 34. What does network cross-communication and regulation reveal within the organism?
A) Why it ceases permanently
B) How encryption keys are generated
C) Why brute force attacks succeed
D) How it occurs
  • 35. Which interactions are listed as applications of information-theoretic approaches in physiology?
A) One-time pad interactions
B) Cryptographic interactions
C) Enigma machine interactions
D) Cardio-respiratory interactions
  • 36. In what kind of environments is network physiology applied according to the text?
A) Cryogenic laboratory environments
B) Underground bunker environments
C) Simulated virtual environments
D) Extreme environments
  • 37. What was the name of Turing's information unit used in the Ultra project?
A) The bit
B) The ban
C) The byte
D) The shannon
  • 38. In which project was Turing's information unit used?
A) The Venona project
B) The Unicity project
C) The Enigma project
D) The Ultra project
  • 39. What German machine code was broken during World War II with the help of the ban?
A) Lorenz cipher code
B) Enigma machine code
C) One-time pad code
D) Symmetric key code
  • 40. What does information theory lead us to believe about keeping secrets?
A) It is extremely easy using symmetric keys
B) It is much more difficult than it might first appear
C) It is completely impossible under any circumstances
D) It requires no computational effort
  • 41. What kind of attack can break systems based on asymmetric or symmetric key algorithms?
A) A brute force attack
B) A network physiology attack
C) A conditional mutual attack
D) An information-theoretic attack
  • 42. What are symmetric key algorithms sometimes called?
A) Unicity distance algorithms
B) Secret key algorithms
C) One-time pads
D) Asymmetric algorithms
  • 43. What is an example of a commonly used method of symmetric key algorithms?
A) Block ciphers
B) Bans
C) One-time pads
D) Transfer entropy
  • 44. What must be used correctly even when applying information-theoretically secure methods?
A) Block ciphers
B) Brute force
C) Care
D) Transfer entropy
  • 45. Which project was able to crack the one-time pads of the Soviet Union?
A) The Ultra project
B) The Network Physiology project
C) The Venona project
D) The Enigma project
  • 46. In which type of data compression must the data be reconstructed exactly?
A) Lossless data compression
B) Channel coding
C) Lossy data compression
D) Rate-distortion theory
  • 47. What justifies the division of coding theory into compression and transmission?
A) Source-channel separation theorems
B) Channel resolvability
C) Pragmatic information
D) Rate-distortion theory
  • 48. What do source-channel separation theorems justify the use of as the universal currency for information?
A) Distortion functions
B) Bytes
C) Entropy
D) Bits
  • 49. What type of channel involves more than one transmitter?
A) The multiple-access channel
B) The broadcast channel
C) The relay channel
D) The wiretap channel
  • 50. What type of channel involves more than one receiver?
A) The multiple-access channel
B) The wiretap channel
C) The relay channel
D) The broadcast channel
  • 51. What type of channel involves intermediary helpers?
A) The wiretap channel
B) The relay channel
C) The multiple-access channel
D) The broadcast channel
  • 52. What should joint entropy not be confused with despite similar notation?
A) Cross-entropy
B) Mutual information
C) Conditional entropy
D) Kullback-Leibler divergence
  • 53. What type of space does the vector give values in for joint entropy?
A) Euclidean space
B) Vector space
C) Product space
D) Metric space
  • 54. What is the formula for self-information I(pi)?
A) -ln(pi)
B) -log2(pi)
C) 1 / pi
D) log2(pi)
  • 55. What is the entropy H relative to the surprisal of all possible symbols?
A) The weighted average
B) The median
C) The maximum value
D) The geometric mean
  • 56. If 1000 bits are transmitted and each is independently and equally likely to be 0 or 1, how much information has been transmitted?
A) No information
B) 1 shannon
C) 2000 bits
D) 1000 shannons
  • 57. In what year was Claude Shannon's paper 'A Mathematical Theory of Communication' published?
A) 1948
B) 1952
C) 1939
D) 1960
  • 58. In what decade was information theory established and formalized?
A) 1920s
B) 1930s
C) 1940s
D) 1950s
  • 59. In what context was information theory initially formed?
A) Quantum computing
B) Telecommunication
C) Artificial intelligence
D) Molecular biology
  • 60. What is the entropy of a coin flip when you already know the outcome after it has landed?
A) 0.5 bits
B) Zero
C) 1 bit
D) 2 bits
  • 61. What is an example of source coding or data compression mentioned in the text?
A) ZIP files
B) Compact discs
C) Voyager missions
D) DSL
  • 62. What is an example of channel coding mentioned in the text?
A) Mobile phones
B) Artificial intelligence
C) DSL
D) ZIP files
  • 63. Whose success was crucially impacted by information theory regarding deep space missions?
A) Apollo missions
B) Voyager missions
C) Curiosity rover
D) Hubble telescope
  • 64. Which invention's success was crucially impacted by information theory?
A) Compact disc
B) Television
C) Radio
D) Steam engine
  • 65. What technology's feasibility was made possible by information theory?
A) Automobiles
B) Electric guitars
C) Mobile phones
D) Airplanes
  • 66. What modern developments were impacted by information theory alongside artificial intelligence?
A) The printing press
B) The postal service
C) The telegraph network
D) The Internet
  • 67. Which computational paradigm is listed alongside artificial intelligence as an application of information theory?
A) Quantum computing
B) Distributed computing
C) Cloud computing
D) Optical computing
  • 68. Which of the following artistic applications is mentioned as a use case for information theory?
A) Sculpture casting
B) Oil painting restoration
C) Art creation
D) Architectural drafting
  • 69. What specific musical topic is analyzed using information theory according to the text?
A) Vocal cord anatomy
B) Music
C) Acoustic room resonance
D) Musical instrument design
  • 70. Which philosophical field is listed at the end of the text as an application area of information theory?
A) Epistemology
B) Metaphysics
C) Ethics
D) Aesthetics
  • 71. Which historian rated Shannon's 1948 paper as the most important development of 1948?
A) James Gleick
B) Ralph Hartley
C) Harry Nyquist
D) Vannevar Bush
  • 72. In what year did Shannon outline some of his initial ideas in a letter to Vannevar Bush?
A) 1939
B) 1928
C) 1940
D) 1948
  • 73. To whom did Shannon write a letter outlining initial ideas of information theory in 1939?
A) Ludwig Boltzmann
B) Alan Turing
C) James Gleick
D) Vannevar Bush
  • 74. Who wrote the 1924 paper 'Certain Factors Affecting Telegraph Speed'?
A) Ralph Hartley
B) Alan Turing
C) Harry Nyquist
D) Claude Shannon
  • 75. What relation was given in Harry Nyquist's 1924 paper?
A) H = log Sn
B) W = K log m
C) PV = nRT
D) E = mc2
  • 76. What unit of information was sometimes called the hartley in honor of Ralph Hartley?
A) The byte
B) The baud
C) The decimal digit
D) The bit
  • 77. Who used similar ideas in 1940 as part of the statistical analysis of breaking German Enigma ciphers?
A) Ralph Hartley
B) Claude Shannon
C) Harry Nyquist
D) Alan Turing
  • 78. Who made important contributions connecting information-theoretic entropy and thermodynamic entropy in the 1960s?
A) Harry Nyquist
B) Vannevar Bush
C) Rolf Landauer
D) James Gleick
  • 79. What logarithmic base is the bit or shannon based on?
A) Natural logarithm
B) Common logarithm
C) Binary logarithm
D) Decimal logarithm
  • 80. What logarithmic base is the nat based on?
A) Natural logarithm
B) Base-two logarithm
C) Common logarithm
D) Binary logarithm
  • 81. What logarithmic base is the decimal digit based on?
A) Natural logarithm
B) Binary logarithm
C) Common logarithm
D) Base-e logarithm
  • 82. What does the maximum value of entropy represent?
A) The lowest possible information content
B) The most predictable state
C) A deterministic sequence
D) The most unpredictable state
  • 83. What logarithmic base measures entropy in bytes per symbol?
A) Base-e
B) Base-10
C) Base-256
D) Base-2
  • 84. What type of trial has two outcomes for the binary entropy function?
A) A Markov trial
B) A logarithmic trial
C) A Bernoulli trial
D) An equiprobable trial
  • 85. What is another name for conditional entropy?
A) Equivocation
B) Marginal entropy
C) Mutual information
D) Joint entropy
  • 86. What is another name for mutual information according to the text?
A) Transinformation
B) Kullback-Leibler divergence
C) Pointwise mutual information
D) Log-likelihood ratio
  • 87. In what field is mutual information particularly important for maximizing shared information between sent and received signals?
A) Thermodynamics
B) Communication
C) Macroeconomics
D) Quantum mechanics
  • 88. Mutual information can be expressed as the average of which divergence?
A) Mahalanobis distance
B) Jensen-Shannon divergence
C) Euclidean distance
D) Kullback-Leibler divergence
  • 89. With which statistical test is mutual information closely related in the context of contingency tables?
A) Mann-Whitney U test
B) Log-likelihood ratio test
C) Student's t-test
D) Shapiro-Wilk test
  • 90. What type of mathematical function is the KL divergence classified as?
A) Semi-quasimetric
B) Inner product
C) Linear transformation
D) Euclidean metric
  • 91. In the alternative interpretation involving Alice and Bob, who knows the true probability distribution p(x)?
A) Both
B) Alice
C) Bob
D) Neither
  • 92. According to the surprise interpretation, who will be more surprised on average upon seeing the value of X?
A) It is impossible to determine
B) Bob
C) Both will be equally surprised
D) Alice
  • 93. What type of set is X assumed to be when drawing a random number in the surprise interpretation?
A) A discrete set
B) An infinite continuous set
C) An empty set
D) A finite geometric set
  • 94. Does directed information apply to statistical physics?
A) Only in quantum states
B) Only in macroscopic mechanics
C) No
D) Yes
  • 95. What does the random process Xn consist of?
A) {Y1, Y2, ..., Y_n}
B) {X0, X1, ..., X_{n-1}}
C) {X1, Y1, ..., X_n, Y_n}
D) {X1, X2, ..., X_n}
  • 96. What do the two expressions for the rate give for stationary sources?
A) The same result
B) A result of zero
C) An undefined value
D) Completely different results
  • 97. How is the noise nature of the channel considered in the text?
A) A negligible factor in modern systems
B) An inherent fixed property
C) A completely controllable variable
D) An unpredictable random variable that changes constantly
  • 98. What is the crossover probability of a binary symmetric channel denoted as?
A) Hb
B) e
C) p
D) i
  • 99. What does a binary symmetric channel do to the input bit with probability p?
A) Delays the input bit
B) Duplicates the input bit
C) Flips the input bit
D) Erases the input bit
  • 100. What feature do many channels have in practice?
A) Zero capacity
B) Ternary input
C) Memory
D) Gaussian noise
Creato con That Quiz — il sito per la creazione di test e la valutazione in matematica e in altre materie.