Information theory

52,104 views

Science4All

Published on Streamed live on May 15, 2020
About :

Here's a quick introduction to Claude Shannon's information theory, and why it's fascinating from both a philosophical and engineering perspective. • Introduction - 0:00 • Quiz 1 - 8:21 • Magic trick - 12:39 • Explanation by information theory - 20:37 • Fundamental postulate of information theory - 27:21 • Quiz 2 - 32:00 • Shannon's entropy - 37:06 • Quiz 3 - 42:38 • Calculating log2 on a calculator - 51:35 • Quiz 4 - 57:15 • Joint and conditional entropy - 1:06:36 • Quiz 5 - 1:21:58 • The average length of a code is greater than the entropy - 1:37:53 • Quiz 6 - 1:58:54 • Jensen's inequality - 2:10:50 • Kullback-Leibler (KL) divergence - 2:17:18 • Quiz 7 - 2:29:30 • Mutual information - 2:36:17 • Quiz 8 - 2:46:40 • The entropy diagram - 2:56:30 • Quiz 9 - 2:59:34 • Quiz 10 - 3:08:21 • The final result of the live audience - 3:16:28 • Mutual information does not imply correlation - 3:19:00 Link for the quizzes: bit.ly/S4A_live2_Q1 Link for the correction: bit.ly/score_bayes #COVID19 #cds #cafédessciences Twitter: / le_science4all Facebook: / science4allorg Tipeee: https://www.tipeee.com/science4all My goodies: https://shop.spreadshirt.fr/science4all My upcoming dates: https://www.dropbox.com/s/t3abghdmh59... The formula of knowledge (my 1st book): https://laboutique.edpsciences.fr/pro... The fabulous construction site (my 2nd book, with El Mahdi El Mhamdi): https://laboutique.edpsciences.fr/pro... Probably? in audio: http://playlists.podmytube.com/UC0NCb... Me in podcast with Mr Phi: YouTube version: / @axiome7403 Audio version: http://feeds.feedburner.com/Axiome Subtitles on other videos: http://www.youtube.com/timedtext_cs_p...

  • vidoe Comments
Trend Videos
27:02
[SUB] Giving back as much as you receive, our love is two-way #LeeYoungJi #ChaJwiPul
차린건 쥐뿔도 없지만
1,204,696 views   5 days ago
21:10
GFRIEND's Killing Voice Live! - Running Through Time, Night, Today From Us, You and I, Glass Bead, FINGERTIP Dingo Music Dingo Music
딩고 뮤직 / dingo music
2,374,710 views   1 day ago
12:31
It's so delicious that I'm going to buy more cabbage! 👍👍I should have eaten like this before~ 3 delicious and healthy cabbage recipes
강쉪
87,959 views   2 days ago
10:25
3 hours before returning from vacation
숏박스
3,818,741 views   5 days ago
8:50
【🤴Ep.448】 Only efficiency and cost-effectiveness! We brought you an extremely cost-effective pellet stove that competes solely on heat!
공구왕황부장
480,229 views   7 days ago
11:04
I went to the original Robatayaki restaurant
유우키의 일본이야기 YUUKI
356,880 views   7 days ago
28:01
A monster that burns everything?! If you want to be reincarnated, stop the Phoenix! [Reincarnation School Monster Class Season 3 Episode 1]
웃소 Wootso
358,889 views   4 days ago
26:11
UFC Champion Merab Asks Kim Dong-hyun to WrestleㅣEP.3 Las Vegas Training Camp
매미킴 TV
417,302 views   1 day ago
10:00
I made a surprise visit to the Koi TV office.
스카이
148,161 views   5 days ago
3:40
Park Seo-jin - Clown King of Singers 2 Episode 3
MBN MUSIC
374,703 views   1 day ago
27:57
A game of rock-paper-scissors where you bet your life on one game!! The loser gets to go to LA and buy LA ribs ㅋㅋㅋ
보물섬
1,110,681 views   4 days ago
27:02
[SUB] Giving back as much as you receive, our love is two-way #LeeYoungJi #ChaJwiPul
차린건 쥐뿔도 없지만
1,204,696 views   5 days ago
2:53
ROSÉ - APT. (Band VER.) (With. Lee Young Ji) [The Seasons - Lee Young Ji's Rainbow] KBS 241129 Broadcast
KBS Kpop
8,284,626 views   12 days ago
15:28
Now I can't do Nupfhack - Minecraft NEW Nupfhacker
우왁굳
621,782 views   5 days ago
13:41
Found a Chinese Restaurant w/ Delicious Big Portions! Jjajangmyeon + Jjamppong + Tangsuyuyk
히밥heebab
903,777 views   7 days ago
10:20
Squid Game 2 Character Introduction Netflix
Netflix Korea 넷플릭스 코리아
1,674,045 views   7 days ago
11:04
The identity of the mystery active singer sung by Choi Su-ho is the god of janggu, Park Seo-jin!! What is the result of the fierce battle? #SeeCurrentKing2
MBN Entertainment
258,706 views   1 day ago
13:27
A miserable relationship advice from a single person...
찰스엔터
453,799 views   1 day ago
24:33
The story of a Japanese female friend who eventually quit her job and came to Korea
여행가 제이 [Jay world traveler]
482,571 views   3 days ago
5:55
[Park Soo-hong is happy] 45 days after birth 24 hours of parenting Full sleep Unicorn baby Park Soo-hong's daughter Park Jae-i Vlog
박수홍 행복해다홍
683,168 views   3 days ago
5:10
Winter spinach is three times more delicious when prepared like this
김대석 셰프TV
190,211 views   1 day ago
21:43
[vlog] Seungheon, Junbbang, Sojung and plotting argument
찰스엔터
852,773 views   2 weeks ago
32:23
SUB) One bite Hyeyoung 😋 Episode 4 + Mukbang VLOG) Cream rice cake for spring, the best combination ever❤️Chocolate shell yogurt honey rice cake, sesame oil + seaweed, honeycomb honey + cracker, strawberry chocolate chokku rice cake, self-yo-ah-jeong, butter yakgwa, year-end gift event👏🏻 MUKBANG
여수언니 정혜영 [Yeosu Unnie]
197,861 views   3 days ago
32:23
SUB) One bite Hyeyoung 😋 Episode 4 + Mukbang VLOG) Cream rice cake for spring, the best combination ever❤️Chocolate shell yogurt honey rice cake, sesame oil + seaweed, honeycomb honey + cracker, strawberry chocolate chokku rice cake, self-yo-ah-jeong, butter yakgwa, year-end gift event👏🏻 MUKBANG
여수언니 정혜영 [Yeosu Unnie]
197,861 views   3 days ago
27:57
A game of rock-paper-scissors where you bet your life on one game!! The loser gets to go to LA and buy LA ribs ㅋㅋㅋ
보물섬
1,110,681 views   4 days ago
57:44
Chicken Skewers VS Hotdogs in 24 Hours!! How Many Can You Eat at Once to Get Full?! (Skewer Warning)
파뿌리
680,084 views   3 days ago
11:04
I went to the original Robatayaki restaurant
유우키의 일본이야기 YUUKI
356,880 views   7 days ago
12:31
It's so delicious that I'm going to buy more cabbage! 👍👍I should have eaten like this before~ 3 delicious and healthy cabbage recipes
강쉪
87,959 views   2 days ago
25:36
★Tsubokman appears★ The end of the voice impersonator
깡주은
1,680,899 views   7 days ago
21:10
GFRIEND's Killing Voice Live! - Running Through Time, Night, Today From Us, You and I, Glass Bead, FINGERTIP Dingo Music Dingo Music
딩고 뮤직 / dingo music
2,374,710 views   1 day ago
4:58
Please put your fingerprint on the machine in front.
킥서비스
421,576 views   21 hours ago
11:04
The identity of the mystery active singer sung by Choi Su-ho is the god of janggu, Park Seo-jin!! What is the result of the fierce battle? #SeeCurrentKing2
MBN Entertainment
258,706 views   1 day ago
Google AdSense
336 x 280
Up Next
29:17
THE RISKS OF EXPOSURE TO THE RIGHT
RIFLESSIONI FOTOGRAFICHE
6,739 views
5 months ago
32:11
The Paradoxes of Digital Photography: What No One Tells You!
RIFLESSIONI FOTOGRAFICHE
15,375 views
5 months ago
45:45
2004 -2024 : MIRRORLESS CAMERAS - 20 YEARS OF EVOLUTION : PROS AND CONS
RIFLESSIONI FOTOGRAFICHE
10,573 views
5 months ago
28:03
Autofocus Problems with Fujifilm? Discover the Tricks to Solve Them Easily!
RIFLESSIONI FOTOGRAFICHE
10,812 views
3 months ago
6:28
Visual Triangle Technique in Photography: How to Create Dynamic and Perfect Compositions
Ilaria Rubino
4,595 views
2 weeks ago
38:08
The Truth About Micro 4/3: Why So Few Professionals Use It?
RIFLESSIONI FOTOGRAFICHE
13,401 views
5 months ago
28:58
The secrets of SHUTTER TIMES: from beginner to professional
RIFLESSIONI FOTOGRAFICHE
7,695 views
8 months ago
27:03
HOW MANY MEGAPIXELS DO YOU REALLY NEED? WE REVEAL THE TRUTH! (photography tutorial)
RIFLESSIONI FOTOGRAFICHE
30,970 views
10 months ago
24:49
BLACK AND WHITE PHOTOGRAPHY : MONOCHROME SENSOR VS BAYER -PENTAX KIII MONOCHROME VS PENTAX KIII
Promirrorless
7,080 views
10 months ago
37:41
📸 Dynamic Range: Say Goodbye to BURNT HIGHLIGHTS - Full Tutorial!
RIFLESSIONI FOTOGRAFICHE
23,078 views
6 months ago
33:11
THE 7 FALSE MYTHS ABOUT DIGITAL PHOTOGRAPHY
RIFLESSIONI FOTOGRAFICHE
5,971 views
7 months ago
34:37
Does equipment influence photographic style? Or does our style guide our choices?
RIFLESSIONI FOTOGRAFICHE
6,116 views
4 weeks ago
31:20
FUJI XT5 vs FUJI X100 VI: Are you in doubt and don't know which one to choose? We'll help you ;)
RIFLESSIONI FOTOGRAFICHE
8,997 views
7 months ago
22:38
SONY A9III WHAT DOES A PROFESSIONAL PHOTOGRAPHER FROM LA REPUBBLICA THINK?
RIFLESSIONI FOTOGRAFICHE
4,257 views
8 months ago
29:14
PENTAX K3 MARK III MONOCHROME ONE MONTH OF REAL-LIFE USE
Promirrorless
11,460 views
1 year ago
46:21
15 Tricks for Taking Stunning Landscape Photographs
RIFLESSIONI FOTOGRAFICHE
14,545 views
7 months ago
32:17
THIS IS WHY I CHOSE THE FUJI XT5
RIFLESSIONI FOTOGRAFICHE
17,308 views
2 months ago
27:46
MIRRORLESS: It's Not For Everyone! 7 Reasons Why SLR Is Still A Good Choice
RIFLESSIONI FOTOGRAFICHE
9,740 views
7 months ago
17:31
All About Depth of Field in Photography
Francesco Fanti
13,803 views
2 years ago
26:48
How to properly set up an entry-level DSLR. The 10 golden rules for beginners
Valerio Pardi
117,241 views
4 years ago
22:13
When he comes back how to behave so as not to feel bad
Luca Mattia
154 views
12 days ago
35:11
How to Recognize an Unhealthy Relationship: Emotional Awareness
Luca Mattia
258 views
5 days ago
1:02:25
Marco Lillo and Antonio Massari interview Nicola Gratteri
Il Fatto Quotidiano
214,688 views
Streamed 3 months ago
1:19:34
'I FELT COMPLETELY CRAZY' - bipolar schizoaffective What is Life
Cos'è Vita
8,106 views
2 months ago
15:37
I am a Digital Hermit
Andrea D'Angelo
169 views
2 weeks ago
1:21:46
Is Mathematics the Best Programming Language? 🧮 With Paolo Caressa
Giuseppe Funicello
937 views
Streamed 8 days ago
1:06:41
Why I RETIRED from TRAINING (INFOBUSINESS Criticality)
Big Luca
11,143 views
12 days ago
49:49
How to Fill the Inner Void (No Psychologist Explains It to You Like This)
Giorgia Dalla Valle
55,685 views
1 month ago
1:43:33
Cogitata Infinita on Self-Knowledge - with Roberto Mercadini
Rick DuFer
137,967 views
1 year ago
14:40
Unsolicited Opinion: Modern Family
Signore del Circo
46 views
2 weeks ago
1:39:10
Ep. 149 - Nothing More Can Be Said with Immanuel Casto
IL BAZaR AtOMICo
17,949 views
2 months ago
36:41
You are not your thoughts: we know about obsessive compulsive disorder
Dana
1,819 views
8 days ago
51:31
Emotions shape matter
Selene Calloni Williams
4,128 views
Streamed 6 days ago
1:16:39
Balene in m*rda.
NanniTwitch
6,838 views
5 days ago
1:07:37
Fear Makes 99 - Psyco Matinee ep.99
Matinée
35 views
5 days ago
1:08:57
Are we at the end of WordPress or the beginning of a new era?
Jose Mortellaro
1,345 views
8 days ago
1:19:42
Mars in Bear: THE ART OF DREAMING
Un Posto per i Pensieri
25 views
Streamed 8 days ago
1:34:19
PSYCHIATRY and PHILOSOPHY: The Need for Clarity - with @ValerioRosso
Rick DuFer
65,086 views
2 years ago
Google AdSense
336 x 280

fetery.com. Copyright 2024