BERT Neural Network - EXPLAINED!

공유
소스 코드
  • 게시일 2024. 04. 27.
  • Understand the BERT Transformer in and out.
    Follow me on M E D I U M: towardsdatascience.com/likeli...
    Please subscribe to keep me alive: krplus.net/uCodeEmporiu...
    PLAYLISTS FROM MY CHANNEL
    ⭕ Reinforcement Learning: • Reinforcement Learning...
    Natural Language Processing: • Natural Language Proce...
    ⭕ Transformers from Scratch: • Natural Language Proce...
    ⭕ ChatGPT Playlist: • ChatGPT
    ⭕ Convolutional Neural Networks: • Convolution Neural Net...
    ⭕ The Math You Should Know : • The Math You Should Know
    ⭕ Probability Theory for Machine Learning: • Probability Theory for...
    ⭕ Coding Machine Learning: • Code Machine Learning
    MATH COURSES (7 day free trial)
    📕 Mathematics for Machine Learning: imp.i384100.net/MathML
    📕 Calculus: imp.i384100.net/Calculus
    📕 Statistics for Data Science: imp.i384100.net/AdvancedStati...
    📕 Bayesian Statistics: imp.i384100.net/BayesianStati...
    📕 Linear Algebra: imp.i384100.net/LinearAlgebra
    📕 Probability: imp.i384100.net/Probability
    OTHER RELATED COURSES (7 day free trial)
    📕 ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
    📕 Python for Everybody: imp.i384100.net/python
    📕 MLOps Course: imp.i384100.net/MLOps
    📕 Natural Language Processing (NLP): imp.i384100.net/NLP
    📕 Machine Learning in Production: imp.i384100.net/MLProduction
    📕 Data Science Specialization: imp.i384100.net/DataScience
    📕 Tensorflow: imp.i384100.net/Tensorflow
    REFERENCES
    [1] BERT main paper: arxiv.org/pdf/1810.04805.pdf
    [1] BERT in google search: blog.google/products/search/s...
    [2] Overview of BERT: arxiv.org/pdf/2002.12327v1.pdf
    [4] BERT word embeddings explained: / why-bert-has-3-embeddi...
    [5] More details of BERT in this amazing blog: towardsdatascience.com/bert-e...
    [6] Stanford lecture slides on BERT: nlp.stanford.edu/seminar/deta...

댓글 • 327

  • @CodeEmporium
    @CodeEmporium  년 전 +6

    For details and code on building a translator using a transformer neural network, check out my playlist "Transformers from scratch": krplus.net/bidio/gaeCg3dmdqyshWE

  • @AmandeepSingh-xk4yv
    @AmandeepSingh-xk4yv 3 년 전 +241

    Just watched a video on Transformers, and now this. Am astounded at how you explained such complex notions with such ease!
    Hugely underrated channel!

  • @brilliantdirectoriestraining

    I have studied for several years AI, NPL and Neural networks. But the way you explained this was lovely, friendly and very simple which is why I am pretty sure you are BERT

  • @jeenakk7827
    @jeenakk7827 3 년 전 +24

    I wish I had come across this channel earlier. You have a wonderful skill in explaining complicated concepts. I love your "3 pass" approach!!

  • @andrewlai3358
    @andrewlai3358 3 년 전 +2

    Thank you for the explanation. You really have a knack for explaining NLP concepts clearly without losing much fidelity. Please keep posting!

  • @ankit_khanna
    @ankit_khanna 3 년 전

    One of the best videos on BERT.
    Great work!
    Wishing you loads of success!

  • @maverick3069
    @maverick3069 3 년 전 +1

    The multiple passes of explanation is an absolutely brilliant way to explain! Thanks man.

  • @rashmikuchhal5339
    @rashmikuchhal5339 3 년 전

    I always watch your videos and appreciate the efforts you put to make the complicated topics so easy and clear. Thankyou for all your work. I really like the way you explain in 3 passes.... great work

  • @mauriciolandos4712
    @mauriciolandos4712 11 개월 전

    Best explanator on youtube, you have a good mix of simplifying so it can be understood, but not overly simplifying so we learn deeply enough. The idea of having 3 passes going deeper was a great idea as well.

  • @dannysimon2965
    @dannysimon2965 3 년 전

    Wow, thanks!! I tried watching many videos and couldn't understand a single thing. But yours was truly concise and informative.

  • @MarketingLeap
    @MarketingLeap 3 년 전

    Loved how you explained BERT really well. Great job!

  • @abhikc8108
    @abhikc8108 3 년 전 +3

    Great explanation, I really like the three pass idea it breaks down a lot of complications to simple concepts.

  • @madhubagroy
    @madhubagroy 2 년 전 +1

    The BEST explanation on BERT. Simply outstanding!

  • @user-qx3jn9ii7s
    @user-qx3jn9ii7s 3 년 전

    Hey, your explantation and presentation on complicated concepts made me clear about TF and BERT.
    I will expect you to upload more exciting videos.

  • @usamahussain4461
    @usamahussain4461 2 년 전 +4

    Phenomenal the way you condense such a complicated concept into a few minutes, clearly explained.

  • @Kumar08
    @Kumar08 3 년 전

    Fantastic explanation, Covered each and every point in the BERT.
    Looking forward for more videos on NLP.

  • @BogdanSalyp
    @BogdanSalyp 3 년 전 +1

    Extremely underrated channel, didn't find any other good explanation on KRplus/Medium/Google

  • @amreshgiri
    @amreshgiri 3 년 전

    Probably the best (easiest to understand in one go) video on BERT. Thanks ❤️

  • @noumaaaan
    @noumaaaan 3 년 전

    This explanation is pretty amazing! I have a presentation on this soon. Thank you so much!

  • @aruncjohn
    @aruncjohn 3 년 전

    Excellent explanation!. Will never miss a video of yours from now on!

  • @NadavBenedek
    @NadavBenedek 2 년 전

    I love the "pass1" "pass2" concept of how you explain things. It's great.

  • @AbdulWahab-cy9ib
    @AbdulWahab-cy9ib 3 년 전 +1

    Was struggling to understand the basics of BERT after going through Transformer model. This video was indeed helpful.

  • @sajaal-dabet148
    @sajaal-dabet148 3 년 전

    This is amazing! Crystal clear explanation, thanks a lot.

  • @krishnaik06
    @krishnaik06 3 년 전 +201

    Amazing Explanation :)

    • @doyourealise
      @doyourealise 3 년 전 +1

      big fan sir

    • @richarda1630
      @richarda1630 3 년 전

      hear hear! so agree!

    • @User-nq9ee
      @User-nq9ee 2 년 전 +2

      To teach us , you study and explore .. really grateful for your efforts Krish .

    • @indgaming5452
      @indgaming5452 년 전

      Where there is krish sir... I will come there. .... Sir I found u here also...
      We are learning together 😇

    • @itsme1674
      @itsme1674 년 전

      Nice to meet you sir

  • @ziangtian
    @ziangtian 년 전 +1

    OMG!!!! This vid is a life-saver! just elucidated so many aspects of NLP to me (a 3 month beginner who still understands nothing

  • @healthertsy1863
    @healthertsy1863 7 개월 전

    Don't hesitate, this is the best video of BERT explanation for sure!

  • @michaelherrera4450
    @michaelherrera4450 3 년 전 +5

    Dude this video is incredible. I cannot express how good you are at explaining

  • @NachoProblems
    @NachoProblems 6 개월 전

    Do you realize you are the only good description of how exactly fine tuning works I have found, and I've been researching for months. Thank you!!!

    • @CodeEmporium
      @CodeEmporium  6 개월 전 +1

      You are too kind. Thank you for the donation. You didn’t have to bug it is appreciated. Also super glad this content was useful! More of this to come

  • @LoLelfy
    @LoLelfy 3 년 전

    Omg your videos are so good! So happy I found your channel, I'm binge watching everything :D

    • @CodeEmporium
      @CodeEmporium  3 년 전 +1

      Glad you found my channel too! Thank you! Hope you enjoy them!

  • @pathuri86
    @pathuri86 년 전

    Excellent and concise explanation. Loved it. Thanks for this fantastic video.

  • @mohamedsaaou9258
    @mohamedsaaou9258 3 년 전

    Wonderful, and the best explanation of BERT ever :) , Good Job , and big thank you !

  • @prasannabiswas2727

    I read many blogs on BERT but they were more focused on how to use BERT rather than what actually BERT is?. This video helped me clear all my doubts regarding how Bert is trained. Clear and concise explanation.

  • @ydas9125
    @ydas9125 년 전

    I am very impressed by the clarity and core focus of your explanations to describe such complex processes. Thank you.

    • @CodeEmporium
      @CodeEmporium  년 전

      You are very welcome. Thanks for watching and commenting :)

  • @aeirya1686
    @aeirya1686 5 개월 전

    Very very friendly, clear and masterful explanation. This is exactly what I was after. Thank you!

  • @arvindvasudevan45
    @arvindvasudevan45 3 년 전

    Excellent articulation of the concept. Thank you.

  • @xJFGames
    @xJFGames 년 전 +5

    I'm honestly amazed of how you managed to transform a complex algorithm in a simple 10 minutes video. Much thanks to you, my final thesis appreciates you.

  • @josephselwan1652
    @josephselwan1652 2 년 전 +1

    Amazing stuff. For visualization purposes, when you get into a deeper pass, I would recommend always adding the zooming effect for intuitive understanding. I am not sure about others, but when you do that, I instantly know "OK, now we are within this 'box' "

    • @CodeEmporium
      @CodeEmporium  2 년 전 +2

      Good thought. I'll try to make this apparent in the future. Thanks!

  • @magelauditore333
    @magelauditore333 3 년 전

    Such a underrated channel. Keep it up man

  • @TSP-NPC
    @TSP-NPC 10 개월 전

    Thanks for the great explanation of Transformers and the architecture of BERT.

    • @CodeEmporium
      @CodeEmporium  10 개월 전

      My pleasure and thank you for the super thanks :)

  • @pallavijog912
    @pallavijog912 3 년 전

    Wow.. just switched from another BERT explained video to this.. stark difference.. excellent explanation indeed.. thanks..

  • @erfanshayegani3693

    Every time I watch this video I gain a better understanding of the procedure. Thanks a lot for the great content!!!

  • @ruyanshou805
    @ruyanshou805 3 년 전

    Well explained! I have been looking for something like this for quite long!

  • @jx7433
    @jx7433 개월 전

    Excellent Explanation! Thank you!

  • @rohanmirchandani9726

    This is one of the best resources explaining BERT available online.

  • @andymoses95
    @andymoses95 4 년 전 +1

    The one which I was looking for the past 6 months.! Thanks a lot for making this.

  • @gauravsahani2499
    @gauravsahani2499 3 년 전

    Loved the explanation, Sir!

  • @naveen6630
    @naveen6630 3 년 전

    Hey. Your playlists are great. Also, the BERT explanation was excellent by the way. I am having a thought of working with farm-haystack using flask, dockers, and BERT. So I wonder whether if it's kind of the same you have explained, if not could you share your knowledge on that with me. Thank you.

  • @themaninjork
    @themaninjork 3 년 전

    Your Videos are very well explained !

  • @pratyushnegi4082
    @pratyushnegi4082 2 년 전

    Thanks for explaining this in such a simple way :)

  • @urd4651
    @urd4651 2 년 전

    thank you for sharing the video! very clear and helpful!!

  • @felixakwerh5189
    @felixakwerh5189 3 년 전

    great video, i like the 3-pass method you used to explain the concepts

  • @agustindiaz3361
    @agustindiaz3361 3 년 전

    Your videos are great! Amazing work

  • @goelnikhils
    @goelnikhils 년 전

    Excellent Explanation. Main thing to note is the finer point around explanation/mention of the loss functions that BERT uses. As not many other videos on same topic cover this. Tood Good

  • @deepeshkumar4945

    dude , you are amazing , you explained the state of the art NLP model , in such a well explained and concise video . Thanks a ton for this video !!!!!!

    • @CodeEmporium
      @CodeEmporium  년 전 +1

      You are super welcome. Thanks so much for commenting this!

  • @mays7n
    @mays7n 9 개월 전

    this must be one of the best explanation videos on the internet, thank you!

  • @arturjaroszewicz8424

    Beautiful explanation!

  • @20.nguyenvongockhue80

    wow AMAZING EXPLAINATION. Thank you very much

  • @keyrellousadib6124

    This is an excellent summary. Very clear and super well organized. Thanks very much

    • @CodeEmporium
      @CodeEmporium  년 전

      Thank you so much for watching ! And for the wonderful comment :$

  • @Deddiward
    @Deddiward 3 년 전

    Wow I've just discovered your channel, it's full of resources, very nice!

  • @gauravchatterjee794

    Best Explanation by far!

  • @rizwanulhoqueratul4811

    Thank you for the reference links!

  • @akashsaha3921
    @akashsaha3921 3 년 전

    Well explained. Short and to the point

  • @JP-gk6pi
    @JP-gk6pi 3 년 전

    3 pass explanation is a really good approach to explain this complex concept. Best video on BERT

    • @beteaberra631
      @beteaberra631 2 년 전

      Great video! But what is pass 1, pass 2 and pass 3?

  • @maryamaziz3841
    @maryamaziz3841 3 년 전

    Thanks for wonderful explanation for bert architecture 🍀🌹

  • @BiranchiNarayanNayak

    Best explanation i have seen so far on BERT.

  • @seeunkim4185
    @seeunkim4185 년 전

    Thank you so much for the clear explanation, I get the grip of the BERT now!

  • @mohsennayebi86
    @mohsennayebi86 2 년 전

    Amazing Explanation! I am speechless :)

  • @jeflee2787
    @jeflee2787 3 년 전

    Thanks man! Great work!

  • @harshavardhany2970
    @harshavardhany2970 3 년 전 +1

    Simple and clear explanations (which shows you know what you're talking about). And cool graphics. Will be back for more videos :)

  • @adityaj9984
    @adityaj9984 7 개월 전

    BEST EXPLAINATION EVEERRRR

  • @somerset006
    @somerset006 8 개월 전

    Nice job, man! Especially the multi-phase approach of explaining things, top to bottom.

    • @CodeEmporium
      @CodeEmporium  8 개월 전

      Super happy you liked the approach. Thanks for commenting

  • @bidyapatip
    @bidyapatip 3 년 전

    After reading lot of blogs, videos, I understood its so difficult network. But after going through this, I feel so easy to understand BERT(and its varient available in transformer library)

  • @beingnothing34
    @beingnothing34 3 년 전

    Amazing. Thanks a lot. You really **demystify** !!

  • @snowglade1
    @snowglade1 3 년 전

    Hey this is an exceptional training video.

  • @She_cooks2023
    @She_cooks2023 2 개월 전

    Amazing explanation !!

  • @prathyusha5393
    @prathyusha5393 3 년 전

    Thanks a bunch for these wonderful videos!

  • @jan-rw2qx
    @jan-rw2qx 11 개월 전

    First half is exactly how much I need to understand right now, thank you :)

  • @rodrigomaldonado5280

    new subscriber, amazing explanation!

  • @fahnub
    @fahnub 8 개월 전

    Thank you so much for these videos.

    • @CodeEmporium
      @CodeEmporium  8 개월 전 +1

      You are welcome! Thanks so much for commenting! Really appreciate it :)

  • @nooshnabi9248
    @nooshnabi9248 2 년 전

    Great Video! So easy to follow!

  • @TheMehrdadIE
    @TheMehrdadIE 3 년 전

    Awesome! How simple you explain these models :)

  • @MrsMarsis
    @MrsMarsis 3 년 전

    this is amazing, thank you very much!

  • @renosyaputra
    @renosyaputra 3 년 전

    Thank you, clear and direct explanation

  • @medomed1105
    @medomed1105 3 년 전

    Amazing Explanation

  • @ankitbaranwal8986
    @ankitbaranwal8986 3 년 전

    Thanks much! Appreciate this! 🙏🏼

  • @ilyasaroui7745
    @ilyasaroui7745 4 년 전

    Good touch to put the references on the description instead of on the slides

  • @AhmedHefny--
    @AhmedHefny-- 3 년 전

    that`s really amazing explanation thanks a lot

  • @findingx152
    @findingx152 9 개월 전

    great explanation.. Thanks !!

  • @aitrends8901
    @aitrends8901 년 전

    Very nice high level understanding of Transformers...

  • @srinivasanthiruvengadathan2177

    Excellent Explanation. Thanks

  • @namanbhayani1016
    @namanbhayani1016 3 년 전

    Very well explained!

  • @dhananjaysonawane1996

    @11:08 Please go on forever :):D... the best explanation I have seen so far, Thanks man!

  • @rofu37
    @rofu37 3 년 전

    Pure knowledge. Thank you

  • @dipanjanghosal6164

    Thanks for such a nice overview .. Very well done animation which augments the understanding further.. Maybe you could have touched on Roberta here and the differences. May be a separate video for that?

    • @CodeEmporium
      @CodeEmporium  4 년 전 +1

      Thanks! Roberta is on my list. Wasn't kidding when I said there is a lot on Bert. Will make that in another video

  • @dupontremi5638
    @dupontremi5638 년 전

    great explanation, I understood everything ! thanks a lot

  • @madhu1987ful
    @madhu1987ful 2 년 전

    Amazing and quick explanation man..thanks a lot :-)

  • @sinamolavipour5925

    Thanks for the nice presentation!

  • @venupunna9940
    @venupunna9940 3 년 전

    Thank you for the wonderful content...

  • @alidi5616
    @alidi5616 2 년 전

    That's it. The best explanation i came through. Receive my upvote and subscription 😁

  • @dakshbhatnagar
    @dakshbhatnagar 8 개월 전

    This helped! 💯