Diferencias

Muestra las diferencias entre dos versiones de la página.

--- materias:pln:2019:teoricos [2019/04/01 14:01] – francolq
+++ materias:pln:2019:teoricos [2019/09/20 10:59] (actual) – francolq
@@ Línea 11: / Línea 11: @@
   * [[http://web.stanford.edu/class/cs224n/|Natural Language Processing with Deep Learning (Chris Manning, Stanford, 2019)]] ([[https://web.stanford.edu/class/archive/cs/cs224n/cs224n.1184/|Winter 2018]], [[https://web.stanford.edu/class/archive/cs/cs224n/cs224n.1174/|Winter 2017]])
     * **[[https://www.youtube.com/playlist?list=PL3FW7Lu3i5Jsnh1rnUwq_TcylNr7EkRe6|Video Lectures (2017)]]**
+    * **[[https://www.youtube.com/playlist?list=PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z|Video Lectures (2019)]]**
   * [[http://www.cs.columbia.edu/~cs4705/|Natural Language Processing (Michael Collins, Columbia, 2013)]]
     * **[[http://academictorrents.com/details/8a8f93e18dd6c46c48ee2936ed500b1ff4cc9175|Torrent]]**
@@ Línea 71: / Línea 72: @@
 ===== 5ta clase: 25 de marzo =====
+{{:materias:pln:2019:errorsmeme.png?direct&400|}}
@@ Línea 93: / Línea 96: @@
     * [[https://www.youtube.com/watch?v=Z7RxBcpyN1U&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=36|Learning Sentiment Lexicons]]
     * [[https://www.youtube.com/watch?v=3Eo--0_ocIk&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=37|Other Sentiment Tasks]]
+===== 7ma clase: 1 de abril =====
+  * Regresión Logística:
+    * [[https://www.youtube.com/watch?v=YQClUDd9ff4&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=38|Generative vs Discriminative Models]]
+    * [[https://www.youtube.com/watch?v=MemiaOYSB0k&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=39|Making features from text for discriminative NLP models]]
+    * [[https://www.youtube.com/watch?v=7-7MlBdy3EE&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=40|Feature Based Linear Classifiers
+]]
+    * [[https://www.youtube.com/watch?v=uRJjelMVcPA&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=41|Building a Maxent Model The Nuts and Bolts]]
+    * [[https://www.youtube.com/watch?v=_Niy2f-M9KA&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=42|Generative vs. Discriminative models: The problem of overcounting evidence]]
+    * [[https://www.youtube.com/watch?v=E1k2bG6fKrY&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=43|Maximizing the Likelihood]]
+===== 8va clase: 4 de abril =====
+  * PLN con Deep Learning (curso [[http://web.stanford.edu/class/cs224n|Socher]]):
+    * [[http://web.stanford.edu/class/cs224n/lectures/lecture1.pdf|Introduction to NLP and Deep Learning]] ([[https://cs.famaf.unc.edu.ar/~francolq/uba2018/lecture1-2.pdf|versión corta]], [[https://www.youtube.com/watch?v=OQQ-W_63UgQ&t=2725s&index=1&list=PL3FW7Lu3i5Jsnh1rnUwq_TcylNr7EkRe6|videolecture]])
+    * [[http://web.stanford.edu/class/cs224n/lectures/lecture2.pdf|Word Vectors 1]] ([[https://www.youtube.com/watch?v=ERibwqs9p38&t=0s&index=2&list=PL3FW7Lu3i5Jsnh1rnUwq_TcylNr7EkRe6|videolecture]])
+    * [[http://web.stanford.edu/class/cs224n/lectures/lecture3.pdf|Word Vectors 2]] ([[https://cs.famaf.unc.edu.ar/~francolq/uba2018/lecture3-2.pdf|versión corta]], [[https://www.youtube.com/watch?v=ASn7ExxLZws&t=4121s&index=3&list=PL3FW7Lu3i5Jsnh1rnUwq_TcylNr7EkRe6|videolecture]])
+===== 9na clase: 8 de abril =====
+  * Etiquetado de secuencias:
+    * [[https://www.youtube.com/watch?v=JhJU0Akkqzo&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=56|Introducción al Part-of-Speech (POS) tagging]]
+    * [[https://www.youtube.com/watch?v=Zm_bmRhbaQg&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=57|Algunos métodos y resultados]]
+  * Más sobre etiquetado de secuencias (curso de Collins):
+    * [[https://www.youtube.com/watch?v=6jUva-eD-xY&list=PLlQBy7xY8mbI13gwXZz4r55MeatSZOqm7&index=1|Etiquetado de secuencias]]
+    * [[https://www.youtube.com/watch?v=VMZM7AYjEsg&list=PLlQBy7xY8mbI13gwXZz4r55MeatSZOqm7&index=2|Modelos generativos para el aprendizaje supervisado]]
+    * [[https://www.youtube.com/watch?v=cAJmM5k62yM&list=PLlQBy7xY8mbI13gwXZz4r55MeatSZOqm7&index=3|Introducción a los Hidden Markov Models (HMMs)]]
+    * [[https://www.youtube.com/watch?v=uAT3iJpQwJ0&list=PLlQBy7xY8mbI13gwXZz4r55MeatSZOqm7&index=4|Estimación de parámetros de HMMs]]
+===== 10ma clase: 11 de abril =====
+  * Etiquetado de secuencias: Algoritmo de Viterbi para HMMs (curso de Collins).
+    * [[https://www.youtube.com/watch?v=ECu_KQV3V30&list=PLlQBy7xY8mbI13gwXZz4r55MeatSZOqm7&index=5|5. The Viterbi Algorithm for HMMs - Part I]]
+    * [[https://www.youtube.com/watch?v=WqGUa54x8wE&list=PLlQBy7xY8mbI13gwXZz4r55MeatSZOqm7&index=6|6. The Viterbi Algorithm for HMMs - Part II]]
+    * [[https://www.youtube.com/watch?v=Bu7oSlNCmdU&list=PLlQBy7xY8mbI13gwXZz4r55MeatSZOqm7&index=7|7. The Viterbi Algorithm for HMMs - Part III]]
+    * [[https://www.youtube.com/watch?v=Y5hXE23Tdzc&list=PLlQBy7xY8mbI13gwXZz4r55MeatSZOqm7&index=8|8. Summary]]
+===== 11va clase: 15 de abril =====
+   * Modelos log-linear (Michael Collins):
+     * [[https://www.youtube.com/watch?v=IS-uxts3RaQ&list=PLlQBy7xY8mbLci-jOGu9zEo_RgtEIKuzm&index=1|1. Introduction]]
+     * [[https://www.youtube.com/watch?v=r6nH0km8qGk&list=PLlQBy7xY8mbLci-jOGu9zEo_RgtEIKuzm&index=2|2. Two Example Problems]]
+     * [[https://www.youtube.com/watch?v=ks3jVp2tkyw&list=PLlQBy7xY8mbLci-jOGu9zEo_RgtEIKuzm&index=3|3. Features in Log-Linear Models - Part I]]
+     * [[https://www.youtube.com/watch?v=RJwE_Hh0kRg&list=PLlQBy7xY8mbLci-jOGu9zEo_RgtEIKuzm&index=4|4. Features in Log-Linear Models - Part II]]
+     * [[https://www.youtube.com/watch?v=lLhKPJ4zVwQ&list=PLlQBy7xY8mbLci-jOGu9zEo_RgtEIKuzm&index=5|5. Definition of Log-Linear Models - Part I]]
+     * [[https://www.youtube.com/watch?v=Vjuuyp_X840&list=PLlQBy7xY8mbLci-jOGu9zEo_RgtEIKuzm&index=6|6. Definition of Log-Linear Models - Part II]]
+     * [[https://www.youtube.com/watch?v=3yaVtAs33tE&list=PLlQBy7xY8mbLci-jOGu9zEo_RgtEIKuzm&index=7|7. Parameter Estimation in Log-Linear Models - Part I]]
+     * [[https://www.youtube.com/watch?v=2M3and23C9o&list=PLlQBy7xY8mbLci-jOGu9zEo_RgtEIKuzm&index=8|8. Parameter Estimation in Log-Linear Models - Part II]]
+     * [[https://www.youtube.com/watch?v=zNCRFZNZ4zM&list=PLlQBy7xY8mbLci-jOGu9zEo_RgtEIKuzm&index=9|9. Smoothing Regularization in Log-Linear Models]]
+   * Modelos log-linear para etiquetado de secuencias  (Michael Collins):
+     * [[https://www.youtube.com/watch?v=2JtXXA9jf48&list=PLlQBy7xY8mbKeIEDbRgNjwTY3CblY6mWo&index=1|1. Introduction]]
+     * [[https://www.youtube.com/watch?v=ALbpKKIRgI4&list=PLlQBy7xY8mbKeIEDbRgNjwTY3CblY6mWo&index=2|2. Recap of the Tagging Problem]]
+     * [[https://www.youtube.com/watch?v=bCHE0I_d_58&list=PLlQBy7xY8mbKeIEDbRgNjwTY3CblY6mWo&index=3|3. Independence Assumptions in Log-linear Taggers]]
+     * [[https://www.youtube.com/watch?v=_FpDvRSZLVI&list=PLlQBy7xY8mbKeIEDbRgNjwTY3CblY6mWo&index=4|4. Features in Log-Linear Taggers]]
+     * [[https://www.youtube.com/watch?v=K6bVMy5KsB0&list=PLlQBy7xY8mbKeIEDbRgNjwTY3CblY6mWo&index=5|5. Parameters in Log-Linear Models]]
+     * [[https://www.youtube.com/watch?v=U6-MN1Rt_FA&list=PLlQBy7xY8mbKeIEDbRgNjwTY3CblY6mWo&index=6|6. The Viterbi Algorithm for Log-Linear Taggers]]
+     * [[https://www.youtube.com/watch?v=5Axk8JhR3Mg&list=PLlQBy7xY8mbKeIEDbRgNjwTY3CblY6mWo&index=7|7. An Example Application]]
+     * [[https://www.youtube.com/watch?v=lnZCnRLjsPM&list=PLlQBy7xY8mbKeIEDbRgNjwTY3CblY6mWo&index=8|8. Summary]]
+===== 12va clase: 22 de abril =====
+  * Análisis sintáctico y gramáticas libres de contexto (curso de Collins):
+     * [[https://www.youtube.com/watch?v=0tGFWbc2834&list=PLlQBy7xY8mbK9Uy9i7MTGSwyLJPii3w1L&index=1|1. Introduction]]
+     * [[https://www.youtube.com/watch?v=cNezM-Lirrg&list=PLlQBy7xY8mbK9Uy9i7MTGSwyLJPii3w1L&index=2|2. Introduction to the Parsing Problem - Part I]]
+     * [[https://www.youtube.com/watch?v=7IFNJysB23o&list=PLlQBy7xY8mbK9Uy9i7MTGSwyLJPii3w1L&index=3|3. Introduction to the Parsing Problem - Part II]]
+     * [[https://www.youtube.com/watch?v=zYqNH-dduKw&list=PLlQBy7xY8mbK9Uy9i7MTGSwyLJPii3w1L&index=4|4. Context-Free Grammars - Part I]]
+     * [[https://www.youtube.com/watch?v=e2M-rYrBbdQ&list=PLlQBy7xY8mbK9Uy9i7MTGSwyLJPii3w1L&index=5|5. Context-Free Grammars - Part II]]
+     * [[https://www.youtube.com/watch?v=w14jNdszrCQ&list=PLlQBy7xY8mbK9Uy9i7MTGSwyLJPii3w1L&index=6|6. A Simple Grammar for English - Part I]]
+     * [[https://www.youtube.com/watch?v=NdV6j3cAXDA&list=PLlQBy7xY8mbK9Uy9i7MTGSwyLJPii3w1L&index=7|7. A Simple Grammar for English - Part II]]
+     * [[https://www.youtube.com/watch?v=WFospacX6ms&list=PLlQBy7xY8mbK9Uy9i7MTGSwyLJPii3w1L&index=8|8. A Simple Grammar for English - Part III]]
+     * [[https://www.youtube.com/watch?v=YOMhR7yV9dk&list=PLlQBy7xY8mbK9Uy9i7MTGSwyLJPii3w1L&index=9|9. A Simple Grammar for English - Part IV]]
+     * [[https://www.youtube.com/watch?v=EvPpV9YZHNk&list=PLlQBy7xY8mbK9Uy9i7MTGSwyLJPii3w1L&index=10|10. Examples of Ambiguity]]
+===== 13va clase: 29 de abril =====
+  * Parsing Introduction (curso de Jurafsky y Manning):
+    * [[https://www.youtube.com/watch?v=XCm4js8wp4A&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=58|1. Syntactic Structure Constituency vs Dependency]]
+    * [[https://www.youtube.com/watch?v=xLa2A4pBF6I&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=59|2. Empirical Data-Driven Approach to Parsing]]
+    * [[https://www.youtube.com/watch?v=zJ_wC4EW_ak&list=PLQiyVNMpDLKnZYBTUOlSI9mi9wAErFtFm&index=60|3. The Exponential Problem in Parsing]]
+  * PCFGs (curso de Collins):
+     * [[https://www.youtube.com/watch?v=2hLBHSKbS44&list=PLlQBy7xY8mbKypSJe_AjVtCuXXsdODiDi&index=1|1. Introduction]]
+     * [[https://www.youtube.com/watch?v=wSONlMwa9rE&list=PLlQBy7xY8mbKypSJe_AjVtCuXXsdODiDi&index=2|2. Basics of PCFGs - Part I]]
+     * [[https://www.youtube.com/watch?v=DjwH9wzCFzg&list=PLlQBy7xY8mbKypSJe_AjVtCuXXsdODiDi&index=3|3. Basics of PCFGs - Part II]]
+     * [[https://www.youtube.com/watch?v=5YGqouHpclY&list=PLlQBy7xY8mbKypSJe_AjVtCuXXsdODiDi&index=4|4. The CKY Parsing Algorithm - Part I]]
+     * [[https://www.youtube.com/watch?v=0XmVYAG1ZAo&list=PLlQBy7xY8mbKypSJe_AjVtCuXXsdODiDi&index=5|5. The CKY Parsing Algorithm - Part II]]
+     * [[https://www.youtube.com/watch?v=dH2dHMT0tOA&list=PLlQBy7xY8mbKypSJe_AjVtCuXXsdODiDi&index=6|6. The CKY Parsing Algorithm - Part III]]
+===== 14va clase: 6 de mayo =====
+{{:materias:pln:2019:deepmeme.png?direct&400|}}
+  * Introducción a Redes Neuronales:
+    * [[https://www.youtube.com/watch?v=8CWyBNX6eDo&list=PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z&index=3|Neural Networks (cs224n lecture 3)]]
+    * [[https://www.youtube.com/watch?v=yLYHDSv-288&list=PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z&index=4|Backpropagation (cs224n lecture 4)]]
+===== 15va clase: 9 de mayo =====
+  * Charla [[https://drive.google.com/drive/folders/1x09yGkLIRixkvDa1UbeTk913m0AAU2LK|"De 0 a 20 en Redes Neuronales"]]:
+    * [[https://drive.google.com/open?id=1SGYt5zaykw38OMFOpaQJAq09240iiDyL2OlJzG2juSs|slides]]
+    * [[https://drive.google.com/open?id=1TW16qiUXKfnm0uky5qjXQO-jWmc1rfZn|ejemplo (Jupyter Notebook)]]
+    * [[https://drive.google.com/open?id=1sYNCeW_QjnLG8wKx9eltPCqPNkHpZU3h|dataset]]
+===== 16va clase: 13 de mayo =====
+  * Redes Neuronales Recurrentes:
+    * [[https://www.youtube.com/watch?v=iWea12EAu6U&list=PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z&index=6|Language Models and RNNs (cs224n lecture 6)]]
+    * [[https://www.youtube.com/watch?v=QEw0qEa0E50&list=PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z&index=7|Vanishing Gradients, Fancy RNNs (cs224n lecture 7)]]
+  * Links:
+    * [[http://colah.github.io/posts/2015-08-Understanding-LSTMs/|Understanding LSTM Networks]]
+===== 17ma clase: 16 de mayo =====
+  * Traducción Automática y modelos "sequence to sequence":
+    * [[https://www.youtube.com/watch?v=XXtpJxZBa2c&list=PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z&index=8| Translation, Seq2Seq, Attention (cs224n lecture 8)]]
+===== 20 y 23 de mayo =====
+Semana de mayo sin clases teóricas.
+===== 18va clase: 27 de mayo =====
+  * [[https://www.youtube.com/watch?v=fyqm8fRDgl0&list=PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z&index=10|Practical Tips for Projects (cs224n lecture 9)]]
+===== 19na clase: 30 de mayo =====
+  * [[https://www.youtube.com/watch?v=yIdF-17HwSk&list=PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z&index=11|Question Answering (cs224n lecture 10)]]
+===== 20va clase: 3 de junio =====
+  * [[https://www.youtube.com/watch?v=EAJoRA0KX7I&list=PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z&index=12|Convolutional Networks for NLP (cs224n lecture 11)]]
+===== 21va clase: 6 de junio =====
+  * [[https://www.youtube.com/watch?v=S-CspeZ8FHc&list=PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z&index=14|Contextual Word Embeddings (cs224n lecture 13)]]
+  * Links:
+    * [[http://nlp.seas.harvard.edu/2018/04/03/attention.html|The Annotated Transformer]] (Alexander Rush)
+===== 10 de junio =====
+No hubo (profesor lesionado).
+===== 22va clase: 13 de junio =====
+  * [[https://www.youtube.com/watch?v=3wWZBGN-iX8&list=PLoROMvodv4rOhcuXMZkNm7j3fVwBBY42z&index=21|Future of NLP + Deep Learning (cs224n lecture 20)]]
+===== 17 y 20 de junio =====
+¡Feriados y fin de clases!