UnivIS
Informationssystem der Friedrich-Alexander-Universität Erlangen-Nürnberg © Config eG 
FAU Logo
  Sammlung/Stundenplan    Modulbelegung Home  |  Rechtliches  |  Kontakt  |  Hilfe    
Suche:      Semester:   
 
 Darstellung
 
Druckansicht

 
 
Modulbeschreibung (PDF)

 
 
 Außerdem im UnivIS
 
Vorlesungs- und Modulverzeichnis nach Studiengängen

Vorlesungsverzeichnis

 
 
Veranstaltungskalender

Stellenangebote

Möbel-/Rechnerbörse

 
 

Machine Learning in Signal Processing (MLISP)5 ECTS
(englische Bezeichnung: Machine Learning in Signal Processing)

Modulverantwortliche/r: Veniamin Morgenshtern
Lehrende: Veniamin Morgenshtern


Startsemester: WS 2019/2020Dauer: 1 SemesterTurnus: jährlich (WS)
Präsenzzeit: 60 Std.Eigenstudium: 90 Std.Sprache: Englisch

Lehrveranstaltungen:


Inhalt:

This course is an introduction into statistical machine learning and artificial intelligence. The special emphasis is on applications to modern signal processing problems. The course is focused on design principles of machine learning algorithms.

First we will study basic methods for regression and classification: linear regression, logistic regression, the nearest neighbors algorithm. Based on these examples, we will discuss the fundamental trade-off between the flexibility of the model and the ability to fit the model based on the moderate amount of training data. We will contrast learning in high-dimensional spaces vs. learning in low dimensional spaces.

Next, we will study methods that help make linear models flexible: polynomial features and splines. When these tools are used, regularization is crucial. We will discuss structured signal representations: short-time Fourier transform and wavelets. We will focus on the importance of sparsity in signal representations. This will lead us to compressed sensing and to other modern convex-optimization-based methods for signal denoising, reconstruction, and compression. We will review key concepts in convex optimization, study the LASSO, support vector machines, the idea of kernels. The last part of the course will focus on the breakthrough new technology for computer vision: the deep learning.

The course contains exercises: 30 percent mathematical and 70 percent programming in Python. You will be asked to implement basic machine learning and signal processing algorithms yourself. For more advanced algorithms, you will practice using powerful numerical and optimization libraries (numpy, cvxpy, scikit-learn, pywavelets, pytorch).

Lernziele und Kompetenzen:

Students are able to:

  • Apply standard machine learning and signal processing algorithms to design solutions to practical problems in new domains.

  • Use standard packages for machine learning in Python: numpy, cvxpy, scikit-learn, pywavelets, pytorch.

  • Choose appropriate algorithms and signal representations for the problem at hand.

  • Debug and calibrate machine learning algorithms. Develop simple modification to the standard algorithms as appropriate to the problem at hand.

  • Rapidly discover, understand, and apply advanced algorithms and signal representations that were not covered in class.

  • Explain the theoretical aspects that underpin the design of new algorithms.

  • Explain the importance of statistics and optimization in machine learning.

Literatur:

Literature:

• T. Hastie, R. Tibshirani, J. Friedman: The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition, Chapters 1–7.
• Ng: Lecture notes and materials for Stanford CS229 class. Lecture Notes and Exercises.
• M. Kon: Lecture notes on basics of wavelets.
• M. Nielsen: Neural networks and deep learning.


Weitere Informationen:

Schlüsselwörter: ASC, Machine Learning
www: https://en.lms.tf.fau.de/study-and-teaching/lectures/

Verwendbarkeit des Moduls / Einpassung in den Musterstudienplan:
Das Modul ist im Kontext der folgenden Studienfächer/Vertiefungsrichtungen verwendbar:

  1. Advanced Signal Processing & Communications Engineering (Master of Science)
    (Po-Vers. 2016w | TechFak | Advanced Signal Processing & Communications Engineering (Master of Science) | Gesamtkonto | Pflichtmodule | Machine Learning in Signal Processing)
  2. Communications and Multimedia Engineering (Master of Science)
    (Po-Vers. 2011 | TechFak | Communications and Multimedia Engineering (Master of Science) | Gesamtkonto | Wahlpflichtmodule | Technische Wahlpflichtmodule | Machine Learning in Signal Processing)
  3. Communications and Multimedia Engineering (Master of Science)
    (Po-Vers. 2011 | TechFak | Communications and Multimedia Engineering (Master of Science) | Gesamtkonto | Wahlmodule | Technische Wahlmodule | Machine Learning in Signal Processing)
  4. Information and Communication Technology (Master of Science)
    (Po-Vers. 2019s | TechFak | Information and Communication Technology (Master of Science) | Pflicht- und Wahlpflichtmodule der Studienschwerpunkte | Schwerpunkt Embedded Systems | Wahlpflichtmodul aus EEI im Schwerpunkt Embedded Systems | Machine Learning in Signal Processing)
  5. Information and Communication Technology (Master of Science)
    (Po-Vers. 2019s | TechFak | Information and Communication Technology (Master of Science) | Pflicht- und Wahlpflichtmodule der Studienschwerpunkte | Schwerpunkt Networks and Digital Communication | Wahlpflichtmodul aus EEI im Schwerpunkt Networks and Digital Communication | Machine Learning in Signal Processing)
  6. Information and Communication Technology (Master of Science)
    (Po-Vers. 2019s | TechFak | Information and Communication Technology (Master of Science) | Pflicht- und Wahlpflichtmodule der Studienschwerpunkte | Schwerpunkt Media Processing Systems | Wahlpflichtmodul aus EEI im Schwerpunkt Media Processing Systems | Machine Learning in Signal Processing)
  7. Informations- und Kommunikationstechnik (Master of Science)
    (Po-Vers. 2016s | TechFak | Informations- und Kommunikationstechnik (Master of Science) | Schwerpunkte im Masterstudium | Schwerpunkt Eingebettete Systeme | Wahlpflichtmodule | Wahlpflichtmodul aus EEI im Schwerpunkt Eingebettete Systeme | Machine Learning in Signal Processing)
  8. Informations- und Kommunikationstechnik (Master of Science)
    (Po-Vers. 2016s | TechFak | Informations- und Kommunikationstechnik (Master of Science) | Schwerpunkte im Masterstudium | Schwerpunkt Kommunikationsnetze und Übertragungstechnik | Wahlpflichtmodule | Wahlpflichtmodul aus EEI im Schwerpunkt Kommunikationsnetze | Machine Learning in Signal Processing)
  9. Informations- und Kommunikationstechnik (Master of Science)
    (Po-Vers. 2016s | TechFak | Informations- und Kommunikationstechnik (Master of Science) | Schwerpunkte im Masterstudium | Schwerpunkt Multimediasysteme | Wahlpflichtmodule | Wahlpflichtmodul aus EEI im Schwerpunkt Multimediasysteme | Machine Learning in Signal Processing)

Studien-/Prüfungsleistungen:

Machine Learning in Signal Processing (Prüfungsnummer: 84401)
Prüfungsleistung, Klausur, Dauer (in Minuten): 90, benotet, 5 ECTS
Anteil an der Berechnung der Modulnote: 100.0 %
Prüfungssprache: Englisch

Erstablegung: WS 2019/2020, 1. Wdh.: SS 2020
1. Prüfer: Veniamin Morgenshtern
Termin: 22.10.2020, 13:30 Uhr, Ort: H 8 TechF
Termin: 26.02.2021, 11:00 Uhr, Ort: H 11

UnivIS ist ein Produkt der Config eG, Buckenhof