UnivIS
Information system of Friedrich-Alexander-University Erlangen-Nuremberg © Config eG 
FAU Logo
  Collection/class schedule    module collection Home  |  Legal Matters  |  Contact  |  Help    
search:      semester:   
 
 Layout
 
printable version

 
 
 Also in UnivIS
 
course list

lecture directory

 
 
events calendar

job offers

furniture and equipment offers

 
 

  Lab Course Machine Learning in Signal Processing (LabMLISP)

Lecturer
Prof. Dr. Veniamin Morgenshtern

Details
Praktikum
4 cred.h, compulsory attendance, ECTS studies, ECTS credits: 2,5
nur Fachstudium, Sprache Englisch
Time and place: Wed 12:00 - 15:00, 06.021

Fields of study
WPF ASC-MA ab 1 (ECTS-Credits: 2,5)
WPF CME-MA ab 1 (ECTS-Credits: 2,5)

Prerequisites / Organisational information
Knowledge of Python programming language is required. Basic theoretical knowledge in machine learning is assumed: consider taking the Machine Learning in Signal Processing (MLSIP) course in the same semester.

Contents
Imagine a car driving on an autobahn in an automatic mode. Among other things, the car needs to steer itself to keep driving in it's own lane. To accomplish this, the central problem is to detect the road-lane markings. These are the white solid or dashed lines that are drawn on each side of the lane. The standard modern approach to solve this type of problems is to take a large dataset of labled examples and train a deep neural network model to accomplish the task. This is how car and pedestrian detection algorithms are developed. The difficulty with the road-lane markings is that there is no labled dataset of them and creating such dataset would cost millions of dollars.
In this lab course we will solve this problem using transfer learning and mathematical modeling:
  • Create cartoon-like artificial images of a road with known locations for the lane markings.

  • Train deep neural network on these artificial images with heavy data augmentations that mimic real-world images.

  • Create a dataset of unlabeled real-life videos by downloading and organizing examples from youtube.

  • Create a machine learning pipeline for working with these videos efficiently.

  • Apply the neural network that has been trained on artificial data to the real world videos.

  • Analyze the quality of results produced by the network.

  • Use mathematical modeling to correct the outputs of the network.

  • Retrain the network on the dataset composed of the corrected outputs.

  • Measure and analyze the quality of the results.

The software will be written in Python using JupyterLab development framework. Access to modern GPU servers will be provided. This is an intensive research-level course; the result of the course might be the creation of state-of-the-art lane detection system for self-driving cars.

ECTS information:
Title:
Lab Course Machine Learning in Signal Processing

Credits: 2,5

Prerequisites
Knowledge of Python programming language is required. Basic theoretical knowledge in machine learning is assumed: consider taking the Machine Learning in Signal Processing (MLSIP) course in the same semester.

Contents
Imagine a car driving on an autobahn in an automatic mode. Among other things, the car needs to steer itself to keep driving in it's own lane. To accomplish this, the central problem is to detect the road-lane markings. These are the white solid or dashed lines that are drawn on each side of the lane. The standard modern approach to solve this type of problems is to take a large dataset of labled examples and train a deep neural network model to accomplish the task. This is how car and pedestrian detection algorithms are developed. The difficulty with the road-lane markings is that there is no labled dataset of them and creating such dataset would cost millions of dollars.
In this lab course we will solve this problem using transfer learning and mathematical modeling:
  • Create cartoon-like artificial images of a road with known locations for the lane markings.

  • Train deep neural network on these artificial images with heavy data augmentations that mimic real-world images.

  • Create a dataset of unlabeled real-life videos by downloading and organizing examples from youtube.

  • Create a machine learning pipeline for working with these videos efficiently.

  • Apply the neural network that has been trained on artificial data to the real world videos.

  • Analyze the quality of results produced by the network.

  • Use mathematical modeling to correct the outputs of the network.

  • Retrain the network on the dataset composed of the corrected outputs.

  • Measure and analyze the quality of the results.

The software will be written in Python using JupyterLab development framework. Access to modern GPU servers will be provided. This is an intensive research-level course; the result of the course might be the creation of state-of-the-art lane detection system for self-driving cars.

Additional information
Expected participants: 15, Maximale Teilnehmerzahl: 20
www: https://lms.tf.fau.de/studium-und-lehre/lehrveranstaltungen/

Verwendung in folgenden UnivIS-Modulen
Startsemester SS 2019:
Lab Course Machine Learning in Signal Processing (LabMLISP)

Department: Chair of Multimedia Communications and Signal Processing (Prof. Dr. Kaup)
UnivIS is a product of Config eG, Buckenhof