CE 470 | Course Introduction and Application Information - Department of Software Engineering

Course Name

Introduction to Neural Networks

Code	Semester	Theory (hour/week)	Application/Lab (hour/week)	Local Credits	ECTS
CE 470	Fall/Spring	3	0	3	5

Prerequisites	None
Course Language	English
Course Type	Elective
Course Level	First Cycle
Mode of Delivery	-
Teaching Methods and Techniques of the Course	Problem Solving Case Study Lecture / Presentation
National Occupation Classification	-
Course Coordinator	Dr. Öğr. Üyesi Kaya OĞUZ
Course Lecturer(s)	-
Assistant(s)	-

Course Objectives

This course will introduce the fundamental principles and algorithms of Artificial Neural Network (ANN) systems. The course will cover many subjects including basic neuron model, simple perceptron, adaptive linear element, Least Mean Square (LMS) algorithm, Multi Layer Perceptron (MLP), Back Propagation (BP) learning algorithm, Radial Basis Function (RBF) networks, Self Organizing Maps (SOM) and Learning Vector Quantization (LVQ), Support Vector Machines (SVMs), Continuous time and discrete time Hopfield networks, classification techniques, pattern recognition, signal processing and control applications.

Learning Outcomes

#	Content	PC Sub	* Contribution Level
#	Content	PC Sub	1	2	3	4	5
1	Describe basic artificial neural network models,
2	Use the most common ANN architectures and their learning algorithms for a specific application,
3	Explain the principles of supervised and unsupervised learning, and generalization ability,
4	Evaluate the practical considerations in applying ANNs to real classification, pattern recognition, signal processing and control problems,
5	Implement basic ANN models and algorithms using Matlab and its Neural Network Toolbox.

Course Description

The following topics will be included in the course: The main neural network architectures and learning algorithms, perceptrons and the LMS algorithm, back propagation learning, radial basis function networks, support vector machines, Kohonen’s self organizing feature maps, Hopfield networks, artificial neural networks for signal processing, pattern recognition and control.

Course Category	Core Courses
	Major Area Courses
	Supportive Courses	X
	Media and Management Skills Courses
	Transferable Skill Courses

Week	Subjects	Related Preparation	Learning Outcome
1	Biological motivation. Historical remarks on artificial neural networks. Applications of artificial neural networks. A taxonomy of artificial neural network models and learning algorithms.	Introduction. S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761. Lecture Notes.
2	General artificial neuron model. Discretevalued perceptron model, threshold logic and their limitations. Discretetime (dynamical) Hopfield networks. Hebb’s rule. Connection wieght matrix as an outer product of memory patterns.	Chapter 1. S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761. Lecture Notes.
3	Supervised learning. Perceptron learning algorithm. Adaptive linear element. Supervised learning as output error minimization problem. Gradient descent algorithm for minimization. Least mean square rule.	Chapter 2. S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761. Lecture Notes.
4	Single layer, continuous valued perceptron. Nonlinear (sigmoidal) activation function. Delta rule. Batch mode and pattern mode gradient descent algorithms. Convergence conditions for deterministic and stochastic gradient descent algorithms.	Chapter 3. Chapter 4: Sections 4.1, 4.2, 4.16. S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761. Lecture Notes.
5	Multi layer perceptron as universal approximator. Function representation and approximation problems. Backpropagation Learning. Local minima problem. Overtraining.	Chapter 4: Sections 4.4, 4.5, 4.8, 4.10, 4.12. S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761. Lecture Notes.
6	Midterm Exam I.
7	Batch and pattern mode training. Training set versus test set. Overfitting problem. General practices for network training and testing. Signal processing and pattern recognition applications of multilayer perceptrons.	Chapter 4: Sections 4.3, 4.10., 4.11, 4.13, 4.14, 4.15, 4.19, 4.20. S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761.
8	Radial Basis Function (RBF) network. Backpropagation learning for determining linear weights, centers and widths parameters of RBF networks. Random selection of centers. Input versus input-output clustering for center and width determination. Regularization theory, mixture of Gaussian (conditional probability density function) model and neurofuzzy connections of RBF networks.	Chapter 5. S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761
9	Parametric versus nonparametric methods for data representation. Unsupervised learning as a vector quantization problem. Competitive networks. Winner takes all networks. Kohonen’s self organizing feature map. Clustering.	Chapter 9. S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761.
10	Signal processing applications of artificial neural networks. Principal component analysis. Data compression and reduction. Image and 1D signal compression and transformation applications of artificial neural networks.	Chapter 8. S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761
11	Midterm Exam II.
12	Pattern recognition applications of artificial neural networks. Artificial neural networks for feature extraction. Nonlinear feature mapping. Data fusion. Artificial neural networks as classifiers. Image and speech recognition applications.	Sections 1.4,1.5., 3.11, 4.7, 5.8, 6.7, S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761. Lecture Notes.
13	Implementation of artificial neural networks models and associated learning algorithms for signal processing, pattern recognition and control in MATLAB numerical software environment.	L. Fausett, Fundamentals of Neural Networks, Chapter 6, Prentice Hall, ISBN-13: 978-0133341867
14	Cumulative review of artificial neural networks models, learning algorithms and their applications.	S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761. Lecture Notes.
15	Semester Review
16	Final Exam

Course Notes/Textbooks

S. Haykin, Neural Networks and Learning Machines, Pearson Education, 3rd Ed., 2009, ISBN13 9780131293762 ISBN10 0131293761

Suggested Readings/Materials

J. M. Zurada, Int. To Artificial Neural Systems, West Publishing Company, 1992 ISBN 053495460X, 9780534954604.

L. Fausett, Fundamentals of Neural Networks, Prentice Hall, ISBN-13: 978-0133341867

Semester Activities	Number	Weighting	LO 1	LO 2	LO 3	LO 4	LO 5
Participation
Laboratory / Application
Field Work
Quizzes / Studio Critiques
Portfolio
Homework / Assignments	5	20
Presentation / Jury
Project	1	30
Seminar / Workshop
Oral Exams
Midterm	2	50
Final Exam
Total

Weighting of Semester Activities on the Final Grade		100
Weighting of End-of-Semester Activities on the Final Grade
Total

Semester Activities	Number	Duration (Hours)	Workload
Theoretical Course Hours (Including exam week: 16 x total hours)	16	3	48
Laboratory / Application Hours (Including exam week: '.16.' x total hours)	16		0
Study Hours Out of Class	14	3	42
Field Work			0
Quizzes / Studio Critiques			0
Portfolio			0
Homework / Assignments	2	3	6
Presentation / Jury			0
Project	1	24	24
Seminar / Workshop			0
Oral Exam			0
Midterms	2	15	30
Final Exam			0
		Total	150

#	PC Sub	Program Competencies/Outcomes	* Contribution Level
#	PC Sub	Program Competencies/Outcomes	1	2	3	4	5
1	Engineering Knowledge: Knowledge of mathematics, science, basic engineering, computer computation, and topics specific to related engineering disciplines; the ability to use this knowledge in solving complex engineering problems		-	-	-	X	-
	1	Mathematics	-	-	-	-	-
	2	Science	-	-	-	-	-
	3	Basic engineering	-	-	-	-	-
	4	Computer computation	-	-	-	-	-
	5	Topics specific to related engineering disciplines	-	-	-	-	-
	6	The ability to use this knowledge in solving complex engineering problems	-	-	-	-	-
2	Problem Analysis: The ability to define, formulate, and analyze complex engineering problems by using fundamental science, mathematics, and engineering knowledge, while considering the relevant UN Sustainable Development Goals (SDGs) related to the problem.		-	-	-	-	X
3	Engineering Design: The ability to design creative solutions to complex engineering problems; the ability to design complex systems, processes, devices, or products that meet present and future requirements, considering realistic constraints and conditions.		-	-	-	-	-
	1	The ability to design creative solutions to complex engineering problems	-	-	-	-	-
	2	Considering realistic constraints and conditions in designing complex systems, processes, devices, or products	-	-	-	-	-
	3	The ability to design in a way that meets current and future requirements	-	-	-	-	-
4	Use of Techniques and Tools: The ability to select and use appropriate techniques, resources, and modern engineering and information technology tools, including prediction and modeling, for the analysis and solution of complex engineering problems, while being aware of their limitations		-	-	X	-	-
5	Research and Investigation: The ability to use research methods, including literature review, designing experiments, conducting experiments, collecting data, analyzing and interpreting results, for the investigation of complex engineering problems.		X	-	-	-	-
	1	The ability to use research methods, including literature review	-	-	-	-	-
	2	Designing experiments	-	-	-	-	-
	3	Conducting experiments, collecting data, analyzing and interpreting results, for the investigation of complex engineering problems	-	-	-	-	-
6	Global Impact of Engineering Practices: Knowledge of the impacts of engineering practices on society, health and safety, the economy, sustainability, and the environment within the scope of the UN Sustainable Development Goals (SDGs); awareness of the legal consequences of engineering solutions		-	-	-	-	-
	1	Global Impact of Engineering Practices: Knowledge of the impacts of engineering practices on society, health and safety, the economy, sustainability, and the environment within the scope of the UN Sustainable Development Goals (SDGs)	-	-	-	-	-
	2	Awareness of the legal consequences of engineering solutions	-	-	-	-	-
7	Ethical Behavior: Acting in accordance with the principles of the engineering profession; knowledge of ethical responsibility; awareness of acting impartially and inclusively, without discrimination in any matter. (FENG101)		-	-	-	-	-
	1	Acting in accordance with the principles of the engineering profession; knowledge of ethical responsibility	-	-	-	-	-
	2	Awareness of acting impartially and inclusively, without discrimination in any matter.	-	-	-	-	-
8	Individual and Team Work: The ability to work effectively as an individual and as a member or leader of both intra-disciplinary and interdisciplinary teams (whether face-to-face, remote, or hybrid).		-	-	-	-	-
9	Verbal and Written Communication: Taking into account the various differences of the target audience (such as education, language, profession), particularly in technical matters.		-	-	-	-	-
	1	Verbal (ENGxxx)	-	-	-	-	-
	2	Written effective communication skills. (ENGxxx)	-	-	-	-	-
10	Project Management: Knowledge of business practices such as project management and economic feasibility analysis; awareness of entrepreneurship and innovation.		-	-	-	-	-
	1	Knowledge of business practices such as project management and economic feasibility analysis; (FENG497-FENG498)	-	-	-	-	-
	2	Awareness of entrepreneurship and innovation. (FENG101)	-	-	-	-	-
11	Lifelong Learning: The ability to learn independently and continuously, adapt to new and emerging technologies, and think critically about technological changes.		-	-	-	-	-

CE 470 | Course Introduction and Application Information

WEEKLY SUBJECTS AND RELATED PREPARATION STUDIES

EVALUATION SYSTEM

ECTS / WORKLOAD TABLE

COURSE LEARNING OUTCOMES AND PROGRAM QUALIFICATIONS RELATIONSHIP

NEWSALL NEWS

Visit of broadAngle in Izmir University of Economics

Success Stories of Izmir University of Economics Students

NEW GÜZELBAHÇE CAMPUS

GLOBAL CAREER

CONTRIBUTION TO SCIENCE

VALUING PEOPLE

BENEFIT TO SOCIETY