Course Content (Syllabus)
Course Content
Introduction to Artificial Intelligence and Machine Learning: Definitions and basic concepts (AI, ML, Deep Learning). Learning categories. Machine learning applications - limitations.
Introduction to Python and basic libraries.
Supervised Learning: Performance criteria (accuracy, precision, recall, ROC) - model comparison. Classification methods (k nearest neighbors, decision trees). Practical application in predicting natural variables from experimental or simulated data.
Artificial Neural Networks and Training: Basic principles (Perceptron, logistic regression, softmax function). Common activation functions (ReLU, tanh, sigmoid). Multi-layer neural networks. Deep Learning Models.
Recursive and Convolutional Neural Networks – Applications in Physics: Recursive neural networks (CNN, RNN, LSTM). Time series analysis of physical systems. Phase recognition of matter using CNN. Chaos and prediction using LSTM.
Overview of AI Applications in Physics: Applications in astronomy, high-energy physics, chaotic systems, and solid-state physics.
AI for accelerating simulations and solving inversely defined problems. Analyzing experimental data with machine learning tools.
Physics-Informed Neural Networks (PINNs): Incorporating physical laws into the training process of neural networks.
Differential equations and PINNs. Examples of solving PDEs (e.g. heat equation, wave equation). Using automatic differentiation.
Analysis of Complex and Nonlinear Systems. Reconstruction of Attractors (Takens), use of entropy and finding the Lyapunov exponents of nonlinear systems.
SINDy and Symbolic Regression for extracting equations from data. Applications to nonlinear dynamical systems.
Reinforcement Learning: Basic principles of Reinforcement Learning (RL). Environments - State, Action, Reward. Policy Optimization, Learning Q-values. Applications of RL to particle systems and robotic vehicle navigation.
Reservoir Computing. Definition - Basic principles - Advantages. Basic reservoir computing models: Echo State Networks (ESN), Liquid State Machines, Time Delay Reservoirs. Reservoir computer architectures and their physical implementations (optical, circuit, mechanical Reservoir).
Application of Reservoir Computing in time series forecasting and pattern recognition/categorization.
Course Bibliography (Eudoxus)
1. Μηχανική Μάθηση, Κ. Διαμαντάρας, Δ. Μπότσης, Κλειδάριθμος 2019. (Εύδοξος: 86198212)
2. Εγχειρίδιο Τεχνητής Νοημοσύνης, Charu C. Aggarwal, Γκιούρδας, 2023. (Εύδοξος: 122074123)
3. Νευρωνικά Δίκτυα & Μηχανική Μάθηση, H. Simon, Παπασωτηρίου, 2010. (Εύδοξος: 9743)
Additional bibliography for study
1. Machine Learning for Physics and Astronomy. A. Viviana, Princeton University Press, 2023.
2. Machine Learning for Physicists: A Hands-on Approach,Sadegh Raeisi, Sdighe Raeisi, IOP Publishing Ltd, 2023.
3. AI for Physics, Volker Knecht, CRC Press, 2022.