Focus on: 
Login

SO Basics of Neural Networks 2025

→ Europe/Madrid
Salón de Actos (IAA-CSIC)

Salón de Actos

IAA-CSIC
Description

Deep learning (DL) is a family of techniques widely used in multiple fields with excellent results. Unfortunately, DL has a steep  learning curve. Fortunately, several domain-specific libraries have been developed to facilitate the use of DL models. 

For the widespread adoption of these techniques, researchers should be able to design and use their own DL models. Image classification is one of the main applications of DL  in astrophysics and offers a convenient way to learn about neural networks. The de facto standard to tackle this problem is Convolutional Neural Networks (CNN), a concrete deep learning architecture.  This course will serve as an introduction to Deep Learning with four  sessions with the following objectives: understanding the basics of neural networks, getting to know the fundamental libraries and fundamental architectures, learning how to train a CNN, gaining confidence in using CNNs for image classification tasks, and learning how to evaluate their preformance.

The tutor of this school is Dr Francisco Eduardo Sanchez Karhunen (Universidad de Sevilla).

There will be coffee breaks available to participants.

Contents

  • Session 1: Deep Learning fundamentals
  • Session 2: Convolutional Neural Networks fundamentals
  • Session 3: Practical considerations in real-world CNNs
  • Session 4: Evaluation 

For more details, see the agenda below.

The repository with contents and materials can be found in Github (TBC)

Organizing Committee 

  • Rainer Schödel (Chair), IAA-CSIC, Spain 
  • Laura Darriba, IAA-CSIC, Spain  
  • Javier Moldón, IAA-CSIC, Spain 

Registration

This course will be an in-person event, and it is limited to 25 participants in order to assure adequate interaction and individualised attention. Inscription will be handled on a first come, first serve basis. To formalize the participation you must fill the mandatory fields in the registration form https://form.jotform.com/250704428022346. 

 

The registration fee is 135 euros. It includes two coffee breaks daily.

 

 

 

 

 

This event is supported by the "Center of Excellence Severo Ochoa" award to the Instituto de Astrofísica de Andalucía. We acknowledge financial support from the Severo Ochoa grant CEX2021-001131-S funded by MCIN/AEI/ 10.13039/501100011033 from the Instituto de Astrofísica de Andalucía.

  • Thursday, 16 October
    • 09:00 → 12:00
      Session 1: Deep Learning fundamentals 3h

      • Roots of deep learning techniques. Reasons for layer stacking. Role of weights and activation functions. Layer as a map between representation spaces. Model parameters. Basic structure for classification tasks. Network training as an optimization problem. Weight initialization techniques. Typical loss functions and optimizers. Learning-rate scheduling.

      • Hands-on lab: Build from scratch a basic multilayer neural network using the Tensorflow-2 library. Sequential mode of layer stacking. Model training to tackle a classical basic image classification problem.

      Speaker: Dr Francisco Eduardo Sanchez Karhunen (Universidad de Sevilla)
    • 14:00 → 18:30
      Session 2: Convolutional Neural Networks fundamentals 4h 30m

      • Drawbacks of classical multilayer networks in image classification tasks. Human brain image handling. Convolutional layers: padding and stride. Types of pooling layer. Kernels for feature map extraction. Kernel stacking. CNNs as an extension of classical stacked layer models. Top layers in CNNs.

      • Hands-on lab. Build from scratch a basic CNN for image classification using the Galaxy10 dataset.

      Speaker: Francisco Eduardo Sanchez Karhunen (Universidad de Sevilla)
  • Friday, 17 October
    • 09:00 → 13:00
      Session 3: Practical considerations in real-world CNNs 4h

      • Overfitting in CNNs. Techniques for overfitting reduction: data augmentation and drop-out. Types of data augmentation. Drop-out rates. Transfer learning: concept and usage. Top Pre-Trained models for image classification. Handling large image datasets: ImageDataGenerators.

      • Hands-on lab: Use of ImageDataGenerators combined with realistic folder structures in image classification problems. Inclusion of data augmentation in our preprocessing pipelines. Add drop-out layers to the CNN design in session 2. Use of transfer learning in a real situation.

      Speaker: Francisco Eduardo Sanchez Karhunen (Universidad de Sevilla)
    • 14:00 → 17:00
      Session 4: Evaluation 3h
      Speaker: Francisco Eduardo Sanchez Karhunen
Powered by Indico