Publications by Gonçalo Mordido

Activity

• Postdocs: Mar 2022 - Jul 2024

Preprints

• Sharpness-Aware Training for Accurate Inference on Noisy DNN Accelerators
  Gonçalo Mordido, Sarath Chandar, and François Leduc-Primeau
  Conference on Lifelong Learning Agents (CoLLAs) workshop, 2022.
  [Edge Intelligence Workshop (EIW), 2022]
  #DL
  [arXiv]

Conference and Journal Papers

2024

10. Exploring Quantization for Efficient Pre-Training of Transformer Language Models
    Kamran Chitsaz, Quentin Fournier, Gonçalo Mordido, and Sarath Chandar
    Findings of the Association for Computational Linguistics (EMNLP), 2024.
    #NLP, #DL
    [arXiv]

11. Should We Attend More or Less? Modulating Attention for Fairness
    Abdelrahman Zayed, Gonçalo Mordido, Samira Shabanian, and Sarath Chandar
    Conference on Language Modeling (COLM), 2024.
    #NLP
    [arXiv]

12. Why Don’t Prompt-Based Fairness Metrics Correlate?
    Abdelrahman Zayed, Gonçalo Mordido, Ioana Baldini, and Sarath Chandar
    Annual Meeting of the Association for Computational Linguistics (ACL), 2024.
    #NLP
    [arXiv], [YouTube]

13. Lookbehind-SAM: k steps back, 1 step forward
    Gonçalo Mordido, Pranshu Malviya, Aristide Baratin, and Sarath Chandar
    International Conference on Machine Learning (ICML), 2024.
    #DL
    [arXiv], [code], [YouTube]

14. Promoting Exploration in Memory-Augmented Adam using Critical Momenta
    Pranshu Malviya, Gonçalo Mordido, Aristide Baratin, Reza Babanezhad Harikandeh, Jerry Huang, Simon Lacoste-Julien, Razvan Pascanu, and Sarath Chandar
    Transactions on Machine Learning Research (TMLR), 2024.
    #DL
    [arXiv]

15. Fast and Accurate Output Error Estimation for Memristor-Based Deep Neural Networks
    Jonathan Kern, Sébastien Henwood, Gonçalo Mordido, Elsa Dupraz, Abdeldjalil Aïssa-El-Bey, Yvon Savaria, and François Leduc-Primeau
    IEEE Transactions on Signal Processing, 2024.
    #DL
    [paper]

16. Fairness-Aware Structured Pruning in Transformers
    Abdelrahman Zayed, Gonçalo Mordido, Samira Shabanian, Ioana Baldini, and Sarath Chandar
    AAAI Conference on Artificial Intelligence (AAAI), 2024.
    #NLP
    [arXiv], [YouTube]

2023

3. Training DNNs Resilient to Adversarial and Random Bit-Flips by Learning Quantization Ranges
   Kamran Chitsaz, Gonçalo Mordido, Jean Pierre David, and François Leduc-Primeau
   Transactions on Machine Learning Research (TMLR), 2023.
   #DL
   [openreview], [code]

4. Deep Learning on a Healthy Data Diet: Finding Important Examples for Fairness
   Abdelrahman Zayed, Prasanna Parthasarathi, Gonçalo Mordido, Hamid Palangi, Samira Shabanian, and Sarath Chandar
   AAAI Conference on Artificial Intelligence (AAAI), 2023.
   #NLP
   [arXiv], [YouTube]

2022

1. Improving Meta-Learning Generalization with Activation-Based Early-Stopping
   Simon Guiroy, Christopher Pal, Gonçalo Mordido, and Sarath Chandar
   Conference on Lifelong Learning Agents (CoLLAs), 2022.
   #DL
   [arXiv], [code], [YouTube]