Alumni member

Activity

  • Postdocs: Mar 2022 - Jul 2024

Preprints

  • Sharpness-Aware Training for Accurate Inference on Noisy DNN Accelerators
    , , and François Leduc-Primeau
    Conference on Lifelong Learning Agents (CoLLAs) workshop, 2022.
    [Edge Intelligence Workshop (EIW), 2022]
    #DL
    [arXiv]

Conference and Journal Papers

2024

  1. Exploring Quantization for Efficient Pre-Training of Transformer Language Models
    , , , and
    Findings of the Association for Computational Linguistics (EMNLP), 2024.
    #NLP, #DL
    [arXiv]

  2. Should We Attend More or Less? Modulating Attention for Fairness
    , , Samira Shabanian, and
    Conference on Language Modeling (COLM), 2024.
    #NLP
    [arXiv]

  3. Why Don’t Prompt-Based Fairness Metrics Correlate?
    , , Ioana Baldini, and
    Annual Meeting of the Association for Computational Linguistics (ACL), 2024.
    #NLP
    [arXiv], [YouTube]

  4. Lookbehind-SAM: k steps back, 1 step forward
    , , Aristide Baratin, and
    International Conference on Machine Learning (ICML), 2024.
    #DL
    [arXiv], [code], [YouTube]

  5. Promoting Exploration in Memory-Augmented Adam using Critical Momenta
    , , Aristide Baratin, Reza Babanezhad Harikandeh, , Simon Lacoste-Julien, Razvan Pascanu, and
    Transactions on Machine Learning Research (TMLR), 2024.
    #DL
    [arXiv]

  6. Fast and Accurate Output Error Estimation for Memristor-Based Deep Neural Networks
    Jonathan Kern, Sébastien Henwood, , Elsa Dupraz, Abdeldjalil Aïssa-El-Bey, Yvon Savaria, and François Leduc-Primeau
    IEEE Transactions on Signal Processing, 2024.
    #DL
    [paper]

  7. Fairness-Aware Structured Pruning in Transformers
    , , Samira Shabanian, Ioana Baldini, and
    AAAI Conference on Artificial Intelligence (AAAI), 2024.
    #NLP
    [arXiv], [YouTube]

2023

  1. Training DNNs Resilient to Adversarial and Random Bit-Flips by Learning Quantization Ranges
    , , Jean Pierre David, and François Leduc-Primeau
    Transactions on Machine Learning Research (TMLR), 2023.
    #DL
    [openreview], [code]

  2. Deep Learning on a Healthy Data Diet: Finding Important Examples for Fairness
    , Prasanna Parthasarathi, , Hamid Palangi, Samira Shabanian, and
    AAAI Conference on Artificial Intelligence (AAAI), 2023.
    #NLP
    [arXiv], [YouTube]

2022

  1. Improving Meta-Learning Generalization with Activation-Based Early-Stopping
    , Christopher Pal, , and
    Conference on Lifelong Learning Agents (CoLLAs), 2022.
    #DL
    [arXiv], [code], [YouTube]