Publications | Apprentissage profond

Prépublications

• Protein Language Models: Is Scaling Necessary?
  Quentin Fournier, Robert M. Vernon, Almer van der Sloot, Benjamin Schulz, Sarath Chandar et Christopher James Langmead
  In bioRxiv, 2024.
  #DL, #Other
  [bioRxiv], [code]

• Exploring the Plasticity of Neural Network for NLP Tasks in Continual Learning
  Maryam Hashemzadeh, Pranshu Malviya*, Darshan Patil* et Sarath Chandar
  Conference on Lifelong Learning Agents (CoLLAs) workshop, 2024.
  #DL, #NLP
  

• BindGPT: A Scalable Framework for 3D Molecular Design via Language Modeling and Reinforcement Learning
  Artem Zholus, Maksim Kuznetsov, Roman Schutski, Rim Shayakhmetov, Daniil Polykovskiy, Sarath Chandar et Alex Zhavoronkov
  In arXiv, 2024.
  #DL, #RL
  [arXiv], [website]

• Predicting the Impact of Model Expansion through the Minima Manifold: A Loss Landscape Perspective
  Pranshu Malviya, Jerry Huang, Quentin Fournier et Sarath Chandar
  In ArXiv, 2024.
  #DL
  [arXiv]

• Interpretability Needs a New Paradigm
  Andreas Madsen, Himabindu Lakkaraju, Siva Reddy et Sarath Chandar
  In ArXiv, 2024.
  #NLP, #DL, #Other
  [arXiv]

• Segmentation of Multiple Sclerosis Lesions across Hospitals: Learn Continually or Train from Scratch?
  Naga Karthik Enamundram, Anne Kerbrat, Pierre Labauge, Tobias Granberg, Jason Talbott, Daniel S. Reich, Massimo Filippi, Rohit Bakshi, Virginie Callot, Sarath Chandar et Julien Cohen-Adad
  In ArXiv, 2022.
  #DL
  [arXiv], [code]

• Feature diversity in self-supervised learning
  Pranshu Malviya* et Arjun Vaithilingam Sudhakar*
  Conference on Lifelong Learning Agents (CoLLAs) workshop, 2022.
  #DL
  [arXiv]

• Sharpness-Aware Training for Accurate Inference on Noisy DNN Accelerators
  Gonçalo Mordido, Sarath Chandar et François Leduc-Primeau
  Conference on Lifelong Learning Agents (CoLLAs) workshop, 2022.
  [Edge Intelligence Workshop (EIW), 2022]
  #DL
  [arXiv]

• An Introduction to Lifelong Supervised Learning
  Shagun Sodhani, Mojtaba Farmazi, Sanket Vaibhav Mehta, Pranshu Malviya, Mohamed Abdelsalam, Janarthanan Rajendran et Sarath Chandar
  In ArXiv, 2022.
  #DL
  [arXiv]

• RECOVER: Sequential Model Optimization Platform for Combination Drug Repurposing Identifies Novel Synergistic Compounds in vitro
  Paul Bertin, Jarrid Rector-Brooks, Deepak Sharma, Thomas Gaudelet, Andrew Anighoro, Torsten Gross, Francisco Martínez-Peña, Eileen L. Tang, Suraj M S, Cristian Regep, Jeremy Hayter, Maksym Korablyov, Nicholas Valiante, Almer van der Sloot, Mike Tyers, Charles Roberts, Michael M. Bronstein, Luke L. Lairson, Jake P. Taylor-King et Yoshua Bengio
  In arXiv, 2022.
  #DL
  [arXiv], [code]

Articles de conférence et de revue

2024

17. Exploring Quantization for Efficient Pre-Training of Transformer Language Models
    Kamran Chitsaz, Quentin Fournier, Gonçalo Mordido et Sarath Chandar
    Findings of the Association for Computational Linguistics (EMNLP), 2024.
    #NLP, #DL
    [arXiv]

18. Lookbehind-SAM: k steps back, 1 step forward
    Gonçalo Mordido, Pranshu Malviya, Aristide Baratin et Sarath Chandar
    International Conference on Machine Learning (ICML), 2024.
    #DL
    [arXiv], [code], [YouTube]

19. Promoting Exploration in Memory-Augmented Adam using Critical Momenta
    Pranshu Malviya, Gonçalo Mordido, Aristide Baratin, Reza Babanezhad Harikandeh, Jerry Huang, Simon Lacoste-Julien, Razvan Pascanu et Sarath Chandar
    Transactions on Machine Learning Research (TMLR), 2024.
    #DL
    [arXiv]

20. A Responsible Framework for Applying Artificial Intelligence on Medical Images and Signals at the Point-of-care: the PACS-AI Platform
    Pascal Theriault-Lauzier, Denis Cobin, Olivier Tastet, Elodie Labrecque Langlais, Bahareh Taji, Guson Kang, Aun-Yeong Chong, Derek So, An Tang, Judy Wawira Gichoya, Sarath Chandar, Pierre-Luc Déziel, Julie G Hussin, Samuel Kadoury et Robert Avram
    Canadian Journal of Cardiology, 2024.
    #DL, #Other
    

21. Mastering Memory Tasks with World Models
    Mohammad Reza Samsami*, Artem Zholus*, Janarthanan Rajendran et Sarath Chandar
    International Conference on Learning Representations (ICLR), 2024. [Oral presentation.]
    #RL, #DL
    [openreview]

22. On the Costs and Benefits of Adopting Lifelong Learning for Software Analytics - Empirical Study on Brown Build and Risk Prediction
    Doriane Olewicki, Sarra Habchi, Mathieu Nayrolles, Mojtaba Faramarzi, Sarath Chandar et Bram Adams
    International Conference on Software Engineering (ICSE) - Software Engineering in Practice Track, 2024. [ICSE24 SEIP Distinguished Paper Award.]
    #DL
    [arXiv]

23. Fast and Accurate Output Error Estimation for Memristor-Based Deep Neural Networks
    Jonathan Kern, Sébastien Henwood, Gonçalo Mordido, Elsa Dupraz, Abdeldjalil Aïssa-El-Bey, Yvon Savaria et François Leduc-Primeau
    IEEE Transactions on Signal Processing, 2024.
    #DL
    [paper]

2023

10. Training DNNs Resilient to Adversarial and Random Bit-Flips by Learning Quantization Ranges
    Kamran Chitsaz, Gonçalo Mordido, Jean Pierre David et François Leduc-Primeau
    Transactions on Machine Learning Research (TMLR), 2023.
    #DL
    [openreview], [code]

11. An Empirical Investigation of the Role of Pre-training in Lifelong Learning
    Sanket Vaibhav Mehta, Darshan Patil, Sarath Chandar et Emma Strubell
    Journal of Machine Learning Research, 2023.
    #DL
    [arXiv]

12. DEUP: Direct Epistemic Uncertainty Prediction
    Moksh Jain, Salem Lahlou, Hadi Nekoei, Victor Butoi, Paul Bertin, Jarrid Rector-Brooks, Maksym Korablyov et Yoshua Bengio
    Transactions on Machine Learning Research (TMLR), 2023.
    #DL
    [arXiv], [code]

13. Label fusion and training methods for reliable representation of inter-rater uncertainty
    Andreanne Lemay, Charley Gros, Naga Karthik Enamundram et Julien Cohen-Adad
    The Journal of Machine Learning for Biomedical Imaging (MELBA), 2023.
    #DL
    [paper]

2022

6. TAG: Task-based Accumulated Gradients for Lifelong Learning
   Pranshu Malviya, Balaraman Ravindran et Sarath Chandar
   Conference on Lifelong Learning Agents (CoLLAs), 2022.
   [Workshop on Theory and Foundation of Continual Learning, ICML, 2021]
   #DL
   [arXiv], [code]

7. Improving Meta-Learning Generalization with Activation-Based Early-Stopping
   Simon Guiroy, Christopher Pal, Gonçalo Mordido et Sarath Chandar
   Conference on Lifelong Learning Agents (CoLLAs), 2022.
   #DL
   [arXiv], [code], [YouTube]

8. Biological Sequence Design with GFlowNets
   Moksh Jain, Emmanuel Bengio, Alex-Hernandez Garcia, Jarrid Rector-Brooks, Bonaventure F. P. Dossou, Chanakya Ekbote, Jie Fu, Tianyu Zhang, Micheal Kilgour, Dinghuai Zhang, Lena Simine, Payel Das et Yoshua Bengio
   International Conference on Machine Learning (ICML), 2022.
   #DL
   [arXiv], [code]

9. Memory Augmented Optimizers for Deep Learning
   Paul-Aymeric McRae, Prasanna Parthasarathi, Mido Assran et Sarath Chandar
   International Conference on Learning Representations (ICLR), 2022.
   #DL
   [openreview], [code]

10. PatchUp: A Feature-Space Block-Level Regularization Technique for Convolutional Neural Networks
    Mojtaba Faramarzi, Mohammad Amini, Akilesh Badrinaaraayanan, Vikas Verma et Sarath Chandar
    AAAI Conference on Artificial Intelligence (AAAI), 2022.
    #DL
    [arXiv], [code]

2021

1. IIRC: Incremental Implicitly-Refined Classification
   Mohamed Abdelsalam, Mojtaba Faramarzi, Shagun Sodhani et Sarath Chandar
   Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
   #DL
   [arXiv], [code], [website], [PyPI], [docs]