publications

publications by categories in reversed chronological order. generated by jekyll-scholar.

2025

  1. Thinking Slow, Fast: Scaling Inference Compute with Distilled Reasoners
    Daniele Paliotta, Junxiong Wang, Matteo Pagliardini, and 6 more authors
    2025
  2. Leveraging the true depth of LLMs
    Ramón Calvo González, Daniele Paliotta, Matteo Pagliardini, and 2 more authors
    2025
  3. M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models
    Junxiong Wang, Wen-Ding Li, Daniele Paliotta, and 3 more authors
    2025

2024

  1. The Mamba in the Llama: Distilling and Accelerating Hybrid Models
    Junxiong Wang, Daniele Paliotta, Avner May, and 2 more authors
    In Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 - 15, 2024, 2024
  2. Understanding and Minimising Outlier Features in Transformer Training
    Bobby He, Lorenzo Noci, Daniele Paliotta, and 2 more authors
    In Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 - 15, 2024, 2024

2023

  1. Graph Neural Networks Go Forward-Forward
    Daniele Paliotta, Mathieu Alain, Bálint Máté, and 1 more author
    2023
  2. Fast Causal Attention with Dynamic Sparsity
    Daniele Paliotta, Matteo Pagliardini, Martin Jaggi, and 1 more author
    In Workshop on Efficient Systems for Foundation Models @ ICML2023, 2023
  3. Fast Attention Over Long Sequences With Dynamic Sparse Flash Attention
    Matteo Pagliardini, Daniele Paliotta, Martin Jaggi, and 1 more author
    In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023, 2023
  4. SUPA: A Lightweight Diagnostic Simulator for Machine Learning in Particle Physics
    Atul Kumar Sinha, Daniele Paliotta, Bálint Máté, and 3 more authors
    In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023, 2023