Publications

Fuel

More recent at the top.

  1. Optimal mini-batch and step sizes for SAGA
    N. Gazagnadou, RMG, J. Salmon
    arXiv:1902.000713, 2019. [code StochOpt.jl]

  2. SGD: general analysis and improved rates
    RMG, N. Loizou, X. Qian, A. Sailanbayev, E. Shulgin, P. Richtárik
    arXiv:1901.09401, 2019.

  3. Improving SAGA via a probabilistic interpolation with gradient descent
    A. Bibi, A. Sailanbayev, B. Ghanem, RMG and P. Richtárik
    arXiv:1806.05633, 2018

  4. Stochastic quasi-gradient methods: variance reduction via Jacobian sketching
    RMG, P. Richtárik and Francis Bach
    arXiv:1805.02632, 2018. [code StochOpt.jl]

  5. Accelerated stochastic matrix inversion: general theory and speeding up BFGS rules for faster second-order optimization
    RMG, Filip Hanzely, P. Richtárik and S. Stich
    Advances in Neural Information Processing Systems, 2018. [code StochOpt.jl]

  6. Learning about random media from near-surface backscattering: using machine learning to measure particle size and concentration
    Artur L. Gower, RMG, Jonathan Deakin, William J. Parnell and I. David Abrahams
    Europhysics Letters, Volume 122, Number 5, 2018

  7. Greedy stochastic algorithms for entropy-regularized optimal transport problems
    Brahim Khalil Abid and RMG
    Proceedings of the 21st International Conference on Artificial Intelligence and Statistics, PMLR, 84:1505-1512, 2018

  8. Tracking the gradients using the Hessian: A new look at variance reducing stochastic methods
    RMG, Nicolas Le Roux and Francis Bach
    Proceedings of the 21st International Conference on Artificial Intelligence and Statistics, PMLR, 84:707-715, 2018. [code StochOpt.jl]

  9. Randomized quasi-Newton updates are linearly convergent matrix inversion algorithms
    RMG and P. Richtárik
    SIAM Journal on Matrix Analysis and Applications , 38(4), 1380-1409, 2017

  10. Linearly Convergent Randomized Iterative Methods for Computing the Pseudoinverse
    RMG and P. Richtárik
    arXiv:1612.06255, 2016

  11. Sketch and Project: Randomized Iterative Methods for Linear Systems and Inverting Matrices
    RMG
    PhD Dissertation, School of Mathematics, The University of Edinburgh, 2016

  12. Stochastic Block BFGS: Squeezing More Curvature out of Data
    RMG, D. Goldfarb and P. Richtárik
    In Proceedings of the 33rd International Conference on Machine Learning, 2016

  13. Stochastic dual ascent for solving linear systems
    RMG and P. Richtárik
    arXiv:1512.06890, 2015

  14. Randomized iterative methods for linear systems
    RMG and P. Richtárik
    SIAM Journal on Matrix Analysis and Applications 36(4), 1660-1690, 2015
    The 1st Most Downloaded Paper from the SIMAX website (May 2017)

  15. High order reverse automatic differentiation with emphasis on the third order
    RMG and A.L. Gower
    Mathematical Programming 155(1), 81-103, 2014

  16. Computing the sparsity pattern of Hessians using automatic differentiation,
    RMG and M.P. Mello
    ACM Transactions on Mathematical Software 40(2), 1-15, 2014

  17. A new framework for Hessian automatic differentiation
    RMG and M.P. Mello
    Optimization Methods and Software 27(2), 251-273, 2012
Reports

Fuel

Technical and industrial mathematics study group reports

  1. Train Positioning Using Video Odometry
    RMG, R. Whittaker, M.D. Wykes, J. Christmas, P. Browne, J. Van lent,
    A.L. Gower and S. Ghosh
    The MIIS Eprints Archive, 2014

  2. Action constrained quasi-Newton methods (software)
    RMG and J. Gondzio
    Technical Report ERGO 14-020, 2014

  3. Conjugate Gradients: The short and painful explanation with oblique projections, 2014

  4. Hessian matrices via automatic differentiation
    R.M.Gower and M.P. Mello
    State University of Campinas technical report rp16-10 Master's thesis (despite title page, it is in English!), 2011

  5. Efficient calculation of derivatives through graph coloring
    R.M.Gower and M.P. Mello
    State University of Campinas technical report part I and part II, 2009
Miscellaneous

Fuel

Sometimes I wear the hat of a reviewer

Referee for
  • Conference on Neural Information Processing Systems (Neurips)
  • International Conference on Machine Learning (ICML)
  • Journal of Machine Learning Research (JMLR)
  • SIAM Journal on Scientific Computing (SOIPT)
  • Optimization Methods and Software, Taylor & Francis
  • Mathematical Programming Computation, Springer
  • Computational and Applied Mathematics, Springer
  • Numerical Algorithms, Springer
  • BIT Numerical Mathematics, Springer

HTML Comment Box is loading comments...