Eduardo Arnold

Eduardo Arnold

Lead Computer Vision Engineer

Cartesian

Biography

I’m a lead computer vision engineer at Cartesian where I work on visual relocalisation, structure-from-motion and general 3D vision. I was previously at Niantic also working on visual relocalization and SLAM. I hold a PhD from the University of Warwick (UK) in the Intelligent Vehicles group. My research focused on 3D vision for autonomous driving, including cooperative 3D object detection, point cloud registration and sensor pose optimisation.

Interests

  • 3D Computer Vision
  • Structure-from-Motion
  • Visual Relocalisation
  • SLAM and Visual-Odometry

Education

  • PhD in Machine Learning for Autonomous Driving, 2017 - 2021

    University of Warwick (UK)

  • BSc in Electrical Engineering with Honours, 2011 - 2017

    Federal University of Santa Catarina (Brazil)

Experience

 
 
 
 
 

Lead Computer Vision Engineer

Cartesian

Feb 2024 – Present Cambridge, USA
  • Optimized a Structure-from-Motion pipeline resulting in a reduction of mapping times from 655min to 102min, a 6-fold speed up.
  • Created benchmark tool that creates ground-truth maps and quantify the quality of mapping and localization with high accuracy.
  • Wrote new production visual re-localization pipeline with PyTorch resulting in 3x faster, 10x higher throughput, using 100x less memory than previous baseline and saving more than 95% in cloud compute costs.
  • Designed and implemented an end-to-end mapping pipeline that process raw data into production-ready SfM maps using Ray workflows on Azure Kubernetes Service (AKS).
  • Trained a global feature model (NetVLAD) for image retrieval in specific data domains, resulting in 10% improvement in localization performance.
  • Designed and implemented a system architecture using REDIS, Helm and K8s to allow scaling the re-localization service to a very large number of simultaneous requests across thousands of maps, whilst maintaining QoS.
 
 
 
 
 

Machine Learning Engineer

Niantic

May 2022 – Dec 2023 London, UK
  • Ran several state-of-the-art SLAM methods on internal datasets and devised an evaluation protocol to compare them.
  • Designed and developed a localization pipeline to align scans to a large scale reference reconstruction in challenging environments.
  • Created a renderer that process >100bi points in less than 20s.
  • Helped adding Lidar-based terms to COLMAP, reducing re-projection median errors from 60px to 3px.
  • Trained and evaluated different NERF variants using aerial views.
  • Performed Camera-IMU calibration which helped to identify time-sync issues.
  • Created multiple Argo/K8s workflows to process data at scale using cloud infrastructure (GCP).
 
 
 
 
 

PhD Research Intern

Niantic

Jun 2021 – Jan 2022 London, UK

Used computer vision and machine learning techniques for augmented reality applications;

  • Created a new benchmark and dataset for visual re-localization with a team of skilled researchers;
  • Trained and evaluated several families of visual localisation methods on this benchmark;
  • Used cloud infrastructure to train and evaluate deep learning models;
  • Presented research outcomes to a cross-disciplinary audience;
  • Paper published at ECCV 2022
 
 
 
 
 

Teaching Assistant

University of Warwick

May 2019 – Apr 2020 Coventry, United Kingdom
  • Prepared and delivered tutorials on PyTorch and fundamentals of machine learning;
  • Prepared module assessments and marked students;
  • Created a Dockerized Jupyterhub platform for students to run their code remotely.
 
 
 
 
 

Research Assistant

University of Warwick

Aug 2018 – Jun 2021 Coventry, United Kingdom

The L3 Pilot European Consortium studies the impact of vehicle automation with key European OEMs. My main responsibilities were:

  • Lead the creation of a responsive online platform to support data visualisation of piloting data across the project.
  • Attend international meetings with key partners in the automotive sector to meet project requirements and report results.

Recent Publications

(2022). Map-free Visual Relocalization: Metric Pose Relative to a Single Image. ECCV 2022 - European Conference on Computer Vision.

PDF Code Dataset Preprint Video

(2021). Fast and Robust Registration of Partially Overlapping Point Clouds. 2021 IEEE Robotics and Automation Letters (RA-L).

PDF Code Dataset Preprint

(2021). Data Study Group Final Report: Greenvest Solutions. September 2020 Alan Turing Data Study Group.

PDF

(2020). Cooperative Perception for 3D Object Detection in Driving Scenarios using Infrastructure Sensors. IEEE Transactions on Intelligent Transportation Systems.

PDF Code Dataset Preprint

(2020). The L3Pilot Data Management Toolchain for a Level 3 Vehicle Automation Pilot. Electronics.

PDF

Contact