This page contains a list of my publications and other projects I have done. To see my curriculum vitae/resume, see here.

Publications

1. PINNACLE: PINN Adaptive ColLocation and Experimental points selection.
   Gregory Kang Ruey Lau*, Apivich Hemachandra*, See-Kiong Ng and Bryan Kian Hsiang Low.
   ICLR 2024 Spotlight Presentation. Acceptance rate: 5%.
   
   abstract (click to show)

   Physics-Informed Neural Networks (PINNs), which incorporate PDEs as soft constraints, train with a composite loss function that contains multiple training point types: different types of collocation points chosen during training to enforce each PDE and initial/boundary conditions, and experimental points which are usually costly to obtain via experiments or simulations. Training PINNs using this loss function is challenging as it typically requires selecting large numbers of points of different types, each with different training dynamics. Unlike past works that focused on the selection of either collocation or experimental points, this work introduces PINN Adaptive ColLocation and Experimental points selection (PINNACLE), the first algorithm that jointly optimizes the selection of all training point types, while automatically adjusting the proportion of collocation point types as training progresses. PINNACLE uses information on the interactions among training point types, which had not been considered before, based on an analysis of PINN training dynamics via the Neural Tangent Kernel (NTK). We theoretically show that the criterion used by PINNACLE is related to the PINN generalization error, and empirically demonstrate that PINNACLE is able to outperform existing point selection methods for forward, inverse, and transfer learning problems.


2. Training-Free Neural Active Learning With Initialization-Robustness Guarantees.
   Apivich Hemachandra, Zhongxiang Dai, Jasraj Singh, See-Kiong Ng and Bryan Kian Hsiang Low.
   ICML 2023. Acceptance rate: 27.9%.
   
   abstract (click to show) paper (arXiv) code (GitHub)

   Existing neural active learning algorithms have aimed to optimize the predictive performance of neural networks (NNs) by selecting data for labelling. However, other than a good predictive performance, being robust against random parameter initializations is also a crucial requirement in safety-critical applications. To this end, we introduce our expected variance with Gaussian processes (EV-GP) criterion for neural active learning, which is theoretically guaranteed to select data points which lead to trained NNs with both (a) good predictive performances and (b) initialization robustness. Importantly, our EV-GP criterion is training-free, i.e., it does not require any training of the NN during data selection, which makes it computationally efficient. We empirically demonstrate that our EV-GP criterion is highly correlated with both initialization robustness and generalization performance, and show that it consistently outperforms baseline methods in terms of both desiderata, especially in situations with limited initial data or large batch sizes.

Undergraduate Senior Thesis

The title of my undergraduate thesis is “Data Diversification in Different Domains”. You can visit this page for further details.

Industry-Related Projects

I, with a few others, are working on projects with PTTEP, a Thai company who deals with extraction of petroleum. The projects I work on involves automation of tasks currently done by human, and will often require skills and knowledge from machine learning, statistics, mathematics and even physics.

Other Projects

For other projects I have done in the past (mostly pre-2020 during my undergraduate), see here.