Short description of portfolio item number 1
Posts by Collection
portfolio
Short description of portfolio item number 2
projects
1. Automatic problem reduction using machine learning
Motivation: In the big data era, the size of many real-world combinatorial optimisation problems has increased significantly over the years, making the problems very hard to solve. This project aims to develop innovative problem reduction methods using machine learning to reduce the size of large-scale optimisation problems so that the reduced problems can be solved by existing optimisation algorithms.
Gap: The traditional problem reduction methods are designed manually, relying on the intuition or insights of an expert. In contrast, we will develop innovative machine learning models to automate the process of problem reduction, alleviating the requirement of domain knowledge. The underlying mechanism of the proposed method is illustrated in the context of Travelling Salesman Problem (TSP) as follows.
Training: Firstly, a set of small and easy TSP instances are solved to optimality, with the optimal routes highlighted in yellow in the corresponding graph (left subfigure). Features (e.g. edge weight) are then extracted to characterise each edge in the graphs, and edges are mapped to the feature space as training examples (middle subfigure). Finally, classification algorithms can be used to learn a decision boundary in the feature space to well separate edges that are part of the optimal routes from those which are not (right subfigure).
Testing: Given an unsolved TSP instance (left subfigure), each edge in the corresponding graph is first mapped to a point in the feature space (middle subfigure). Based on the location of the points with respect to the optimal decision boundary, the edges that are not expected to be part of the optimal route can be predicted and removed from the corresponding graph (right subfigure).
Current progress: This conceptual framework was originally described in our recent IEEE TPAMI paper. As a proof of concept, we have shown that this framework works well on two problems. As this is a largely unexplored research area, we see great potential in this hybrid technique and a lot of opportunities for future work.
Publications: [IEEE TPAMI, OR Spectrum]
2. Automatic problem decomposition using machine learning
To appear
3. Optimal solution prediction
To appear
4. Boosting meta-heuristics via machine learning
To appear
5. Instance space analysis and algorithm selection
To appear
6. Problem decomposition for black-box continuous optimization
To appear
publications
Conference papers
- Wu, H., Wang, W., Malepathirana, T., Senanayake, D., Oetomo, D., Halgamuge, S. (2024). When To Grow? A Fitting Risk-Aware Policy for Layer Growing in Deep Neural Networks. In Proceedings of the Thirty-Eight AAAI Conference on Artificial Intelligence (AAAI-24). AAAI. [PDF]
- Wu, H., Zhuang, B. (2024). Fast and Accurate Continual Test Time Domain Adaptation. In ACM MM Workshop on Continual Learning 2024. [PDF]
Under Review
- Wu, H., Wang, Wei., Malepathirana, T., Seneviratne, S., Oetomo, D., Halgamuge, S. TT-MPD: Test Time Model Pruning and Distillation.
- Wu, H., Zhuang, B. LLM-BIP: Structured Pruning for Large Language Models with Block-Wise Forward Importance Propagation.
- Wu, H., Wang, Wei., Malepathirana, S., Oetomo, D., Halgamuge, S. Neural Growth Policy Design: The Regularization Effect Perspective.
talks
Published:
This is a description of your talk, which is a markdown files that can be all markdown-ified like any other post. Yay markdown!
Published:
This is a description of your tutorial, note the different field in type. This is a markdown files that can be all markdown-ified like any other post. Yay markdown!
Published:
This is a description of your talk, which is a markdown files that can be all markdown-ified like any other post. Yay markdown!
Published:
This is a description of your conference proceedings talk, note the different field in type. You can put anything in this field.
teaching
Undergraduate course, University 1, Department, 2014
This is a description of a teaching experience. You can use markdown like any other post.
Heading 1
Heading 2
Heading 3
Workshop, University 1, Department, 2015
This is a description of a teaching experience. You can use markdown like any other post.