MTO

Evolutionary Multitask Optimization

[Wikipedia]

Introduction

Evolutionary Multitask Optimization is a paradigm proposed by [1] in the optimization literature that focuses on solving multiple self-contained tasks at the same time. Inspired by the well-established concepts of transfer learning and multi-task learning in predictive analytics, the key motivation behind multitask optimization is that if optimization tasks are related to each other (in terms of their optimal solutions, or the general characteristics of their function landscapes), then the search progress on one can be transferred to substantially speedup the search on the other. Notably, the success of the paradigm is not necessarily limited to one-way knowledge transfers from simpler to more complex tasks. In fact, in an attempt to intentionally solve a harder task, several simpler ones may often be unintentionally solved.

[1].A. Gupta, Y. Ong and L. Feng, "Multifactorial Evolution: Toward Evolutionary Multitasking," in IEEE Transactions on Evolutionary Computation, vol. 20, no. 3, pp. 343-357, June 2016, doi: 10.1109/TEVC.2015.2458037.

News

Contact us


If you have any question, please contact us.


Email: liangf@cqu.edu.cn     yuxiaohuang@cqu.edu.cn.

Evolutionary Multitask Optimization

[Wikipedia]

Download

  • B. Da, Y. S. Ong, L. Feng, A.K. Qin, A. Gupta, Z. Zhu, C. K. Ting, K. Tang, and X. Yao, "Evolutionary Multitasking for Single-objective Continuous Optimization: Benchmark Problems, Performance Metric, and Baseline Results", Technical Report, 2016.

    Single-Objective MFO benchmark problems and baseline codes are available.Click here!

  • Y. Yuan, Y. S. Ong., L. Feng, A.K. Qin, A. Gupta., B. Da, Q. Zhang, K. C. Tan, Y. Jin, and H. Ishibuchi, "Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results", Technical Report, 2016.

    Multi-Objective MFO benchmark problems and baseline codes are available.Click here!

New MTO Benchmarks for WCCI 2020 Competition on Evolutionary Multi-task Optimization :


  • New Single-Objective Complex 2-task benchmark problems are available.Click here!

  • New Multi-Objective Complex 2-task benchmark problems are available.Click here!

  • New Single-Objective Manytask(50-Tasks) benchmark problems are available.Click here!

  • New Multi-Objective Manytask(50-Tasks) benchmark problems are available.Click here!


    • New MTO Benchmarks for GECCO 2020 Competition on Evolutionary Multi-task Optimization :


  • New Single-Objective Manytask(50-Tasks) benchmark problems are available.Click here!

  • New Multi-Objective Manytask(50-Tasks) benchmark problems are available.Click here!

    • Evolutionary Multitask Optimization

    [Wikipedia]

    Methods

    In the existing literature, two common approaches for multitask optimization span Bayesian optimization and evolutionary computation.

    • Multitask Bayesian optimization is a recent model-based approach that leverages the concept of knowledge transfer to speedup the automatic hyperparameter optimization process of machine learning algorithms. The method builds a multitask Gaussian process model on the data originating from different searches progressing in tandem. The captured inter-task dependencies are thereafter utilized to better inform the subsequent sampling of candidate solutions in the respective search spaces.

    • Evolutionary multitasking has been explored as a means of exploiting the implicit parallelism of population-based search algorithms to simultaneously progress multiple distinct optimization tasks. By mapping all tasks to a unified search space, the evolving population of candidate solutions can harness the hidden relationships between them through continuous genetic transfer - which is induced when solutions associated with different tasks crossover with each other. More recently, modes of knowledge transfer that are different from direct solution crossover have been explored.

    Source Codes


    • The Multi-Task Optimization Platform (MTO Platform) is inspired by PlatEMO and designed to facilitate experiments on multi-task optimization algorithms here.

    • Matlab code for "Bali, K. K., Ong, Y. S., et. al., Multifactorial Evolutionary Algorithm with Online Transfer Parameter Estimation: MFEA-II" can be downloaded here.

    • Matlab code for "Cognizant Multitasking in Multiobjective Multifactorial Evolution: MO-MFEA-II" can be downloaded here.

    • Matlab alpha version of MFEA can be downloaded here.

    • Matlab beta version of MFEA for Continuous Optimization can be downloaded here.

    • Matlab alpha version for multi-objective continuous optimization via multitasking MO-MFEA available here.

    • Matlab code of MFPSO and MFDE can be downloaded here (MFPSO and MFDE).

    • Matlab code for "Da, B., Gupta, A., et. al., Curbing Negative Influences Online for Seamless Transfer Evolutionary Optimization" can be downloaded here.

    • Matlab code for the autoencoding component of "Feng, L., Zhou, L., et. al., Evolutionary Multitasking via Explicit Autoencoding" can be downloaded here.

    • Code for "Osaba, E., Martinez, A. D., et. al., Multifactorial Cellular Genetic Algorithm (MFCGA): Algorithmic Design, Performance Comparison and Genetic Transferability" can be downloaded here.

    • Code for "Martinez, A. D., Osaba, E., et. al., Simultaneously Evolving Deep Reinforcement Learning Models using Multifactorial Optimization" can be downloaded here.

    • Code for “Xu, Z., Liu, X., Zhang, K., & He, J. Cultural transmission based multi-objective evolution strategy for evolutionary multitasking” can be downloaded here.

    Evolutionary Multitask Optimization

    [Wikipedia]

    Publications


    • Y. Huang, L. Feng, M. Li, Y. Wang, Z. Zhu and K. C. Tan, "Fast Vehicle Routing via Knowledge Transfer in a Reproducing Kernel Hilbert Space," in IEEE Transactions on Systems, Man, and Cybernetics: Systems, doi: 10.1109/TSMC.2023.3270308.

    • Y. Jiang, Z. -H. Zhan, K. C. Tan and J. Zhang, "Knowledge Learning for Evolutionary Computation," in IEEE Transactions on Evolutionary Computation, doi: 10.1109/TEVC.2023.3278132.

    • Y. Jiang, Z. -H. Zhan, K. C. Tan and J. Zhang, "Block-Level Knowledge Transfer for Evolutionary Multitask Optimization," in IEEE Transactions on Cybernetics, doi: 10.1109/TCYB.2023.3273625.

    • L. Feng, A. Gupta, K. C. Tan, et al, "Evolutionary Multi-Task Optimization: Foundations and Methodologies." (2023).

    • W. Lin, Q. Lin, L. Feng and K. C. Tan, "Ensemble of Domain Adaptation-Based Knowledge Transfer for Evolutionary Multitasking," in IEEE Transactions on Evolutionary Computation, doi: 10.1109/TEVC.2023.3259067.

    • S. -H. Wu, Z. -H. Zhan, K. C. Tan and J. Zhang, "Transferable Adaptive Differential Evolution for Many-Task Optimization," in IEEE Transactions on Cybernetics, doi: 10.1109/TCYB.2023.3234969.

    • J. Wu, H. Yang, Y. Zeng, Z. Wu, J. Liu and L. Feng, "A twin learning framework for traveling salesman problem based on autoencoder, graph filter, and transfer learning," in IEEE Transactions on Consumer Electronics, doi: 10.1109/TCE.2023.3269071.

    • X. Zhang, R. Cheng, L. Feng and Y. Jin, "Machine Learning Assisted Evolutionary Multi-Objective Optimization [Guest Editorial]," in IEEE Computational Intelligence Magazine, vol. 18, no. 2, pp. 16-17, May 2023, doi: 10.1109/MCI.2023.3248919.

    • W. Zhou et al., "Dynamic Multi-Objective Optimization Framework With Interactive Evolution for Sequential Recommendation," in IEEE Transactions on Emerging Topics in Computational Intelligence, doi: 10.1109/TETCI.2023.3251352.

    • Yanchi Li, Wenyin Gong, Shuijia Li, Multitasking optimization via an adaptive solver multitasking evolutionary framework, Information Sciences , Volume 630, 2023, Pages 688-712, ISSN 0020-0255.

    • X. Wang, Z. Dong, L. Tang and Q. Zhang, "Multiobjective Multitask Optimization-Neighborhood as a Bridge for Knowledge Transfer," in IEEE Transactions on Evolutionary Computation , vol. 27, no. 1, pp. 155-169, Feb. 2023, doi: 10.1109/TEVC.2022.3154416.

    • K. Qiao et al., "A Self-Adaptive Evolutionary Multi-Task Based Constrained Multi-Objective Evolutionary Algorithm," in IEEE Transactions on Emerging Topics in Computational Intelligence, doi: 10.1109/TETCI.2023.3236633.

    • J. Li et al., "Knowledge transfer for Object Detection with Evolution architecture search," 2022 4th International Conference on Data-driven Optimization of Complex Systems (DOCS), Chengdu, China, 2022, pp. 1-6, doi: 10.1109/DOCS55193.2022.9967711.

    • L. Cao, M. Jiang, L. Feng, Q. Lin, R. Pan and K. Chen Tan, "Hybrid Estimation of Distribution Based on Knowledge Transfer for Flexible Job-shop Scheduling Problem," 2022 4th International Conference on Data-driven Optimization of Complex Systems (DOCS), Chengdu, China, 2022, pp. 1-6, doi: 10.1109/DOCS55193.2022.9967485.

    • Y. Wu et al., "Evolutionary Multiform Optimization with Two-stage Bidirectional Knowledge Transfer Strategy for Point Cloud Registration," in IEEE Transactions on Evolutionary Computation, 2022, doi: 10.1109/TEVC.2022.3215743.

    • C. He, R. Cheng, L. Li, K. C. Tan and Y. Jin, "Large-scale Multiobjective Optimization via Reformulated Decision Variable Analysis," in IEEE Transactions on Evolutionary Computation, 2022, doi: 10.1109/TEVC.2022.3213006.

    • Y. Jiang, Z. -H. Zhan, K. C. Tan and J. Zhang, "A Bi-objective Knowledge Transfer Framework for Evolutionary Many-Task Optimization," in IEEE Transactions on Evolutionary Computation, 2022, doi: 10.1109/TEVC.2022.3210783.

    • H. Bai, R. Cheng, D. Yazdani, K. C. Tan and Y. Jin, "Evolutionary Large-Scale Dynamic Optimization Using Bilevel Variable Grouping," in IEEE Transactions on Cybernetics, doi: 10.1109/TCYB.2022.3164143.

    • Y. Su, Q. Lin, Z. Ming and K. C. Tan, "Adapting Decomposed Directions for Evolutionary Multiobjective Optimization," in IEEE Transactions on Cybernetics, doi: 10.1109/TCYB.2022.3165557.

    • S. Liu, Q. Lin, L. Feng, K. -C. Wong and K. C. Tan, "Evolutionary Multitasking for Large-Scale Multiobjective Optimization," in IEEE Transactions on Evolutionary Computation, doi: 10.1109/TEVC.2022.3166482.

    • L. Feng, Q. Shang, Y. Hou, K. C. Tan and Y. -S. Ong, "Multispace Evolutionary Search for Large-Scale Optimization With Applications to Recommender Systems," in IEEE Transactions on Artificial Intelligence, vol. 4, no. 1, pp. 107-120, Feb. 2023, doi: 10.1109/TAI.2022.3156952.

    • H. Chen, H. -L. Liu, F. Gu and K. C. Tan, "A Multiobjective Multitask Optimization Algorithm Using Transfer Rank," in IEEE Transactions on Evolutionary Computation, vol. 27, no. 2, pp. 237-250, April 2023, doi: 10.1109/TEVC.2022.3147568.

    • W. Zhou, L. Feng, K. C. Tan, M. Jiang and Y. Liu, "Evolutionary Search With Multiview Prediction for Dynamic Multiobjective Optimization," in IEEE Transactions on Evolutionary Computation, vol. 26, no. 5, pp. 911-925, Oct. 2022, doi: 10.1109/TEVC.2021.3135020.

    • Y. Feng, L. Feng, S. Kwong and K. C. Tan, "A Multivariation Multifactorial Evolutionary Algorithm for Large-Scale Multiobjective Optimization," in IEEE Transactions on Evolutionary Computation, vol. 26, no. 2, pp. 248-262, April 2022, doi: 10.1109/TEVC.2021.3119933.

    • J. -Y. Li, Z. -H. Zhan, K. C. Tan and J. Zhang, "A Meta-Knowledge Transfer-Based Differential Evolution for Multitask Optimization," in IEEE Transactions on Evolutionary Computation, vol. 26, no. 4, pp. 719-734, Aug. 2022, doi: 10.1109/TEVC.2021.3131236.

    • Y. Guo, G. Chen, M. Jiang, D. Gong and J. Liang, "A Knowledge guided Transfer Strategy for Evolutionary Dynamic Multiobjective Optimization," in IEEE Transactions on Evolutionary Computation, 2022, doi: 10.1109/TEVC.2022.3222844.

    • J. Li, T. Sun, Q. Lin, M. Jiang and K. C. Tan, "Reducing Negative Transfer Learning via Clustering for Dynamic Multiobjective Optimization," in IEEE Transactions on Evolutionary Computation, vol. 26, no. 5, pp. 1102-1116, Oct. 2022, doi: 10.1109/TEVC.2022.3144180.

    • Shang, Q., Huang, Y., Dong, J. et al. Multi-space evolutionary search with dynamic resource allocation strategy for large-scale optimization. Neural Comput & Applic 34, 7673–7689 (2022).

    • D. Wang, K. Liu, L. Feng, P. Dai, W. Wu and S. Guo, "Evolutionary Multitasking for Cross-domain Task Optimization via Vehicular Edge Computing," 2021 IEEE Global Communications Conference (GLOBECOM), Madrid, Spain, 2021, pp. 1-6, doi: 10.1109/GLOBECOM46510.2021.9685894.

    • Lim, R., Gupta, A., Ong, YS. et al. Non-linear Domain Adaptation in Transfer Evolutionary Optimization. Cogn Comput 13, 290–307 (2021).

    • L. Zhou, L. Feng, A. Gupta and Y. -S. Ong, "Learnable Evolutionary Search Across Heterogeneous Problems via Kernelized Autoencoding," in IEEE Transactions on Evolutionary Computation, vol. 25, no. 3, pp. 567-581, June 2021, doi: 10.1109/TEVC.2021.3056514.

    • X. Wang, Q. Kang, M. Zhou, S. Yao and A. Abusorrah, "Domain Adaptation Multitask Optimization," in IEEE Transactions on Cybernetics, doi: 10.1109/TCYB.2022.3222101.

    • Gupta, L. Zhou,Y. S. Ong, Z. Chen and Y. Hou. "Half a Dozen Real-World Applications of Evolutionary Multitasking, and More". IEEE Computational Intelligence Magazine , In Press, 2022.

    • Q. Shang, Y. Huang, Y. Wang, et al. "Solving vehicle routing problem by memetic search with evolutionary multitasking". Memetic Comp , 2022.

    • G. Li, Q. Zhang, Z. Wang, "Evolutionary competitive multitasking optimization". Evolutionary Computation , 2022.

    • Q. Chen, X. Ma, Y. Yu, et al, "Multi-objective evolutionary multi-tasking algorithm using cross-dimensional and prediction-based knowledge transfer". IEEE Transactions on Cybernetics , 2022.

    • K. J. Du, J. Y. Li, H. Wang, et al, "Multi-objective multi-criteria evolutionary algorithm for multi-objective multi-task optimization". Complex & Intelligent Systems , 2022.

    • Z. Xu, K. Zhang, J. He, et al, "A novel membrane-inspired evolutionary framework for multi-objective multi-task optimization problems". Information Sciences , 2022.

    • Y. Ye, Q. Lin, L. Ma, et al, "Multiple source transfer learning for dynamic multiobjective optimization". Information Sciences , 2022.

    • Song Q, Zheng Y J, Yang J, et al, "Predicting Demands of COVID-19 Prevention and Control Materials via Co-Evolutionary Transfer Learning". IEEE Transactions on Cybernetics , 2022.

    • S. H. Wu, Z. H. Zhan, K. C. Tan, et al, "Orthogonal transfer for multitask optimization". IEEE Transactions on Evolutionary Computation , 2022.

    • Q. Dang, W. Gao, M. Gong, "Multiobjective multitasking optimization assisted by multidirectional prediction method". Complex & Intelligent Systems , 2022.

    • J. Shi, X. Zhang, X. Liu, et al, "Multicriteria semi-supervised hyperspectral band selection based on evolutionary multitask optimization". Knowledge-Based Systems , 2022.

    • Z. Hu, Y. Li, H. Sun, et al, "Multitasking multiobjective optimization based on transfer component analysis". Information Sciences , 2022.

    • K. Ren, F. X. Xiao, H. G. Han, "Dynamic multitask optimization with improved knowledge transfer mechanism". Applied Intelligence , 2022.

    • Z. Xu, X. Liu, K. Zhang, et al, "Cultural transmission based multi-objective evolution strategy for evolutionary multitasking". Information Sciences , 2022.

    • S. H. Wu, Z. H. Zhan, K. C. Tan, et al, "Orthogonal transfer for multitask optimization". IEEE Transactions on Evolutionary Computation , 2022.

    • H. Chen, H. L. Liu, F. Gu, et al, "A Multi-objective Multitask Optimization Algorithm Using Transfer Rank". IEEE Transactions on Evolutionary Computation , 2022.

    • X. Wang, Z. Dong, L. Tang, et al, "Multiobjective Multitask Optimization-Neighborhood as a Bridge for Knowledge Transfer". IEEE Transactions on Evolutionary Computation , 2022.

    • Y. Bi, B. Xue, M. Zhang, "Multitask Feature Learning as Multiobjective Optimization: A New Genetic Programming Approach to Image Classification". IEEE Transactions on Cybernetics , 2022.

    • M. Shakeri, E. Miahi, A. Gupta, et al, "Scalable Transfer Evolutionary Optimization: Coping With Big Task Instances". Information Sciences , 2022.

    • X. Wang, Y. Jin, S. Schmitt, et al, "Transfer Learning Based Co-Surrogate Assisted Evolutionary Bi-Objective Optimization for Objectives with Non-Uniform Evaluation Times". IEEE Transactions on Evolutionary Computation , 2022.

    • K. Qiao, K. Yu, B. Qu, et al, "An Evolutionary Multitasking Optimization Framework for Constrained Multiobjective Optimization Problems". IEEE Transactions on Evolutionary Computation , 2022.

    • K. Qiao, K. Yu, B. Qu, et al, "Dynamic Auxiliary Task-Based Evolutionary Multitasking for Constrained Multi-objective Optimization". IEEE Transactions on Evolutionary Computation , 2022.

    • Z. Liang, Y. Zhu, X. Wang, et al, "Evolutionary Multitasking for Multi-objective Optimization Based on Generative Strategies". IEEE Transactions on Evolutionary Computation , 2022.

    • C. Lyu, Y. Shi, L. Sun, et al, "Community detection in multiplex networks based on evolutionary multi-task optimization and evolutionary clustering ensemble". IEEE Transactions on Evolutionary Computation , 2022.

    • Osaba E, Del Ser J, Martinez A D, et al. "Evolutionary Multitask Optimization: a Methodological Overview, Challenges, and Future Research Directions". Cognitive Computatio , 2022.

    • H. Xu, A. K. Qin, S. Xia, "Evolutionary Multitask Optimization With Adaptive Knowledge Transfer". IEEE Transactions on Evolutionary Computation , 2021.

    • T. Wei, J. Zhong, "Towards Generalized Resource Allocation on Evolutionary Multitasking for Multi-Objective Optimization". IEEE Computational Intelligence Magazine , 2021.

    • T. Wei, S. Wang, J. Zhong, et al, "A review on evolutionary multi-task optimization: Trends and challenges". IEEE Transactions on Evolutionary Computation , 2021.

    • Feng, Y., Feng, L., Hou, Y., Tan, K. C., & Kwong, S. “EMT-ReMO: Evolutionary Multitasking for High-Dimensional Multi-Objective Optimization via Random Embedding”. IEEE Congress on Evolutionary Computation , 2021.

    • Cao, Y., Hou, Y., Feng, L., Ge, H., Zhang, Q., & Wei, X. “A Study on Realtime Task Selection Based on Credit Information Updating in Evolutionary Multitasking”. International Conference on Evolutionary Multi-Criterion Optimization , 2021.

    • Zhang, F., Mei, Y., Nguyen, S., Zhang, M., & Tan, K. C. “Surrogate-assisted evolutionary multitask genetic programming for dynamic flexible job shop scheduling”. IEEE Transactions on Evolutionary Computation , 2021.

    • Wu, K., Wang, C., & Liu, J. “Evolutionary multitasking multilayer network reconstruction”. IEEE Transactions on Cybernetics , 2021.

    • Chen, K., Xue, B., Zhang, M., & Zhou, F. “Evolutionary Multitasking for Feature Selection in High-dimensional Classification via Particle Swarm Optimisation”. IEEE Transactions on Evolutionary Computation , 2021.

    • Li, J., Li, H., Liu, Y., & Gong, M. “Multi-fidelity evolutionary multitasking optimization for hyperspectral endmember extraction”. Applied Soft Computing , 2021.

    • Xu, Z., Liu, X., Zhang, K., & He, J. “Cultural transmission based multi-objective evolution strategy for evolutionary multitasking”. Information Sciences , 2021.

    • Osaba, E., Del Ser, J., Martinez, A. D., Lobo, J. L., & Herrera, F. “AT-MFCGA: An Adaptive Transfer-guided Multifactorial Cellular Genetic Algorithm for Evolutionary Multitasking”. Information Sciences , 2021.

    • Shen F, Liu J, Wu K. “Evolutionary multitasking network reconstruction from time series with online parameter estimation”. Knowledge-Based Systems , 2021.

    • Liang, Z., Liang, W., Wang, Z., Ma, X., Liu, L., & Zhu, Z. “Multiobjective Evolutionary Multitasking With Two-Stage Adaptive Knowledge Transfer Based on Population Distribution”. IEEE Transactions on Systems, Man, and Cybernetics: Systems , 2021.

    • Wang, H., Feng, L., Jin, Y., & Doherty, J. “Surrogate-Assisted Evolutionary Multitasking for Expensive Minimax Optimization in Multiple Scenarios”. IEEE Computational Intelligence Magazine , 2021.

    • Bai, L., Lin, W., Gupta, A., & Ong, Y. S. “From Multitask Gradient Descent to Gradient-Free Evolutionary Multitasking: A Proof of Faster Convergence”. IEEE Transactions on Cybernetics , 2021.

    • Binh, H. T. T., Thang, T. B., Thai, N. D., & Thanh, P. D. “A bi-level encoding scheme for the clustered shortest-path tree problem in multifactorial optimization”. Engineering Applications of Artificial Intelligence , 2021.

    • Chen, K., Xue, B., Zhang, M., & Zhou, F. “Evolutionary Multitasking for Feature Selection in High-dimensional Classification via Particle Swarm Optimisation”. IEEE Transactions on Evolutionary Computation , 2021.

    • Xue, X., Zhang, K., Tan, K. C., Feng, L., Wang, J., Chen, G., ... & Yao, J. “Affine transformation-enhanced multifactorial optimization for heterogeneous problems”. IEEE Transactions on Cybernetics , 2020.

    • Martinez, A. D., Osaba, E., Del Sery, J., & Herrera, F. “Simultaneously evolving deep reinforcement learning models using multifactorial optimization”. IEEE Congress on Evolutionary Computation , 2020.

    • Liu, J., Li, P., Wang, G., Zha, Y., Peng, J., & Xu, G. “A multitasking electric power dispatch approach with multi-objective multifactorial optimization algorithm”. IEEE Access , 2020.

    • Osaba, E., Martinez, A. D., Galvez, A., Iglesias, A., & Ser, J. D. “dMFEA-II: An adaptive multifactorial evolutionary algorithm for permutation-based discrete optimization problems”. Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion , 2020.

    • Xue, X., Zhang, K., Tan, K. C., Feng, L., Wang, J., Chen, G., ... & Yao, J. “Affine transformation-enhanced multifactorial optimization for heterogeneous problems”. IEEE Transactions on Cybernetics , 2020.

    • Liang, Zhengping, Hao Dong, Cheng Liu, Weiqi Liang, and Zexuan Zhu. "Evolutionary Multitasking for Multiobjective Optimization With Subspace Alignment and Adaptive Differential Evolution." IEEE Transactions on Cybernetics, 2020.

    • Hao, Xingxing, Rong Qu, and Jing Liu. "A Unified Framework of Graph-based Evolutionary Multitasking Hyper-heuristic." IEEE Transactions on Evolutionary Computation, 2020.

    • Lin, Jiabin, Hai-Lin Liu, Kay Chen Tan, and Fangqing Gu. "An Effective Knowledge Transfer Approach for Multiobjective Multitasking Optimization." IEEE Transactions on Cybernetics, 2020.

    • Zhou, Lei, Liang Feng, Kay Chen Tan, Jinghui Zhong, Zexuan Zhu, Kai Liu, and Chao Chen. "Toward Adaptive Knowledge Transfer in Multifactorial Evolutionary Computation." IEEE Transactions on Cybernetics, 2020.

    • Feng, Liang, Yuxiao Huang, Lei Zhou, Jinghui Zhong, Abhishek Gupta, Ke Tang, and Kay Chen Tan. "Explicit Evolutionary Multitasking for Combinatorial Optimization: A Case Study on Capacitated Vehicle Routing Problem." IEEE Transactions on Cybernetics, 2020.

    • Yi, Jun, Junren Bai, Haibo He, Wei Zhou, and Lizhong Yao. "A Multifactorial Evolutionary Algorithm for Multitasking Under Interval Uncertainties." IEEE Transactions on Evolutionary Computation, 2020.

    • Wu, Dongrui, and Xianfeng Tan. "Multitasking Genetic Algorithm (MTGA) for Fuzzy System Optimization." IEEE Transactions on Fuzzy Systems, 2020.

    • Bali, Kavitesh Kumar, Abhishek Gupta, Yew-Soon Ong, and Puay Siew Tan. "Cognizant Multitasking in Multi-Objective Multifactorial Evolution: MO-MFEA-II." IEEE Transactions on Cybernetics, 2020.

    • Yao, Shuangshuang, Zhiming Dong, Xianpeng Wang, and Lei Ren. "A Multiobjective multifactorial optimization algorithm based on decomposition and dynamic resource allocation strategy." Information Sciences, 2020.

    • Xu, Zhiwei, Kai Zhang, Xin Xu, and Juanjuan He. "A Fireworks Algorithm Based on Transfer Spark for Evolutionary Multitasking." Frontiers in Neurorobotics, 2020.

    • Thanh, Pham Dinh, Huynh Thi Thanh Binh, and Tran Ba Trung. "An efficient strategy for using multifactorial optimization to solve the clustered shortest path tree problem." Applied Intelligence, 2020.

    • Li, Genghui, Qiuzhen Lin, and Weifeng Gao. "Multifactorial optimization via explicit multipopulation evolutionary framework." Information Sciences, 2020.

    • Yi, Jun, Junren Bai, Haibo He, Wei Zhou, and Lizhong Yao. "A Multifactorial Evolutionary Algorithm for Multitasking Under Interval Uncertainties." IEEE Transactions on Evolutionary Computation, 2020.

    • Wang, Zan, and Xianpeng Wang. "Multiobjective multifactorial operation optimization for continuous annealing production process." Industrial & Engineering Chemistry Research, 2019.

    • Liaw, Rung-Tzuo, and Chuan-Kang Ting. "Evolutionary manytasking optimization based on symbiosis in biocoenosis." AAAI, 2019.

    • Yang, Zhiyong, Qianqian Xu, Xiaochun Cao, and Qingming Huang. "Learning personalized attribute preference via multi-task AUC optimization." AAAI, 2019.

    • Y. Chen, J. Zhong, L. Feng & J. Zhang. “An Adaptive Archive-Based Evolutionary Framework for Many-Task Optimization”. IEEE Transactions on Emerging Topics in Computational Intelligence, 2019.

    • J. Yin, A. Zhu, Z. Zhu, Y. Yu & X. Ma, “Multifactorial Evolutionary Algorithm Enhanced with Cross-task Search Direction”. IEEE Congress on Evolutionary Computation (CEC), 2019.

    • L. Zhou, L. Feng, K. Liu, C. Chen, S. Deng, T. Xiang & S. Jiang. “Towards Effective Mutation for Knowledge Transfer in Multifactorial Differential Evolution”. IEEE Congress on Evolutionary Computation (CEC), 2019.

    • X. Zheng, Y. Lei, A. K. Qin, D. Zhou, J. Shi & M. Gong. “Differential Evolutionary Multi-task Optimization”. IEEE Congress on Evolutionary Computation (CEC), 2019.

    • A. Gupta & Y. S. Ong. “Back to the roots: Multi-x evolutionary computation”. Cognitive Computation, 2019.

    • A. Rauniyar, R. Nath & P. K. Muhuri. “Multi-factorial evolutionary algorithm based novel solution approach for multi-objective pollution-routing problem”. Computers & Industrial Engineering, 2019.

    • Z. Liang, J. Zhang, L. Feng & Z. Zhu. “A hybrid of genetic transform and hyper-rectangle search strategies for evolutionary multi-tasking”. Expert Systems with Applications, 2019.

    • H. T. T. Binh, N. Q. Tuan & D. C. T. Long. “A multi-objective multi-factorial evolutionary algorithm with reference-point-based approach”. IEEE Congress on Evolutionary Computation (CEC), 2019.

    • Q. Shang, L. Zhang, L. Feng, Y. Hou, J. Zhong, A. Gupta & H. L. Liu. “A Preliminary Study of Adaptive Task Selection in Explicit Evolutionary Many-Tasking”. IEEE Congress on Evolutionary Computation (CEC), 2019.

    • C. Jin, P. W. Tsai & A. K. Qin. “ A Study on Knowledge Reuse Strategies in Multitasking Differential Evolution”. IEEE Congress on Evolutionary Computation (CEC), 2019.

    • Z. Tang, M. Gong, F. Jiang, H. Li & Y. Wu. “Multipopulation Optimization for Multitask Optimization”. IEEE Congress on Evolutionary Computation (CEC), 2019.

    • A. Gupta & Y. S. Ong. “Multitask Knowledge Transfer Across Problems”. Memetic Computation, 2019.

    • H. Song, A. K. Qin, P. W. Tsai & J. J. Liang. “Multitasking Multi-Swarm Optimization”. IEEE Congress on Evolutionary Computation (CEC), 2019.

    • C. Wang, H. Ma, G. Chen & S. Hartmann. “Evolutionary Multitasking for Semantic Web Service Composition”. arXiv preprint arXiv:1902.06370., 2019.

    • Y. Lian, Z. Huang, Y. Zhou & Z. Chen. “Improve Theoretical Upper Bound of Jumpk Function by Evolutionary Multitasking”. High Performance Computing and Cluster Technologies Conference, 2019.

    • X. Zheng, A. K. Qin, M. Gong & D. Zhou. “Self-regulated Evolutionary Multi-task Optimization”. IEEE Transactions on Evolutionary Computation, 2019.

    • K. K. Bali, Y. Ong, A. Gupta & P. S. Tan. “Multifactorial Evolutionary Algorithm with Online Transfer Parameter Estimation: MFEA-II”. IEEE Transactions on Evolutionary Computation, 2019.

    • M. Gong, Z. Tang, H. Li & J. Zhang. “Evolutionary Multitasking with Dynamic Resource Allocating Strategy”. IEEE Transactions on Evolutionary Computation, 2019.

    • H. Li, Y. Ong, M. Gong & Z. Wang. “Evolutionary Multitasking Sparse Reconstruction: Framework and Case Study”. IEEE Transactions on Evolutionary Computation , 2018.

    • H. ThiThanh Binh, P. Dinh Thanh, T. Ba Trung & L. Phuong Thao. “Effective Multifactorial Evolutionary Algorithm for Solving the Cluster Shortest Path Tree Problem”. IEEE Congress on Evolutionary Computation (CEC), 2018.

    • D. Liu, S. Huang & J. Zhong. “Surrogate-Assisted Multi-Tasking Memetic Algorithm”. IEEE Congress on Evolutionary Computation (CEC), 2018.

    • Z. Tang & M. Gong. “Adaptive multifactorial particle swarm optimisation”. CAAI Transactions on Intelligence Technology, 2018.

    • Y. Chen, J. Zhong & M. Tan. "A Fast Memetic Multi-Objective Differential Evolution for Multi-Tasking Optimization”. IEEE Congress on Evolutionary Computation (CEC), 2018.

    • Yang, C., Ding, J., Jin, Y., Wang, C., & Chai, T. “Multitasking Multiobjective Evolutionary Operational Indices Optimization of Beneficiation Processes”. IEEE Transactions on Automation Science and Engineering, 2018.

    • Tang, J., Chen, Y., Deng, Z., Xiang, Y. and Joy, C.P. “A Group-based Approach to Improve Multifactorial Evolutionary Algorithm”. IJCAI 2018.

    • Hashimoto, Ryuichi, et al. "Analysis of evolutionary multi-tasking as an island model." Genetic and Evolutionary Computation Conference (GECCO), 2018.

    • Tuan, N. Q., Hoang, T. D., & Binh, H. T. T. “A Guided Differential Evolutionary Multi-Tasking with Powell Search Method for Solving Multi-Objective Continuous Optimization”S. IEEE Congress on Evolutionary Computation (CEC), 2018.

    • Li, G., Zhang, Q., & Gao, W. “Multipopulation evolution framework for multifactorial optimization”. Genetic and Evolutionary Computation Conference (GECCO), 2018.

    • Zhong, J., Feng, L., Cai, W. and Ong, Y.S., “Multifactorial Genetic Programming for Symbolic Regression Problems”. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2018.

    • Thanh, P.D., Dung, D.A., Tien, T.N. and Binh, H.T.T., “An Effective Representation Scheme in Multifactorial Evolutionary Algorithm for Solving Cluster Shortest-Path Tree Problem”. IEEE Congress on Evolutionary Computation (CEC), 2018.

    • Gupta, A., Ong, Y.S. and Feng, L., “Insights on transfer optimization: Because experience is the best teacher”. IEEE Transactions on Emerging Topics in Computational Intelligence, 2018.

    • Feng L, Zhou L, Zhong J, et al. “Evolutionary Multitasking via Explicit Autoencoding”. IEEE Transactions on Cybernetics, 2018.

    • Bao, L., Qi, Y., Shen, M., Bu, X., Yu, J., & Li, Q., et al. "An Evolutionary Multitasking Algorithm for Cloud Computing Service Composition". World Congress on Services. 2018, Springer.

    • Yang, C., Ding, J., Tan, K. C., & Jin, Y. "Two-stage assortative mating for multi-objective multifactorial evolutionary optimization". IEEE Annual Conference on Decision and Control (CDC) , 2018.

    • Zhou, L., Feng, L., Zhong, J., Zhu, Z., Da, B., & Wu, Z. "A study of similarity measure between tasks for multifactorial evolutionary algorithm". Genetic and Evolutionary Computation Conference (GECCO) , 2018

    • Ding, J., Yang, C., Jin, Y., & Chai, T. "Generalized multi-tasking for evolutionary optimization of expensive problems". IEEE Transactions on Evolutionary Computation ,2017, PP(99), 1-1.

    • A. Gupta, Y. S. Ong, L. Feng and K. C. Tan, "Multiobjective Multifactorial Optimization in Evolutionary Multitasking ", IEEE Transactions on Cybernetics, 2017, 1652-1665.

    • B. Da, Y. S. Ong, L. Feng, A.K. Qin, A. Gupta, etc., "Evolutionary Multitasking for Single-objective Continuous Optimization: Benchmark Problems, Performance Metric, and Baseline Results", arXiv:1706.03470, 2017.

    • Y. Yuan, Y. S. Ong, L. Feng, A.K. Qin, A. Gupta, B. Da, etc., "Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results", arXiv:1706.02766, 2017.

    • Chandra, R., Ong, Y. S., and Goh, C. K., "Co-evolutionary multi-task learning with predictive recurrence for multi-step chaotic time series prediction", Neurocomputing, 2017, 21-34.

    • Q. Chen, X Ma, Y. Sun and Z. Zhu, "Adaptive Memetic Algorithm Based Evolutionary Multi-tasking Single-Objective Optimization", SEAL, 2017, 462-472.

    • Chandra, R., "Dynamic Cyclone Wind-Intensity Prediction Using Co-Evolutionary Multi-task Learning", International Conference on Neural Information Processing (ICONIP), 2017, 618-627.

    • Chandra, R., "Co-evolutionary Multi-task Learning for Modular Pattern Classification", International Conference on Neural Information Processing (ICONIP), 2017, 692-701.

    • J. Mo, Z. Fan, W. Li, Y. Fang, Y. You and X. Cai, " Multi-Factorial Evolutionary Algorithm Based on M2M Decomposition", SEAL, 2017, 134-144.

    • Chandra, R., Gupta, A., Ong, Y. S., and Goh, C. K., "Evolutionary Multi-task Learning for Modular Knowledge Representation in Neural Networks", Neural Processing Letters, 2017, 1-17.

    • Chandra, R., Ong, Y. S., and Goh, C. K., "Co-Evolutionary Multi-Task Learning for Dynamic Time Series Prediction", arXiv preprint arXiv:1703.01887, 2017.

    • Scott, E. O., and De Jong, K. A., "Multitask Evolution with Cartesian Genetic Programming", arXiv preprint arXiv:1702.02217, 2017.

    • Yuan, Y., Ong, Y. S., Gupta, A., and Xu, H., "Objective Reduction in Many-Objective Optimization: Evolutionary Multiobjective Approaches and Comprehensive Analysis", IEEE Transactions on Evolutionary Computation, In Press, 2017.

    • Tang, Z., Gong, M., and Zhang, M., "Evolutionary Multi-task Learning for Modular Extremal Learning Machine", IEEE Congress on Evolutionary Computation (CEC) 2017, pp. 474-479.

    • Liaw, R. T., and Ting, C. K., "Evolutionary Many-tasking Based on Biocoenosis through Symbiosis: A Framework and Benchmark Problems", IEEE Congress on Evolutionary Computation (CEC) 2017, pp. 2266-2273.

    • Feng, L., Zhou, W., Zhou, L., Jiang, S.W., Zhong, J.H., Da, B.S., Zhu, Z.X. and Wang, Y., "An Empirical Study of Multifactorial PSO and Multifactorial DE", IEEE Congress on Evolutionary Computation (CEC) 2017, pp. 921-928.

    • Wen, Y. W., and Ting, C. K., "Parting Ways and Reallocating Resources in Evolutionary Multitasking", IEEE Congress on Evolutionary Computation (CEC) 2017, pp. 2404-2411.

    • Chandra, R., Ong, Y. S., and Goh, C. K., "Co-evolutionary Multi-task Learning with Predictive Recurrence for Multi-Step Chaotic Time Series Prediction". Neurocomputing, 2017, 21-34.

    • M. Cheng, Y. S. Ong, A. Gupta and Z. W. Ni, "Coevolutionary Multitasking for Concurrent Global Optimization: With Case Studies in Complex Engineering Design", Engineering Applications of Artificial Intelligence, In Press, 2017.

    • K. Bali, A. Gupta, L. Feng, Y. S. Ong, and P. S. Tan, "Linearized Domain Adaptation in Evolutionary Multitasking", IEEE Congress on Evolutionary Computation, Spain, June 5-8, 2017.

    • A. Gupta, B. Da, Y. Yuan and Y. S. Ong, "On the Emerging Notion of Evolutionary Multitasking: A Computational Analog of Cognitive Multitasking", Recent Advances in Evolutionary Multi-objective Optimization, pps. 139-157, 2017.

    • L. Zhou, L. Feng, J. Zhong, Y. S. Ong, Z. Zhu, E. Sha, "Evolutionary Multitasking in Combinatorial Search Spaces: A Case Study in Capacitated Vehicle Routing Problem", IEEE Symposium Series on Computational Intelligence (SSCI) 2016, Athens, Greece.

    • Sagarna, R., and Ong, Y. S., "Concurrently Searching Branches in Software Tests Generation through Multitask Evolution", IEEE Symposium Series on Computational Intelligence (SSCI) 2016, pp. 1-8.

    • Y. Yuan, Y. S. Ong, A. Gupta, P. S. Tan, H. Xu, "Evolutionary Multitasking in Permutation-Based Combinatorial Optimization Problems: Realization with TSP, QAP, LOP, and JSP", IEEE Region Ten Conference (TENCON) 2016.

    • A. Gupta, and Y. S. Ong, "Genetic Transfer or Population Diversification? Deciphering the Secret Ingredients of Evolutionary Multitask Optimization". IEEE Symposium Series on Computational Intelligence (SSCI) 2016, Athens, Greece.

    • Ong, Y. S., "Towards Evolutionary Multitasking: A New Paradigm in Evolutionary Computation", Computational Intelligence, Cyber Security and Computational Models, pp. 25-26, Springer, Singapore, 2016.

    • R. Chandra, A. Gupta, Y. S. Ong, and C. K. Goh, "Evolutionary multi-task learning for modular training of feedforward neural networks", International Conference on Neural Information Processing (International Conference on Neural Information Processing (ICONIP)) 2016.

    • A. Gupta, Y. S. Ong, B. Da, L. Feng, and S. D. Handoko, "Measuring Complementarity between Function Landscapes in Evolutionary Multitasking", IEEE WCCI - Congress on Evolutionary Computation, 2016.

    • Wen, Y. W., and Ting, C. K., "Learning Ensemble of Decision Trees through Multifactorial Genetic Programming", IEEE WCCI - Congress on Evolutionary Computation, 2016.

    • B. Da, A. Gupta, Y. S. Ong, L. Feng, and C. Wang, "Evolutionary Multitasking Across single and Multi-Objective Formulations for Improved Problem Solving", IEEE WCCI - Congress on Evolutionary Computation, 2016.

    • Y. S. Ong and A. Gupta, "Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking", Cognitive Computation, 10.1007/s12559-016-9395-7, pp 1-18, 2016.

    • Da, B., Gupta, A., Ong, Y.S. and Feng, L., "The Boon of Gene-Culture Interaction for Effective Evolutionary Multitasking". In Australasian Conference on Artificial Life and Computational Intelligence, pp. 54-65. Springer, Cham, 2016.

    • A. Gupta, J. Mańdziuk, Y. S. Ong, 'Evolutionary multitasking in bi-level optimization', Complex and Intelligent Systems, Volume 1, Issue 1-4, pp 83-95, 10.1007/s40747-016-0011-y, 2015.

    • A. Gupta, Y. S. Ong, L. Feng, 'Multifactorial Evolution: Towards Evolutionary Multitasking', IEEE Transactions on Evolutionary Computation, 2015.

    Evolutionary Multitask Optimization

    [Wikipedia]

    Applications


    Algorithms for multitask optimization span a wide array of real-world applications. Recent studies highlight the potential for speedups in the optimization of engineering design parameters by conducting related designs jointly in a multitask manner. In machine learning, the transfer of optimized features across related datasets can enhance the efficiency of the training process as well as improve the generalization capability of learned models. In addition to the above, the concept of multitasking has led to advances in automatic hyperparameter optimization of machine learning models, and ensemble learning.

    Applications have also been reported in cloud computing, with future developments geared toward a cloud-based on-demand optimization service that can cater to multiple customers simultaneously.

  • Gupta, L. Zhou,Y. S. Ong, Z. Chen and Y. Hou. "Half a Dozen Real-World Applications of Evolutionary Multitasking, and More". IEEE Computational Intelligence Magazine ,In Press, 2022.

  • Feng, Liang, Yuxiao Huang, Lei Zhou, Jinghui Zhong, Abhishek Gupta, Ke Tang, and Kay Chen Tan. "Explicit Evolutionary Multitasking for Combinatorial Optimization: A Case Study on Capacitated Vehicle Routing Problem." IEEE Transactions on Cybernetics, 2020.