Optimizing Autotvm with Parallel Genetic Algorithms Boosts AI Performance

Researchers from Beihang University in Beijing have made significant advancements in the field of machine learning, discovering a new method to optimize auto-tuning for deep neural networks. The team, led by Yuchen Feng, employed a parallel genetic algorithm (PGA) in conjunction with the AutoTVM auto-tuning process to achieve improved performance. According to the study, the new method reduces the inference time of typical deep networks by about 8-14% and speeds up the time consumption of the auto-tuning process up to 1.2-1.52x on GPUs compared to the original GA process of AutoTVM.

Key Takeaways:

  • The researchers combined a genetic algorithm (GA) with AutoTVM, resulting in improved performance and reduced inference time.
  • The new method achieves double optimization on both tuning results and tuning time.
  • The parallel genetic algorithm (PGA) was used to widen the search scope and improve search efficiency.
  • The study was conducted with the support of the National Engineering Research Center of Oil & Gas Exploration Computer Software Open Fund.
  • Beihang University's Yuchen Feng was the lead researcher on the project.
  • Additional authors included Changhai Zhao, Jiamin Wen, Minqiang Shang, and Xiaohua Shi.
  • The new method has been tested and shown to improve the inference time of typical deep networks by 8-14%.

Statistics:

  • Reduction in inference time: 8-14%
  • Speedup in auto-tuning process: up to 1.2-1.52x on GPUs
  • Number of researchers involved: 5 (Feng, Zhao, Wen, Shang, Shi)
  • Funding source: National Engineering Research Center of Oil & Gas Exploration Computer Software Open Fund
  • Journal publication: International Journal of Pattern Recognition and Artificial Intelligence (39, 2025, World Scientific Publ Co Pte Ltd)

Sources:

  • Optimizing Autotvm By Parallel Genetic Algorithms. International Journal of Pattern Recognition and Artificial Intelligence, 2025;39.
  • World Scientific Publishing - www.worldscientific.com/;
  • International Journal of Pattern Recognition and Artificial Intelligence - www.worldscinet.com/ijprai/ijprai.shtml
  • Yuchen Feng, Beihang University, School of Software, Beijing 100083, People's Republic of China.