Guojun Xiong (熊国钧)
 |
Postdoctoral fellow at Teamcore |
About me
I am a postdoctoral fellow in the Department of Computer Science at Harvard University, hosted by Prof. Milind Tambe, and supported by the Harvard Center for Research on Computation and Society (CRCS). I obtained my Ph.D. in Data Science from the Department of Applied Mathematics and the Department of Computer Science at Stony Brook University, supervised by Dr. Jian Li.
I am motivated by the challenges posed by complex, resource-constrained sequential decision-making problems under uncertainty. My research objective is to advance the field of reinforcement learning (RL) by developing innovative structured RL frameworks that leverage inherent problem structures to enhance sample efficiency and accelerate learning speed. Throughout my career, I aim to address critical issues in model-based and model-free approaches, especially in environments involving multiple coupled Markov Decision Processes (MDPs). In particular, I seek to refine and implement RL algorithms with provably sub-linear regret guarantees. By focusing on practical applications such as edge/cloud computing, cloud caching, wireless video streaming, and healthcare, my goal is to demonstrate the real-world impact and scalability of structured RL solutions.
Research Interest
My primary research interests include (i) online sequential decision making, (ii) asymptotically optimal index-policy design for restless multi-armed bandits, (iii) finite-time convergence and learning regret analysis for reinforcement learning, (iv) as well as decentralized optimization and multi-agent reinforcement learning. I am actively exploring broader social impacts for my research experience within Teamcore, particularly in public health and general social good.
News and Updates
01/2025 [Paper] Two papers accepted by ICLR 2025.
01/2025 [Service] I will serve as a PC member for KDD 2025.
01/2025 [Service] I will serve as a PC member for IJCAI 2025.
01/2025 [Paper] One paper accepted by IEEE ICC 2025.
12/2024 [Paper] One paper accepted by AAMAS 2025 (acceptance rate: 24.5%).
12/2024 [Paper] One paper accepted by AAAI 2025 (acceptance rate: 23.4%).
11/2024 [Award] Selected as the top reviewer (Rate: 8%) by Neurips 2024.
10/2024 [Paper] One paper accepted by AAAI 2025 Innovative Applications of AI .
09/2024 [Paper] Two papers accepted by Neurips 2024 (acceptance rate: 25.8%).
09/2024 [Service] I will serve as a PC member for ICML 2025.
08/2024 [Service] I will serve as a PC member for AISTATS 2025.
08/2024 [Service] I will serve as a PC member for ICLR 2025.
08/2024 [Service] I will serve as a PC member for COLING 2025.
08/2024 [Paper] One Paper accepted by AIoT 2024.
06/2024 [Paper] One Paper accepted by RLC 2024 Workshop Deployable RL.
06/2024 [Paper] One paper accepted by IEEE Transactions on Wireless Communication.
06/2024 [Paper] One paper accepted by IEEE/ACM Transactions on Networking.
05/2024 [Award] Received the travel grant from Meta for the 1st RL Conference.
05/2024 [Award] Received the Excellence in Research Award from the Data Science Program at Stony Brook University.
05/2024 [Service] I will serve as a PC member for AAAI 2024.
05/2024 [Service] I will serve as a PC member for Neurips 2024.
05/2024 [Paper] One paper on Adversarial Resteless Bandit accepted by ICML 2024 (acceptance rate: 27.5%).
04/2024 [Service] I will serve as a reviewer for IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
05/2024 [Award] Received the Postdoctoral Fellowship from Harvard Center for Research on Computation and Society (CRCS).
12/2023 [Paper] Two papers accepted by AAAI 2024 (acceptance rate: 23.75%).
10/2023 [Award] Received the Scholar Award from Neurips 2023.
10/2023 [Service] I will serve as a reviewer for IEEE Transactions on Networking (TON).
09/2023 [Service] I will serve as a reviewer for IEEE Transactions on Wireless Communication (TWC).
09/2023 [Paper] One paper accepted by Neurips 2023 (acceptance rate: 26.1%).
07/2023 [Service] I will serve as a PC member for AAAI 2023.
06/2023 [Award] Received the Chinese Government Award for Outstanding Self-financed Students Abroad (2022).
05/2023 I will be a research intern at Mitsubishi Electric Research Labs (MERL) this summer.
12/2022 [Paper] One paper accepted by IEEE/ACM Transactions on Networking.
12/2022 [Award] Received the Scholar Award from AAAI 2023.
11/2022 [Paper] One paper accepted by AAAI 2023 (Oral Presentation, acceptance rate: 10.8%).
10/2022 [Service] I will serve as a reviewer for IEEE Transactions on Mobile Computing (TMC).
10/2022 [Award] Received the Scholar Award from Neurips 2022.
10/2022 [Award] Received the travel grant from SUNY-Binhamton.
09/2023 [Paper] One paper accepted by Neurips 2022 (acceptance rate: 25.6%).
07/2023 [Paper] One paper accepted by ACM Mobihoc 2022 (acceptance rate: 19.8%).
10/2022 [Award] Received the Scholar Award from IEEE INFOCOM 2022.
12/2021 [Paper] One paper accepted by IEEE INFOCOM 2022 (acceptance rate: 19.9%).
12/2021 [Paper] One paper accepted by AAAI 2022 (Oral Presentation, acceptance rate: 4.6%).
01/2021 I start my Ph.D. journey at the State University of New York.