UROP Research Mentor Project Submission Portal: Submission #1189
Submission information
Submission Number: 1189
Submission ID: 20541
Submission UUID: e412e18c-0e61-4059-ba17-f47684a23365
Submission URI: /urop-research-mentor-project-submission-portal
Submission Update: /urop-research-mentor-project-submission-portal?token=86HqaulNArec1R0X9tlTZ6qMqpPdHjyygk4EQ1mP6d0
Created: Sat, 08/16/2025 - 10:52 PM
Completed: Sat, 08/16/2025 - 11:51 PM
Changed: Mon, 08/25/2025 - 12:59 PM
Remote IP address: 128.186.121.222
Submitted by: Anonymous
Language: English
Is draft: No
Webform: UROP Project Proposal Portal
Submitted to: UROP Research Mentor Project Submission Portal
Research Mentor Information
Additional Research Mentor(s)
{Empty}
{Empty}
{Empty}
{Empty}
{Empty}
{Empty}
{Empty}
{Empty}
Overall Project Details
improving computer system and microarchitecture security through AI agents
reinforcement learning, large language models, microprocessor, side channel attacks, system security
Yes
2
Computer science;
Electrical and computer engineering;
Electrical and computer engineering;
On FSU Main Campus
Yes
In-person
5-10
Flexible schedule (Combination of business and outside of business. TBD between student and research mentor.)
Timing attacks in microprocessors have gained increasing attention as a major security concern due to their high information leakage rate and the feasibility to combine with transient execution to build stronger attacks. Unfortunately, so far, the attack and defense policies of timing attacks have been mostly explored manually by computer architecture experts and highly rely on heuristics. The existing defenses are designed for known attacks, leaving the system at risk for potential new attacks.
This project proposes to address the problem by leveraging reinforcement learning (RL) agents. Learning from an environment instead of datasets, RL agents has shown super-human performance in many problems. Timing attacks and defense analysis for a given hardware design can be formulated as the problem of finding strategies in an environment, which can be solved by RL agents. With RL agents, we can explore vulnerabilities in microprocessors automatically, and defend against known and unknown attacks. This RL agent will help vendors build better/more secure processors that are future proof.
This project proposes to address the problem by leveraging reinforcement learning (RL) agents. Learning from an environment instead of datasets, RL agents has shown super-human performance in many problems. Timing attacks and defense analysis for a given hardware design can be formulated as the problem of finding strategies in an environment, which can be solved by RL agents. With RL agents, we can explore vulnerabilities in microprocessors automatically, and defend against known and unknown attacks. This RL agent will help vendors build better/more secure processors that are future proof.
Literature review;
programming and implement mircoarchitecture simulator;
perform machine learning and training;
machine learning model architecture search;
implement side channel proof of concept on real machines
programming and implement mircoarchitecture simulator;
perform machine learning and training;
machine learning model architecture search;
implement side channel proof of concept on real machines
required: Python programming, basic C/C++ programming skills
recommended: knowledge about computer architecture; experience with training machine learning models; some x86 assembly knowledge
recommended: knowledge about computer architecture; experience with training machine learning models; some x86 assembly knowledge
UROP is probably the first time the for many of the candidates to get involved in research activities. Specifically, I think there are three goals.
First, the student should be able to learn what research is about and what is the effort they need to put into if they want research as their career. To achieve that, I will let UROP mentees to participate in the research projects that are real, difficult, and impactful. The student may face more difficulty in these kind of projects, but they will get sense of the actual research life. Rather than doing some toy simple project, decide to pursue a PhD then figure out it is not want they are good at.
Second, the student should learn some useful practical skills that might be helpful for their future development either as a researcher or as an industry practitioner. In that regard, I will let mentee working on projects that exercise their programming skills, data analysis skills and writing skills. They will improve these skills as they work on the project and these skills will be useful for their future career inside and outside research.
Third, the student should be able to produce something scientifically valuable. It does not have to be a Nobel prize-level discovery, as long as what the student did contribute to one of the paper the lab is working on (the student can be credited as a coauthor), that would be fantastic to the student as well as to the lab.
First, the student should be able to learn what research is about and what is the effort they need to put into if they want research as their career. To achieve that, I will let UROP mentees to participate in the research projects that are real, difficult, and impactful. The student may face more difficulty in these kind of projects, but they will get sense of the actual research life. Rather than doing some toy simple project, decide to pursue a PhD then figure out it is not want they are good at.
Second, the student should learn some useful practical skills that might be helpful for their future development either as a researcher or as an industry practitioner. In that regard, I will let mentee working on projects that exercise their programming skills, data analysis skills and writing skills. They will improve these skills as they work on the project and these skills will be useful for their future career inside and outside research.
Third, the student should be able to produce something scientifically valuable. It does not have to be a Nobel prize-level discovery, as long as what the student did contribute to one of the paper the lab is working on (the student can be credited as a coauthor), that would be fantastic to the student as well as to the lab.
https://mulongluo.me
{Empty}
Yes
Friday, Sept 6th, 12-12:30pm https://fsu.zoom.us/j/7742440849
Friday, Sept 6th, 12:30-1pm https://fsu.zoom.us/j/7742440849
Friday, Sept 6th, 1-1:30pm https://fsu.zoom.us/j/7742440849
Friday, Sept 6th, 12:30-1pm https://fsu.zoom.us/j/7742440849
Friday, Sept 6th, 1-1:30pm https://fsu.zoom.us/j/7742440849
- Day: Friday, September 5
Start Time: 12:00
End Time: 12:30
Zoom Link: https://fsu.zoom.us/j/7742440849 - Day: Friday, September 5
Start Time: 12:30
End Time: 1:00
Zoom Link: https://fsu.zoom.us/j/7742440849 - Day: Friday, September 5
Start Time: 1:00
End Time: 1:30
Zoom Link: https://fsu.zoom.us/j/7742440849
UROP Program Elements
Yes
Yes
Yes
Yes
{Empty}
2025
https://cre.fsu.edu/urop-research-mentor-project-submission-portal?token=86HqaulNArec1R0X9tlTZ6qMqpPdHjyygk4EQ1mP6d0