Video-Based Surgical Skill Assessment using Artificial Intelligence

Artificial Neural Networks, Deep Learning, Computer Vision, Video Processing

Research Mentor: Dr. Erim Yanik, He/Him
Department, College, Affiliation: Mechanical Engineering / Dean's Office, FAMU-FSU College of Engineering
Contact Email: yaniker@eng.famu.fsu.edu
Research Assistant Supervisor (if different from mentor):
Research Assistant Supervisor Email:
Faculty Collaborators:
Faculty Collaborators Email:

Looking for Research Assistants: Maybe one more
Number of Research Assistants: 2
Relevant Majors: Open to all Engineering and Computer Science majors.

Open to medical school (On different terms. Please reach out and ask).
Project Location: FAMU-FSU College of Engineering / FSU Main Campus
Research Assistant Transportation Required: Yes
Remote or In-person: Partially Remote
Approximate Weekly Hours: 5-10, Flexible schedule (Combination of business and outside of business. TBD between student and research mentor.)
Roundtable Times and Zoom Link: Friday, September 8th from 3 pm to 5 pm.

Erim Yanik is inviting you to a scheduled Zoom meeting.

Topic: Erim Yanik's Personal Meeting Room

Join Zoom Meeting
https://us04web.zoom.us/j/6674363117?pwd=c1ozam14UU1vZ01oNG8ydEhnMjdQUT09

Meeting ID: 667 436 3117
Passcode: bB0Eby

Project Description

Current surgical education predominantly relies on mentor-apprenticeship, leading to subjective and labor-intensive learning paradigms. Regrettably, this approach detrimentally impacts surgical outcomes, contributing to the loss of approximately 400,000 lives annually due to surgical errors.

In this interdisciplinary study, we strive to use artificial intelligence and computer vision technologies to develop automated and objective state-of-the-art solutions to improve surgical education & evaluation, and feedback, as well as surgical data collection procedures, aiming to alleviate the patient safety concerns.

We use models from simple fully-connected networks to large language models, e.g., ChatGPT to achieve our objective.

Research Tasks: 1. Literature Review
2. Data Processing & Analysis
3. Artificial Intelligence Modelling
4. Video Editing, Processing & CAD modelling

Skills that research assistant(s) may need: Required:
* Proficiency in basic deep learning concepts, e.g., convolutional neural networks, fully-connected neural networks, recurrent neural networks.
* Proficiency in coding in Python.
* Proficiency in Tensorflow packages.
* Basic computer skills: open/edit images and videos.
* Microsoft Office skills
* Good communication skills.
* Most importantly curiosity and an open mind

Recommended:
* Experience in PyTorch package.
* Experience in ChatGPT prompt engineering or Large Language Models in general (not a requirement).
* Experience in meta learning, active learning, self-supervised contrastive learning concepts (not a requirement).
* Technical Writing Skills.
* Adobe Illustrator & Photoshop.
* CAD skills.
* Basic understanding of Surgical procedures (not a requirement).