KNeeRF: NOVEL VIEW SYNTHESIS OF A KNEE’S INTERIOR
A 3D MODELING APPROACH TO OPTIMIZE GRAFT PLACEMENT
Översikt
- Datum:Startar 12 januari 2024, 10:00Slutar 12 januari 2024, 11:00
- Plats:
- Språk:Svenska och Engelska
Examiner: Fredrik Kahl
Abstract:
Anterior cruciate ligament (ACL) reconstruction surgeries suffer from high relapse
rates, due to the hard problem of placing the replacement graft. 3D models of knees
could be used as training material for medical professionals to practice placing the
ligaments to reduce relapse rates. We have developed a technique that can produce
realistic renders of knees’ interiors that can further be used in this context.
Our technique is based on Neural Radiance Fields (NeRF) to create novel views
of the knee, where we first compared different NeRF implementations to choose
a starting point for further development. We landed on using NeRF in the Wild
(NeRF-W) as our baseline model. We have made several extensions to NeRF-W to
further improve the application to ACL reconstruction surgeries, such as correcting
ray distortions to produce accurate renderings and using segmentation masks to help
the model remove medical tools from the renderings. We apply our system to data
sets of ACL reconstruction surgeries and demonstrate results that surpass those of
the models compared. We present an average improvement compared to NeRF-W
with 5.7% in PSNR, 0.69% in SSIM, and 23.5% in LPIPS.
Welcome!
Lukas, Charles och Fredrik