Dequeue Table of Content Font

I have been using the Table of Contents plugin on my website. It is slowing down my site but I don't want to remove TOC from my site. Is there any way to remove TOC sources?