Are broken links bad for SEO?

I just ran a site audit and found a bunch of broken links on my site. How worried should I be about this? Also, is it just internal broken links I need to worry about, or external ones too?

Of course! It is an Error. Which is cause of negative effect. It is also cause for bad experience of your user. So, you should solve it as soon as possible