What Should I Do If Unknown Devices Are Still Connecting to My Router After Changing the Password?

I recently changed my router password because I noticed an unknown device connected to my network. I'm wondering what steps I should take next. Should I change the router password first or do something else? If I've been hacked, can I change my password from a new device that hasn't been connected to the network before? I appreciate any guidance on keeping my network secure.