There are two different things to test here: whether you dislike a field and whether the starting setup is just overwhelming. Spring Boot has a lot going on, so finding it confusing doesn't necessarily mean you dislike Java.
Some people lose interest when a project isn't exciting from the start. Others find it gets more enjoyable after they get past the frustrating beginner stage. Give a small project enough time to see which it is for you, but don't feel obliged to stick with something you dread.
If low-level code sounds appealing, C and embedded programming are options too. Sensors and motors can make the results tangible, though hardware costs and concepts like memory management add extra hurdles.
Javrix-5u:
Keep the first version really small. You can always add a score or an obstacle once the basic movement works.