Sure thing!
All you need is an AppleWatch with WatchOS 9 or newer. If you have an internet connection via wifi or eSim, you can stream books without having your phone with you.
If you have BookBeat version 8.3 or newer you can even download books to your watch and listen without having to rely on your phone or internet connection.