I think worldbuilding is a perfectly acceptable dumb hobby to have, so long as you're keeping it to hobby levels and not, like, "I am the next Tolkein, only with dickgirls instead of elves." There ARE a few settings where people are actually into consuming worldbuilding-- tabletop RPGs being the big one-- but mostly the only people who give a shit about your lore on its own are you and the sockpuppet accounts you made.
Like, sometimes you just wanna sit there and make up an entire goofy religion that doesn't have to do with anything and doesn't matter.