One thing you could do is try is
Hostelling Intentional.
IME they run a tighter ship, and probably not have as much of a party atmosphere.
Of course if location is somewhere that drugs are legal and freely available, that may be out the window.
It's been a while since I've been last, though I was in a mixed 4 person hostel in Austin (no idea why Austin hotels are so expensive

) when I positioned for a $332 fare to Quito.
And even in liberal oasis in Texas didn't see or smell any substances illegal in Texas. Would certainly return.
Stayed at HI hostel in SEA many, many times as getting to Victoria, BC used to be ridiculously expensive but Victoria Clipper boats made it reasonable. Sadly, the fantastic location probably got too expensive and they are no longer there (I think they reopened somewhere else).