No. Those days are long gone.
I am traveling on Monday in PE and I have packed my pyjamas in hand luggage. I might get a few looks but I am too old to care about that sort of stuff any more. Comfort and enjoyment that you have paid for. Tick.
Tracksuit will be totally fine
The biggest mistake you can make is overthinking your travel as something people are going to be judging you on. It's your journey, the cabin folks want to make it as nice as they can for you. Your fellow travellers will care not a jot what you wear or do.
If Dave Grohl from Foo Fighters can wear BA pyjamas on Letterman I think you are safe.