During the peak hours, the Foreign Frequent Visitor program can have a line of about ~10-15 people. Other than that, no one. One thing I would note is that the officers sometimes aren't aware they are the "Speedy Immigration" line and are in utter confusion when you walk up to them using the Frequent Visitor pass.

E-gate is really quick, there is never any line for it. There is no interview process for E-gate, you just have to go to the counter, give them your passport, get your photo/index prints taken, and pay the NT$3000 fee.

All this starts 11/1 so you should be fine for 11/9.