Yes you can to keep the baby from falling to the aisle. But when the seat belt sing is turned on the baby's own seat belt has to be attached to the main one and that only really works when sitting up.

Overall, the infant's seat belt is an interesting concept as many airlines don't provide or require any seat belts for infants while others like Finnair police it strictly.