Manual Up/Down Function Does Not Operate On Driver Side: Wiring Diagram
WARNING: This page is about a different car, the 2004 Toyota Prius. However, it is still accessible from the selected car via links, so may be relevant.
Fig 1: Wiring Diagram-Manual UP/DOWN Function (Driver Side)