Toward the front of the armrest, there's a removable plastic cover...pop that cover off and remove the two large screws that hold the door panel to the door.(you don't need to do anything with the screws that hold the master window switch to the panel)

Next, you need to remove the plastic insert piece on the part of arm rest that connects up by the door handle. After you get that piece out, you will see another large screw up near the top. Remove that screw.

The panel is now ready to come off. Just use a screwdriver to pop the plastic grabbers that are located around the outside of the panel. These grabbers are located on all three sides. Then just carefully lift the panel up off the top of the door. It doesn't matter if the window is up or down. Also...be careful when reinstalling, that the cable that goes from the handle is held in place by the little fork piece near the handle or the door won't open from the inside.