Good question. The short answer is no. They are 3.3V-only inputs.
When configured for 3.3V CMOS operations, the serial lines go directly to the processor. Treat them like XScale GPIOs, as listed in section 6.2.10 of the user manual but note that there is no series resistance or ESD protection. If there's any risk of ESD, you'll need to provide protection for those lines.