There's a couple of things:
1) Check the battery (not just the voltage, have it load tested if there is even a shred of doubt). Low battery is an EXTREMELY common cause for host of "behavioral" problems in these vans.
2) Pull the IOD fuse for 20-30 seconds, then reinsert. I've heard this can sometimes fix the issue. Also heard it points to potential battery problems, but not certain.
3) The infamous bad solder joints on the instrument panel. Typically, the symptoms are the vehicle periodically refuses to start, but striking the instrument panel with your hand can get it to go (for awhile anyway). If striking the instrument panel has any noticeable effects on the behavior, I would tend to guess that's your problem. Search this site as there is a tutorial with pictures and everything IIRC.
2003 Honda Odyssey EXL (3.5L)
1997 Town & Country LXi (3.8L)
1992 Honda Accord LX (2.2L)
1990 Chevy K2500 (5.7L TBI)