This type of machine washable "scarf" with a removable neck support frame is, for me, more comfortable than standard airplane neck pillows. They cost $10 on eBay with free shipping.
Another $10 deal on eBay is a blackout sleep mask that does not touch your eyes so you can REM sleep (or keep your eye makeup from smearing). The standard airline sleep masks are not opaque and put pressure on my eyelids.
Standard soft ear plugs work ok for me but I also travel with the best active noise canceling headphones and they work much better. When I sleep on the plane, I wear the headphones but don't play any sound.