Burning Video DVD - .AVIs

I have like 5 movies in .avi, each about 700-800MB.

Is it possible to burn them all to one DVD that'd play on a standard DVD player?  Optimaly, so I'd be able to choose which to watch from a menu, and they'd retain their chapters. 

You know, just wondering if it's possible.  I can convert and do whatever else needed.

A standard DVD? Probably too much content, even for DL.
A DVD player that can handle DivX/XviD MPEG-4 formats? Very likely.
I take it when you say chapters, you mean those similar to a pressed DVD.  Those don't even exist in the .AVIs but you could generate them after you had converted to standard DVD-Video spec.

I would highly recommend getting a DivX-enabled standalone player if you don't already have one.  That way you could burn the .AVIs directly to disc and not have to spend time on conversion.