Some, yes, others, not. The ones with liquid acid in them probably won't work, others with the acid absorbed in glass mat or something like that MAY. Read the info about the battery you have in mind, if it's okay to lay it down the info will say so.
Several years ago I saw a T bucket with 390 Caddy engine and he had the Optima battery mounted sideways on the frame. Said it was no problem and that he'd built it that way and hadn't had any problems with it.
It has to be an AGM battery (Absorbed Glass Mat) and then it can be mounted on it's side. I have one mounted in my RPU that way.
I have an Optima battery in my boat I can switch out for a conventional battery. Thanks for the advice...