The overflow box is just two or three sided acrylic or glass. There is no bottom or top to it. They run pretty much the full height of the tank. Water overflows into the box from the top (usually has "teeth" grills to keep big stuff from getting drawn into the overflow box). People usually have the hole drilled at the bottom of the overflow where it drains.
Here's a corner (two side) overflow box to give you an idea:
Here's a corner (two side) overflow box to give you an idea:
