It sounds strange that GAP should not be able to get more than 4.75 MByte
of memory. Could it be that you have a limit on the maximal process
size? Try 'limit' or 'ulimit' (depending on which shell you use).

Could this be the contiguous memory problem again? GAP needs its
workspace to be together in virtual memory. Is there something in
Linux that could be preventing this?