Your comments

Why is it locked to 4gb no matter what the total size is supposed to be? I have increased the limits but it doesn't go beyond 4gb. There has to be something else limiting this.

memory limi is 15000m and max_executive_time is 999 and the size is around 30gb and about 100 files. i have a 100mbps