Parallelize partitioning of large files

[mpenkov]

For files larger than a certain size (e.g. 10GB), split them into equal sized chunks.

Then partition each chunk in parallel, and concatenate the partitions.