Sollicitatievraag bij Dataiku

How to sort a large dataset within constrained memory limits

Antwoord op sollicitatievraag

Anoniem

2 aug 2025

I proposed and discussed an external merge sort approach: - Split the input file into smaller chunks that fit into memory - Sort each chunk individually and store them in temporary files - Merge the sorted chunks to produce the final output