Asked questions on python, sql queries, etl process, spark, kafka and also asked to write solution for python problem. Explain your experience with ETL pipelines, AWS services, data modeling, and optimizing SQL queries. How do you ensure data quality and handle large-scale data processing? Describe monitoring tools you’ve used and your approach to collaborating with data analysts and engineers.
Sollicitatievragen [1]
Vraag 1
Can you describe your experience designing and optimizing ETL pipelines in AWS, and how you handle data quality and scalability challenges?
