Data Engineer

Compact small files

Handle skew in data

Handle data spill

Optimize resource management

Tune queries by using indexers

Tune queries by using cache

Troubleshoot a failed Spark job

Troubleshoot a failed pipeline run, including activities executed in external services
1 2 … 4 5 6