I use SQL for my data work but I'm new to Python. Coding challenge problems feel pretty rough so far. What should I focus on first if I want to move toward data engineering?
Coming from SQL, what Python should I learn for data engineering?
Asked by
++modestly!elastic
Answers
Start with the basics rather than judging yourself by coding challenges. SQL lets you describe the result you want. Python often asks you to spell out the steps, so loops, conditionals, functions, collections, and reading errors are worth getting comfortable with.
Try a small exercise that connects the two: run a SQL query from Python, read the result, and do something simple with it. That gives you a reason to practice the language without needing to solve puzzles first.
Reply to this answer
Once the basics click, look at pandas and then Spark if the jobs you're targeting use it. The tabular operations should feel more familiar coming from SQL. Python is often the glue connecting those tools, rather than the place where you write every data operation yourself.
Reply to this answer
Don't throw away your SQL knowledge. A useful next step is learning how Python connects to a database and executes queries, including how to pass parameters and work with result sets. Database design and understanding joins still matter when Python is part of the workflow.
Reply to this answer
Add your answer
Answers are reviewed before publication.
fennel-fueled:
I'd learn enough plain Python to understand what the library code is doing first. Otherwise the errors can be hard to untangle.