I currently work as a data analyst, although much of my role is closer to data engineering. I build and monitor ETL pipelines, create dashboards, and maintain and update queries. I have also developed forecasting tools and some AI agents. What I have not done much of yet is build complete applications, so I am exploring ways to get that experience within my current team or company. I am learning Django and Java Spring Boot and would appreciate practical advice on what to focus on next, along with any honest feedback about this transition.
3 Answers
Try to stop collecting frameworks and start shipping small, complete applications. Pick one useful problem at work or in a personal project and take it from requirements through implementation, testing, deployment, and documentation. A small service that real people use will teach you more about software engineering than several unfinished tutorials.
A direct way to gain software engineering experience is to turn some of your existing scripts, forecasting tools, or AI workflows into small REST services. Use Django or Spring Boot to expose them through well-designed endpoints, add authentication and tests, document the API, and deploy them for another team to use. That gives you practice with backend design, error handling, databases, monitoring, and maintenance instead of only learning frameworks in isolation.
Your background may line up especially well with data infrastructure engineering. It lets you use your ETL experience while building systems that make data more useful to applications and business workflows. Look for internal systems of record that could be populated or improved using information already available in your data platform. Reverse ETL is another practical area to explore, since many companies still have awkward gaps between their analytics stack and operational applications.
That sounds like a useful direction. What tools, habits, or types of projects would help me become effective in a data infrastructure role?