I'm preparing for an interview at a company that faces challenges related to CI/CD processes. Multiple teams need to utilize the same GPU resources for their pipelines due to the intensive nature of their workloads. I'm currently in charge of CI/CD for my team, but our workloads aren't very resource-heavy. I'm looking for strategies or processes that could help facilitate better coordination among teams while sharing these scarce resources. Any insights or recommendations would be greatly appreciated!
2 Answers
Consider asking some critical questions to understand the situation better. Start with how CI/CD is connected to the workloads and where exactly the GPUs are required. This could lead you to a more efficient setup!
Using a queuing system could be key here. It ensures that no team gets starved for resources, especially when demand is high. Try implementing a system that can manage access fairly and effectively.
True! It can get complex to merge everything into one scheduler, especially if it becomes a mix of CI/CD and batch job scheduling.