Has anyone successfully connected Azure to a non-Azure HTTP data API? I'm really hoping to hear from someone since I've asked this before without any luck. We're using Azure Synapse to drive data into a datamart for Power BI and need to pull data from a third-party tool that has an API for data collection. I've got some documentation but it's vague and hasn't worked for me so far. I'll even buy a beer for the first person who can share their experience—be it yes or no! So, is there anyone out there who has managed to do this?
4 Answers
Nope, haven’t done it. Seems tricky. I’d suggest that, if it’s required for your project, you might want to explore other options or ETL tools. But I keep hearing it can be done.
For sure, it can be done, but I had some challenges myself! It’s crucial to have the right authentication in place. I struggled when the customer service from the source didn't fully help, which added a lot of delays. Just keep trying with the documentation, as it should eventually work out!
Yes, definitely! You can use Azure Data Factory (ADF) or Fabric Data Factory to connect to non-Azure APIs. Check out Microsoft's documentation on how to copy and transform data from REST endpoints. It details how to set up connections and manage data flow effectively.
Thanks for the tip! I’m having trouble with authentication, though. The data source only supports OAuth and I can't figure out how to set that up in Linked Services. I think I’ve got the Token Endpoint right, but I don’t know how to discover the Client ID and Secret.
Absolutely! I've built REST clients that interact with external APIs. If you're asking specifically about Synapse, it's pretty straightforward. Think of it like using curl from a VM in Azure, just set up your API calls accordingly.
I feel you! I’m stuck too on setting up OAuth; it's been chaos trying to get the right info from the data source.