Looking for Advice on Building an API Service for Scraping

0
3
Asked By CleverPenguin42 On

Hey everyone! I'm currently working on an API service that focuses on web scraping, but I'm running into some challenges. One major issue is that I need to allow users to create and revoke their own API keys, set expiration dates, and manage billing based on API usage. I'm wondering if there's a service out there that can help facilitate this kind of functionality. If you have any suggestions or know of similar solutions, I would really appreciate your input! Thanks!

3 Answers

Answered By TechSage99 On

It sounds like you're trying to tackle quite a few features there! You might want to check out some API management platforms that offer built-in support for user authentication and key management. Services like Auth0 or even AWS API Gateway can help streamline the process of handling API keys and billing. Just keep in mind that implementing scraping could have legal implications depending on the data you're accessing!

Answered By DataDiva87 On

You might find tools like Kong help if you're planning to manage multiple services. It allows for easier routing and management of APIs. It's ideal when you have various services running and need a consistent management layer. Plus, it has extensive plugins to support different functionalities you may need.

Answered By ScraperBilly52 On

Can you share what specific data you're looking to scrape? There could be existing APIs that provide what you need without having to scrape. Lots of businesses share their data through APIs, and it could be more efficient than building your own if the data is already out there.

Related Questions

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.