I'm working on a project where I need to develop a standalone app capable of handling large datasets, typically over 500MB. One key requirement is that I cannot use a database management system (DBMS) for this app. The data comes in as XML, which I'll convert to JSON. Since I'm under an NDA, I can't share too many specifics, but I believe IndexedDB might be a suitable solution. The app is solely client-based, with no server component. Moreover, it's important that the entire setup process is simple for users, and the data format is standardized but varies by institution (e.g., different servers provide different data depending on the university).
3 Answers
Since you can't use a database, I'd suggest thinking about your needs for data persistence. Depending on whether you need to keep the data across sessions or if it's temporary, your solution might change. IndexedDB could still be your best bet for larger datasets that need to persist, while if it’s temporary, simpler storage might suffice.
Have you considered using IndexedDB? It’s designed for client-side storage and can handle large amounts of data efficiently without relying on a server. Plus, it’d keep your app compliant with your constraints!
Another approach could be to split your 500MB JSON file into smaller chunks. For example, you could create 500 files of 1MB each based on specific key fields. Load these files dynamically as needed, though you'll need to manage searches and filters carefully since you can’t sum over the entire dataset easily.
Related Questions
Cloudflare Origin SSL Certificate Setup Guide
How To Effectively Monetize A Site With Ads