Forum Discussion
Aggregation of enterprise data and exporting large datasets to third parties
Assume a large organization with multiple applications/systems that may or may not be connected. All systems are currently on-prem. There are requirements to aggregate data from various sources (int...
1) would be Data Lake, Data Warehouse or Cosmos DB
2) would be Azure Database Migration Service, Azure Data Factory or Event Streaming
3) would be Azure Blob Storage, Azure Files or SFTP Gateway
Rubio67
check this.....Data Storage: Use Azure Data Lake Storage Gen2 for storing large datasets. Optionally, use Azure Synapse Analytics for complex queries and analytics.
Data Transfer: Implement Azure Data Factory with Change Data Capture (CDC) for ongoing data transfer from on-premises databases. Use Azure Database Migration Service for initial migrations.
Secure Data Sharing: Share data with third parties via Azure Blob Storage using Shared Access Signatures (SAS) for secure, temporary access. For SFTP requirements, configure SFTP on Azure Blob Storage.
This solution provides a scalable and secure way to replace the legacy system with Azure cloud services.
