Skip to content

Finish private cloud and push here for warehouse native support of GCP BigQuery, Dataflow #1

Description

@ChiefsBestPal

OCI (easier free tier) , Azure and AWS solutions will follow current data models and ETL flow, and should be easy to migrate to full-support in futre.
But since GCP already deployed, need to push for native main cloud support for GCP services here to the public repo
and to cloud hosts of the database partitions and main warehouse.

  • Need BigQuery and Dataflow integrations pushed HERE for consistent holistic cloud solution across private clouds and this public repo

  • Verify throttling and ingress rules for ETL on GCP... Especially when Analytics engines needs to actively graph between 5M+ to 9M+ nodes and over... The scraping and extraction processes across should be mindful or throttle/rate limit/compliance interruptions

  • Docker builds will be for local SQL server, MySQL and BigQuery... But leave small excerpt for future migrations.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions