Data Loading
Loading Overview
Data loading is the process of cleansing and transforming raw data from various data sources based on your business requirements and loading the resulting data into StarRocks to facilitate analysis.
Strict mode
Strict mode is an optional property that you can configure for data loads. It affects the loading behavior and the final loaded data.
Batch load data from Amazon S3
PhoenixAI provides the following options for loading data from AWS S3:
Batch load data from Azure cloud storage
PhoenixAI provides two options for loading data from Microsoft Azure Storage:
Load data from a local file system
PhoenixAI allows you to load data from a local file system by using Stream Load.
Load from Confluent Cloud
2 items
Load data from Amazon MSK
This topic introduces how to create a Routine Load job to stream messages (events) from Amazon Managed Streaming for Apache Kafka (Amazon MSK) into PhoenixAI.
Load data using INSERT
How to load data into StarRocks using INSERT statements: INSERT VALUES, INSERT INTO SELECT, INSERT OVERWRITE, Dynamic Overwrite, and loading from files...
Load data from Amazon Kinesis
This topic describes how to load data from Amazon Kinesis into PhoenixAI.
Load data using Stream Load transaction interface
How to use the Stream Load transaction interface (two-phase commit) in StarRocks for highly concurrent stream loads from Flink or Kafka with multi-table...
Realtime synchronization from MySQL
How to use Flink CDC to capture MySQL change data in real time and synchronize it into StarRocks tables using the StarRocks Flink connector.
Realtime synchronization from PostgreSQL
How to use a Flink CDC pipeline to capture PostgreSQL changes and stream them into StarRocks Primary Key tables in real time.
Continuously load data from Apache Flink®
How to use the StarRocks Flink connector to continuously load data from Apache Flink into StarRocks, supporting DataStream API, Table API & SQL, and Python API.
Change data through loading
How to perform INSERT, UPDATE, DELETE, partial update, and conditional update on Primary Key tables in StarRocks using Stream Load, Broker Load, or Routine...