Introduction
Starbloom connectors are essential for managing data flow in Starbloom's data pipeline. They serve as the link between data sources, message queues, and databases, enhancing Starbloom's modularity, upgradeability, and scalability.
Each connector performs three main functions: data input, data transformation, and data output, functioning similarly to a stream processor or a streaming ETL.
By introducing a new connector to Starbloom, you can achieve various tasks, such as:
- Data ingestion
- Data transformation and augmentation
- Data indexing and streaming
These connectors enable all Starbloom data consumers to access and query data efficiently.