cdc-streaming-pipeline
bykilo-org· 59 skills
Build a real-time change-data-capture pipeline from a transactional database (Aurora DSQL, Aurora Postgres, RDS) to Redshift Serverless, S3, or any other sink, via Kinesis Data Streams (or MSK). Covers producer setup, consumer Lambda correctness, the append-only event log + reconstruction pattern, schema-drift handling with SUPER + JSON_PARSE, and the operational gotchas (Redshift Data API parameter caps, async statement polling, poison-record handling, retry-and-bisect). Use when the user asks for "CDC to Redshift", "stream change data capture", "Aurora CDC", "DSQL CDC", "Postgres replication to S3", or "build a Lambda consumer for Kinesis CDC". Aurora DSQL public-preview specifics are flagged; the rest is source-agnostic.
How to install cdc-streaming-pipeline?
kilo-org/kilo-marketplace/cdc-streaming-pipeline
$npx -y skills add kilo-org/kilo-marketplace --skill cdc-streaming-pipelineInstalls into the current project.
›Prefer a prompt? Paste this to your agent
Run `npx skills use "https://github.com/kilo-org/kilo-marketplace" --skill "kilo-org/kilo-marketplace/cdc-streaming-pipeline"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/kilo-org/kilo-marketplace" that are relevant to the current task. Run `npx skills add "https://github.com/kilo-org/kilo-marketplace"` and select the relevant skills, then follow their instructions.
Related
6 picksType
- azure-kustoQuery and analyze data in Azure Data Explorer (Kusto/ADX) using KQL for log analytics, telemetry, and time series analysis.Jul 2026
- analyticsWhen the user wants to set up, improve, or audit analytics tracking and measurement.Jul 2026
- firecrawl-dashboard-reportingPull metrics from analytics dashboards and internal web tools with Firecrawl browser.Jun 2026
- data-storytellingTransform data into compelling narratives using visualization, context, and persuasive structure.Jul 2026
- data-visualizationCreate effective data visualizations with Python (matplotlib, seaborn, plotly).Jul 2026
- extension-oqlMake a canister's data queryable by the Caffeine Data Intelligence agent.Jul 2026
