Skip to main content

RSS

Overview

The RSS source allows you to read data from any individual RSS feed.

Output schema

This source is capable of syncing the following streams:

  • items
    • Provides stats about specific RSS items.
    • Most fields are simply kept from RSS items as strings if present (title, link, description, author, category, comments, enclosure, guid).
    • The date field is handled differently. It's transformed into a UTC datetime in a published field for easier use in data warehouses and other destinations.
    • The RSS feed you're subscribing to must have a valid pubDate field for each item for incremental syncs to work properly.
    • Since guid is not a required field, there is no primary key for the feed, only a cursor on the published date.

Features

FeatureSupported?
Full Refresh SyncYes
Incremental - Append SyncYes
NamespacesNo

Requirements / Setup Guide

Only the url of an RSS feed is required.

Performance considerations

None

Reference

Config fields reference

Field
Type
Property name
string
url

Changelog

Expand to review
VersionDatePull RequestSubject
1.0.152024-08-2444635Update dependencies
1.0.142024-08-1744257Update dependencies
1.0.132024-08-1243883Update dependencies
1.0.122024-08-1043687Update dependencies
1.0.112024-08-0343073Update dependencies
1.0.102024-07-2742687Update dependencies
1.0.92024-07-2042139Update dependencies
1.0.82024-07-1341741Update dependencies
1.0.72024-07-1041570Update dependencies
1.0.62024-07-0941197Update dependencies
1.0.52024-07-0640921Update dependencies
1.0.42024-06-2540410Update dependencies
1.0.32024-06-2240083Update dependencies
1.0.22024-06-0439085[autopull] Upgrade base image to v1.2.1
1.0.12024-04-3037535Fix incremental sync
1.0.02024-04-2036418Migrate python cdk to low code
0.1.02022-10-1218838Initial release supporting RSS