Redd Archiver
A PostgreSQL-backed archive generator that creates browsable HTML archives from link aggregator platforms including Reddit, Voat, and Ruqqus.
Install
git clone https://github.com/19-84/redd-archiverInstall command taken from the project's README or registry entry. Always review code before running it.
README excerpt
Read full README on GitHub →Redd-Archiver
⭐ If you find this project useful, please star the repo! It helps others discover the tool and motivates continued development.
Transform compressed data dumps into browsable HTML archives with flexible deployment options. Redd-Archiver supports offline browsing via sorted index pages, full-text search with Docker deployment, or fully dynamic serving straight from PostgreSQL. Archives stay current with monthly incremental updates from Arctic Shift dumps. Features mobile-first design, multi-platform support, operator-selectable themes, and PostgreSQL full-text indexing.
Supported Platforms:
| Platform | Format | Status | Available Posts | Data |
|---|---|---|---|---|
| .zst JSON Lines (Pushshift/Arctic Shift) | ✅ Full support | 2.38B+ posts (40,029 subreddits; rolling — monthly dumps keep archives current) | Download | |
| Voat | SQL dumps | ✅ Full support | 3.81M posts, 24.1M comments (22,637 subverses, complete archive) | Download |
| Ruqqus | .7z JSON Lines | ✅ Full support | 500K posts (6,217 guilds, complete archive) | Download |
Tracked content: 2.38B+ posts across 68,883 communities (full Reddit dataset plus monthly Arctic Shift dumps via incremental updates; Voat/Ruqqus complete archives)
Version 1.1 “Living Archive” adds three serving modes, monthly incremental updates, 11 theme palettes, community metadata/wiki enrichment, and a major performance pass on top of 1.0's multi-platform archiving, REST API, and MCP server. See CHANGELOG.md.
🧭 Serving Modes
One archive, three ways to serve it — the database is the canonical store, switch modes anytime:
| Static | Hybrid (default) | Dynamic | |
|---|---|---|---|
| Runtime requirements | Any web host | nginx + Flask + PostgreSQL | Flask + PostgreSQL |
| Full-text search / REST API | — | ✅ | ✅ |
Dynamic filtering (?flair=&min_score=&from=) & /all/ view |
— | — | ✅ |
| Content live immediately after import | export step | export step | ✅ instantly |
| GitHub Pages / USB-stick / offline | ✅ | pages only | — |
# Static: export once, host anywhere
reddarc.py /data --subreddit privacy ... --output /var/www/html/
# Hybrid (current default): static pages + search server
docker compose up -d
# Dynamic: no export step, Flask renders pages from PostgreSQL
reddarc.py --import-only /data --subreddit privacy ...
REDDARCHIVER_SERVE_MODE=dynamic python search_server.py
🔄 Keep Archives Current (Incremental Updates)
Apply monthly Arctic Shift dumps to an existing archive — only tracked subreddits are imported, re-runs are skipped by checksum, and scores refresh without altering preserved content:
# One month
reddarc.py --update RS_2026-01.zst --comments-file RC_2026-01.zst
# Or point at a downloaded monthly torrent (comments/ + submissions/ layout
# is auto-discovered) and apply every unprocessed month in order:
reddarc.py --update-all /data/monthly/reddit/
reddarc.py --update-status # audit what has been applied
🚀 Quick Start
Similar plugs
An open-source AI agent that brings the power of Gemini directly into your terminal.
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
The fastest path to AI-powered full stack observability, even for lean teams.
The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory,…
⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts. 告别信息过载，你的 AI 舆情监控助手与热点筛选工具！聚合多平台热点 + RSS 订阅，支持关键词精准筛选。AI 智能筛选新闻 + AI 翻译 + AI…