Aggregate News

Multi-source cryptocurrency news aggregation system with AI-powered sentiment analysis, trend detection, and market impact prediction. Monitors 50+ crypto news sources, social media platforms, and official project announcements in real-time.

Supported Sources: CoinDesk, CoinTelegraph, Decrypt, The Block, Bitcoin Magazine, CryptoSlate, Twitter/X, Reddit, Medium, Telegram, Discord, official project blogs, SEC filings, exchange announcements

When to Use This Command

Use /aggregate-news when you need to:

• Monitor breaking crypto news across multiple sources in real-time
• Analyze sentiment shifts before market movements
• Track specific coins, projects, or topics (DeFi, NFTs, regulation)
• Identify trending narratives and meme coins early
• Correlate news events with price movements
• Research fundamental analysis for trading decisions
• Monitor regulatory developments and exchange listings
• Track whale social media activity and influencer sentiment

DON'T use this command for:

• Single-source news reading - Use direct RSS feeds
• Historical price analysis - Use /analyze-trends instead
• On-chain data analysis - Use /analyze-chain instead
• Technical analysis - Use /generate-signal instead
• Real-time price tracking - Use /track-price instead

Design Decisions

Why Multi-Source Aggregation? Single sources have bias and delays. Aggregating 50+ sources provides complete market coverage and cross-verification of breaking news.

Why Sentiment Analysis?

• AI sentiment chosen: News sentiment predicts price movements 15-30 minutes before impact
• Manual reading rejected: Impossible to read 1000+ articles/day across sources

Why Real-Time vs Hourly Digests?

• Real-time chosen: Breaking news impacts prices within seconds (exchange hacks, regulations)
• Hourly rejected: 60-minute delays miss trading opportunities

Why Deduplication?

• Deduplication chosen: 50+ sources report same news, creates 80% redundancy
• All articles kept rejected: Would generate 5000+ alerts/day

Why Market Impact Scoring?

• Scoring chosen: Not all news is equally important (0-100 scale)
• Equal weight rejected: Treats minor updates same as exchange hacks

Prerequisites

Before running this command, ensure you have:

1. News API Access (at least 3 recommended):

• NewsAPI.org key (free: 100 requests/day, paid: unlimited)
• CryptoCompare News API (free tier available)
• CoinGecko News API (no key required, rate limited)
• Alternative Data News API (premium)
• Messari News API (enterprise)

1. Social Media APIs:

• Twitter/X API v2 bearer token (Essential: $100/month)
• Reddit API credentials (free with rate limits)
• Telegram bot token (for channel monitoring)
• Discord bot token + OAuth2 (for server monitoring)

1. AI/ML Services (choose one):

• OpenAI API key (GPT-4 for sentiment: $0.03/1K tokens)
• Anthropic Claude API key (recommended: $0.015/1K tokens)
• Google Vertex AI credentials (PaLM 2)
• Local sentiment model (FinBERT, CryptoBERT)

1. Database (for historical tracking):

• PostgreSQL 13+ with pgvector (similarity search)
• MongoDB 5+ (document storage)
• Elasticsearch 8+ (full-text search, recommended)

1. Infrastructure:

• Linux server (Ubuntu 20.04+) or Docker
• 8GB RAM minimum (16GB for 50+ sources)
• 500GB storage (6 months history)
• Redis (for real-time caching and deduplication)

Implementation Process

Step 1: Configure News Sources

Create config/news_sources.json:

{
  "sources": {
    "mainstream_crypto": [
      {
        "name": "CoinDesk",
        "type": "rss",
        "url": "https://www.coindesk.com/arc/outboundfeeds/rss/",
        "impact_weight": 1.0,
        "credibility": 0.95
      },
      {
        "name": "CoinTelegraph",
        "type": "rss",
        "url": "https://cointelegraph.com/rss",
        "impact_weight": 0.9,
        "credibility": 0.90
      },
      {
…

Step 2: Set Up Sentiment Analysis

Create config/sentiment_config.json:

{
  "provider": "anthropic",
  "model": "claude-3-5-sonnet-20241022",
  "api_key_env": "ANTHROPIC_API_KEY",

  "sentiment_scale": {
    "very_bearish": -1.0,
    "bearish": -0.5,
    "neutral": 0.0,
    "bullish": 0.5,
    "very_bullish": 1.0
  },

  "entity_extraction": {
    "enabled": true,
    "categories": [
      "cryptocurrencies",
      "exchanges",
…

Step 3: Initialize Database Schema

-- PostgreSQL with pgvector for semantic search
CREATE EXTENSION IF NOT EXISTS vector;

CREATE TABLE news_articles (
    id SERIAL PRIMARY KEY,
    article_id VARCHAR(255) UNIQUE NOT NULL,
    source VARCHAR(100) NOT NULL,
    source_type VARCHAR(50) NOT NULL,
    title TEXT NOT NULL,
    content TEXT,
    summary TEXT,
    url TEXT UNIQUE NOT NULL,
    author VARCHAR(255),
    published_at TIMESTAMP NOT NULL,
    fetched_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
    language VARCHAR(10) DEFAULT 'en',

    -- Sentiment analysis
…