Twitter/X Sentiment Scraper

A production-ready Twitter/X scraping and sentiment analysis engine that monitors thousands of accounts and hashtags in real time, scores sentiment using fine-tuned NLP models, and generates actionable trading signals.

What's Included — Full Source Code:

• Complete Python source code
• Twitter/X API v2 integration + scraping fallback
• Fine-tuned FinBERT sentiment model
• Signal generation engine
• Docker deployment

Core Features:

• Real-time monitoring — tracks 500+ crypto influencers, project accounts, and trending hashtags simultaneously
• AI sentiment scoring — fine-tuned FinBERT model scores each tweet on a -1 to +1 scale with crypto-specific context
• Aggregate sentiment signals — combines individual tweet scores into asset-level sentiment (bullish/bearish/neutral) with confidence rating
• Anomaly detection — flags sudden sentiment spikes or drops that historically precede price moves
• Volume tracking — monitors mention volume changes as a leading indicator
• Influencer weighting — high-follower accounts and historically accurate callers get higher weight

Signal Output:

• Sentiment score per asset (BTC, ETH, SOL, and 100+ altcoins)
• Sentiment change velocity (rate of shift)
• Mention volume vs. 7-day average
• Webhook output to Telegram, Discord, or your trading bot
• CSV/JSON export for backtesting

Data Sources:

• Twitter/X API v2 (filtered stream + search)
• Scraping fallback for rate limit bypass
• Reddit r/cryptocurrency, r/wallstreetbets integration
• Telegram group monitoring (optional)

Tech Stack:

• Python 3.11+ with asyncio
• FinBERT (Hugging Face transformers)
• Redis for real-time state
• PostgreSQL for historical data
• FastAPI dashboard
• Docker Compose deployment

Full source code. Self-hosted. Feed sentiment data into any trading bot or strategy.