2e8e07ed17
- Replace direct product URL navigation with fixed heatmap URL and UI product selection - Implement cookie validation with automatic session cleanup - Update login flow to use SSO authentication and new form selectors - Improve data extraction with iframe context and better table parsing - Add multiple fallback selectors for gold price scraping - Enhance error handling, logging, and timeout management
22 lines
638 B
Plaintext
22 lines
638 B
Plaintext
# CME Group QuikStrike Login Credentials
|
|
CME_USERNAME=your_username_here
|
|
CME_PASSWORD=your_password_here
|
|
CME_LOGIN_URL=https://login.cmegroup.com/sso/accountstatus/showAuth.action
|
|
|
|
# QuikStrike URL (fixed - always same page)
|
|
QUIKSTRIKE_URL=https://www.cmegroup.com/tools-information/quikstrike/open-interest-heatmap.html
|
|
|
|
# Gold Price Source (investing.com)
|
|
INVESTING_URL=https://www.investing.com/commodities/gold
|
|
|
|
# Output Settings
|
|
CSV_OUTPUT_PATH=./oi_data.csv
|
|
TOP_N_STRIKES=3
|
|
|
|
# Scraping Settings
|
|
HEADLESS=false # Set to true for production
|
|
TIMEOUT_SECONDS=30
|
|
RETRY_ATTEMPTS=3
|
|
|
|
# Logging
|
|
LOG_LEVEL=INFO # DEBUG, INFO, WARNING, ERROR |