动态爬虫与数据采集平台
Dynamic Web Crawler & Data Collection Platform
使用 Selenium + BeautifulSoup 搭建可复用动态页爬虫,支持无限滚动与复杂 DOM;设计标准化 ETL 清洗/解析并写入 MySQL/PostgreSQL。
Built a reusable crawler for dynamic pages using Selenium + BeautifulSoup, supporting infinite scroll and complex DOM structures. Designed a standardized ETL pipeline.