emarket_data_explorer.shopee_crawler

This module provides the Shopee Data Crawler functionality.

Todo:

  1. very ugly codes too many if-else and for-loop, need to refactor

  2. move the following jobs to config.py or data_builder.py

  3. should dynamically represent data_source, not ‘shopee’.

emarket_data_explorer.shopee_crawler.get_configs_data(config_file: Path) → Path

Return the current path to the shopee_data.

emarket_data_explorer.shopee_crawler.get_data_path(config_file: Path) → Path

Return the current path to the shopee_data.

emarket_data_explorer.shopee_crawler.init_data(data_path: Path) → int

Create the shopee_data folder.