Ebay Sneakers WebScraping Using Selenium

Ebay Sneakers WebScraping Using Selenium

eBay Product Price & Details Web Scraping

This project demonstrates the use of Python-based web scraping to extract product information from eBay. The focus was on collecting structured data such as item titles, prices, and condition from search result pages, enabling price analysis and market research.

Key Features:

  • Data Extraction: Used Selenium to navigate eBay pages and extract product details dynamically.
  • Automation: Configured scripts to scrape multiple pages with minimal manual intervention.
  • Structured Output: Stored results in a clean, structured format for further processing and analysis.

Technologies Used:

  • Python – Core programming language
  • Selenium – Browser automation for dynamic page scraping
  • Pandas – Data storage and cleaning

Business Impact:

  • Competitive Analysis: Enables price comparison with competitors for strategic pricing decisions.
  • Market Insights: Identifies trends in product availability, condition, and pricing.
  • Operational Efficiency: Automates a process that would take hours if done manually.

Code Snippet

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
#from selenium.webdriver.support.ui import FluentWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.common.action_chains import ActionChains
from time import sleep
import requests
import pandas as pd
import string
import time
import numpy as np
import re
    
  # Load the dataset/ webscraping
  
driver.get('https://www.ebay.com')

all_url=[]

sneakers_name=[]

price=[]



specification = []

sleep(4)
driver.find_element(By.XPATH,"/html/body/div[4]/div/div/div/div[1]/header/section/form/div[1]/div/div/input").send_keys("Sneakers")
driver.find_element(By.XPATH,"/html/body/div[4]/div/div/div/div[1]/header/section/form/div[1]/div/div/input").send_keys(Keys.ENTER)



all=driver.find_elements(By.XPATH,"/html/body/div/div/div/div/div/ul/li/div/div/div/a")
for i in range(1,len(all)):
    all_url.append(all[i].get_attribute('href'))

sleep(5)
for i in range(len(all_url)):
    driver.get(all_url[i])

    sleep(5)
    name=driver.find_element(By.XPATH,"/html/body/div/main/div/div/div/div/div/div/div/div/div/h1/span").text#driver.find_element(By.XPATH,'/html/body/div[2]/main/div[1]/div[1]/div[4]/div/div/div[2]/div/div[1]/div[1]/h1/span')
    sneakers_name.append(name)
    price1=driver.find_element(By.XPATH,"/html/body/div/main/div/div/div/div/div/div/div/div/div[3]/div/div/div/span").text
    price.append(price1)


    #specification
    all_spec = driver.find_elements(By.XPATH, '/html/body/div/main/div/div/div/div/div/div/div/div/div/div/div/div/div/div[2]/div/div/div[2]/div/div/div')
    
    product_data = []  # temporary list for one product
    for c in all_spec:
        product_data.append(c.text)
    
    specification.append(product_data)

Other Projects

Telco Churn
Telco Churn
Telco churn refers to the rate at which customers discontinue their services with a telecommunications company-whether it's mobile, internet, cable TV, or bundled services. It's a critical KPI in the telecom industry because high churn rates = revenue leakage + brand instability.
Data-Science
Python
Scikit-learn
Pandas
Numpy
Tensorflow
Keras
Pytorch
View Project
supply chain spend analytics dashboard overview
supply chain spend analytics dashboard overview
This project involved building an interactive Spend Analytics Dashboard to help logistics, procurement and finance teams gain real-time visibility into organizational spending. The dashboard consolidated multi-year spend data across vendors, product categories, and logistics channels - providing a centralized decision-support system for cost control and strategic sourcing.
Visualization
PowerBI
View Project
Scraping Airbnb
Scraping Airbnb
This project demonstrates my ability to combine web scraping techniques with machine learning to classify images. The goal was to build a pipeline that scrapes images of shoes from a website and uses them for training a machine learning model.
WebScraping
BeautifulSoup
Selenium
Scrapy
View Project
Customers Transaction Analysis
Customers Transaction Analysis
A comprehensive database management system for a small business.
Database
SQL
MySQL
PostgreSQL
MongoDB
Pyspark
View Project
Bulldozer Sale Price Prediction
Bulldozer Sale Price Prediction
This project tackled a real-world business problem sourced from a Kaggle competition hosted by Caterpillar Inc. Using structured data containing product specifications, usage history, and transactional attributes, I built a machine learning pipeline capable of forecasting future equipment prices a key tool for optimizing resale strategy in capital-intensive industries.
Data-Science
Python
Scikit-learn
Pandas
Numpy
Tensorflow
Keras
Pytorch
View Project
Credit Score Prediction
Credit Score Prediction
This project focuses on building a predictive model to estimate an individual's credit score category-poor, Standard, or Good-based on financial and behavioral attributes. The goal is to assist financial institutions in automating credit risk assessment, improving loan approval decisions, and reducing default rates.
Data-Science
Python
Scikit-learn
Pandas
Numpy
Tensorflow
Keras
Pytorch
View Project
Customer Booking Prediction
Customer Booking Prediction
This Customer Booking Prediction project uses historical transaction data, customer behavior patterns, and contextual variables to forecast the likelihood and timing of future bookings. By applying machine learning models such as Logistic Regression, XGBoost, or Neural Networks, organizations can identify which customers are most likely to make a booking, when they are likely to do so, and what factors influence their decision
Data-Science
Python
Scikit-learn
Pandas
Numpy
Tensorflow
Keras
Pytorch
View Project
Bike Sharing Prediction
Bike Sharing Prediction
This project Bike Sharing Prediction leverages historical rental data, weather patterns, seasonal trends, and time-based variables to forecast future demand for shared bicycles. This predictive modeling process typically involves data preprocessing, feature engineering, and the application of machine learning algorithms such as Random Forest and Gradient Boosting
Data-Science
Python
Scikit-learn
Pandas
Numpy
Tensorflow
Keras
Pytorch
View Project
Customer Segmentation
Customer Segmentation
Developed a predictive classification model to determine the likelihood of a customer completing a booking. The project enables businesses to reduce cart abandonment, optimize marketing strategies, and increase conversion rates.
Data-Science
Python
Scikit-learn
Pandas
Numpy
Tensorflow
Keras
Pytorch
View Project
Sales Dashboard using Power BI
Sales Dashboard using Power BI
This Sales Performance Dashboard provides actionable insights into product sales, customer segmentation, and regional performance. Built with Power BI, this dashboard supports strategic decision-making by consolidating large volumes of transactional data into an interactive and visually intuitive interface.
Visualization
PowerBI
View Project
Vehicle Repair Dashboard
Vehicle Repair Dashboard
This Vehicle Repair Dashboard provides a strategic lens into fleet maintenance activities across suppliers, vehicle brands, and service types. It enables data-driven decision-making by highlighting repair patterns, supplier performance, and maintenance trends.
Visualization
PowerBI
View Project
Web Scraping and Image Classification with TensorFlow
Web Scraping and Image Classification with TensorFlow
This project demonstrates my ability to combine web scraping techniques with machine learning to classify images. The goal was to build a pipeline that scrapes images of shoes from a website and uses them for training a machine learning model.
WebScraping
BeautifulSoup
Selenium
Scrapy
View Project
British Airways Customer Review Web Scraping, Text Classification, Sentiment Analysis, and Customer Satisfaction
British Airways Customer Review Web Scraping, Text Classification, Sentiment Analysis, and Customer Satisfaction
This project demonstrates my ability to combine web scraping techniques with machine learning to classify images. The goal was to build a pipeline that scrapes images of shoes from a website and uses them for training a machine learning model.
WebScraping
BeautifulSoup
Selenium
Scrapy
View Project
British Airway Webscraping with Beautifulsoup
British Airway Webscraping with Beautifulsoup
This project demonstrates how web scraping can be used to extract valuable data from airline websites, specifically British Airways, using Python's BeautifulSoup library. The goal was to scrape flight-related data, such as flight details, prices, and other useful information, from the British Airways website for analysis.
WebScraping
BeautifulSoup
Selenium
Scrapy
View Project
Ecommerce Website Webscraping
Ecommerce Website Webscraping
This project uses requests and BeautifulSoup to scrape product listings from StockX’s e-commerce platform. The scraper extracts product name, description, price, and image link across multiple paginated results, storing them in a structured dataset for analysis or integration into business workflows.
WebScraping
BeautifulSoup
Selenium
Scrapy
View Project
Jumia Website Scraping
Jumia Website Scraping
This project uses requests and BeautifulSoup to scrape product listings and prices from Jumia Nigeria. The scraper works across multiple pages and categories, returning structured datasets ready for analysis.
WebScraping
BeautifulSoup
Selenium
Scrapy
View Project
Stack Overflow Text Classification
Stack Overflow Text Classification
This project involves building a multi-class classification model to predict the tag of a Stack Overflow question based on its content. The goal is to classify programming questions into specific tags such as Python, CSharp, JavaScript, and Java using Natural Language Processing (NLP) techniques.
Data-Science
Deep-Learning
Python
Numpy
Tensorflow
Keras
Pytorch
View Project
Fruits Image Classification
Fruits Image Classification
This project leverages image classification techniques to classify fruit images into their respective categories using Convolutional Neural Networks (CNN). The dataset used is the Fruits 360 dataset, which includes a wide variety of fruits and vegetables, and the goal was to build a model capable of predicting the type of fruit based on the image.
Data-Science
Deep-Learning
Python
Numpy
Tensorflow
Keras
Pytorch
View Project
Purchase Prediction
Purchase Prediction
Purchase Prediction with Logistic Regression.This project focuses on using logistic regression to predict customer purchases based on various demographic and behavioral features. The goal was to predict whether a customer will make a purchase (binary classification) using factors such as age, gender, marital status, income, occupation, and more.
Data-Science
Scikit-learn
Python
Numpy
K-Means
PCA
Logistic Regression
View Project
Uber Ride Analytics Dashboard Overview
Uber Ride Analytics Dashboard Overview
This project involved building an interactive Uber Analytics Dashboard to provide insights into ride bookings, payment methods, vehicle usage, and location-based demand. The dashboard enabled stakeholders to monitor trends in customer behavior, evaluate revenue drivers, and optimize fleet allocation for operational efficiency and strategic planning.
Visualization
PowerBI
View Project
HR Analytics Dashboard Employee & Attrition Insights
HR Analytics Dashboard Employee & Attrition Insights
This project involved building an Interactive HR analytics dashboard covering employee attrition, hiring, salaries and departmental performance. Includes data visualizations and KPIs for strategic HR decision-making.
Visualization
PowerBI
View Project