Research Question: How does the use of AI-powered chatbots in customer service impact
customer satisfaction in e-commerce businesses?
To effectively answer this question, it is crucial to obtain a sample that accurately represents
customers who engage with customer service in e-commerce settings. Since customer
satisfaction can be influenced by various factors, an ideal sample should include a diverse range
of customer experiences and interactions.
One of the best methods for this study is stratified random sampling, which ensures that
different customer segments are properly represented. This method involves dividing the
population into specific strata based on relevant characteristics and then randomly selecting
participants from each group. The study population would consist of customers who have
recently interacted with e-commerce customer service, and the sampling frame would be drawn
from customer service logs or transaction histories.
The strata could be defined based on:
Type of inquiry: Customers reaching out for simple vs. complex issues (e.g., order
tracking vs. technical product concerns).
Customer frequency: First-time shoppers vs. repeat customers, as their expectations and
experiences may differ.
Demographics: Age, geographic location, or other factors influencing customer
satisfaction.
By ensuring proportional representation of these groups, stratified sampling allows for an
unbiased comparison between chatbot-handled and human-handled interactions. A sample size
of 500–1000 responses would provide sufficient statistical power to analyze differences in
customer satisfaction across these groups.
To measure the dependent variable, customer satisfaction, data collection would involve:
1. Post-interaction surveys with Likert scale ratings (1-5 or 1-7) to gauge satisfaction.
2. Sentiment analysis of customer reviews and complaints to assess overall experience.
3. Net Promoter Scores (NPS) to measure customers’ likelihood of recommending the
service.
Combining these quantitative and qualitative measures will provide a comprehensive
understanding of how AI-powered chatbots influence customer satisfaction in e-commerce
businesses.