Logs

Timestamp Message
2021-02-18 23:26:16 Stopping Spiders.Walmart, itemcount timeout achieved
2021-02-18 23:26:16 Current crawl speed is: 0 items/min
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/back-to-school-clothing/5438_1432442, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/bags-accessories/5438_1045799, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/petite-plus/5438_7161239, as it's already processed
2021-02-18 23:26:15 Dropping item: %{description: "", id: "5438?page=10&cat_id=5438&ps=48", image: [], price: [], title: "", url: "https://www.walmart.com/browse/clothing/5438?page=10&cat_id=5438&ps=48"}. Reason: missing required fields
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/mens-clothing/5438_133197, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/maternity-plus/5438_6770805, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/juniors/5438_133201, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/juniors-plus/5438_5394749, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/kids/5438_7712430, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/shoes/5438_1045804, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/pre-owned/5438_6272369, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/womens-plus/5438_133195, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/men-s-big-tall/5438_133198, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/womens-clothing/5438_133162, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/premium-beauty/5438_7924299, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/women-s-petite/5438_3117077, as it's already processed
2021-02-18 23:26:15 Dropping request: https://www.walmart.com/browse/clothing/maternity-clothing/5438_133284, as it's already processed
2021-02-18 23:26:13 Dropping item: %{description: "", id: "346615251", image: [], price: [], title: "", url: "https://www.walmart.com/ip/2018-New-Indoor-Home-Slippers-Cotton-Fabric-Slippers-Home-Slippers-Couples-Wooden-Floor-Slippers-For-Women/346615251"}. Reason: missing required fields
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/juniors/5438_133201, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/juniors-plus/5438_5394749, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/maternity-clothing/5438_133284, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/maternity-plus/5438_6770805, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/men-s-big-tall/5438_133198, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/pre-owned/5438_6272369, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/petite-plus/5438_7161239, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/premium-beauty/5438_7924299, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/women-s-petite/5438_3117077, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/back-to-school-clothing/5438_1432442, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/shoes/5438_1045804, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/womens-clothing/5438_133162, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/womens-plus/5438_133195, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/mens-clothing/5438_133197, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/kids/5438_7712430, as it's already processed
2021-02-18 23:26:12 Dropping request: https://www.walmart.com/browse/clothing/bags-accessories/5438_1045799, as it's already processed
2021-02-18 23:26:12 Dropping item: %{description: "", id: "5438?page=9&cat_id=5438&ps=48", image: [], price: [], title: "", url: "https://www.walmart.com/browse/clothing/5438?page=9&cat_id=5438&ps=48"}. Reason: missing required fields
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/bags-accessories/5438_1045799, as it's already processed
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/shoes/5438_1045804, as it's already processed
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/back-to-school-clothing/5438_1432442, as it's already processed
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/juniors-plus/5438_5394749, as it's already processed
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/maternity-clothing/5438_133284, as it's already processed
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/maternity-plus/5438_6770805, as it's already processed
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/men-s-big-tall/5438_133198, as it's already processed
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/pre-owned/5438_6272369, as it's already processed
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/juniors/5438_133201, as it's already processed
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/women-s-petite/5438_3117077, as it's already processed
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/petite-plus/5438_7161239, as it's already processed
2021-02-18 23:26:07 Dropping request: https://www.walmart.com/browse/clothing/womens-plus/5438_133195, as it's already processed
2021-02-18 23:26:07 Dropping item: %{description: "", id: "5438?page=8&cat_id=5438&prg=mWeb&ps=48", image: [], price: [], title: "", url: "https://www.walmart.com/browse/clothing/5438?page=8&cat_id=5438&prg=mWeb&ps=48"}. Reason: missing required fields