Logs

Timestamp Message
2021-02-22 17:46:08 Current crawl speed is: 17 items/min
2021-02-22 17:46:08 Stopping Spiders.Walmart, closespider_itemcount achieved
2021-02-22 17:45:23 Dropping item: %{description: "", id: "1072864_1031899", image: [], price: [], title: "", url: "https://www.walmart.com/browse/1072864_1031899"}. Reason: missing required fields
2021-02-22 17:45:19 Dropping item: %{description: "", id: "cordless-drills", image: [], price: [], title: "", url: "https://www.walmart.com/c/kp/cordless-drills"}. Reason: missing required fields
2021-02-22 17:45:19 Dropping item: %{description: "", id: "reconditioned-drills", image: [], price: [], title: "", url: "https://www.walmart.com/c/kp/reconditioned-drills"}. Reason: missing required fields
2021-02-22 17:45:17 Dropping item: %{description: "", id: "code-readers", image: [], price: [], title: "", url: "https://www.walmart.com/c/kp/code-readers"}. Reason: missing required fields
2021-02-22 17:45:13 Dropping item: %{description: "", id: "91083?page=3&cat_id=91083&prg=mWeb", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/91083?page=3&cat_id=91083&prg=mWeb"}. Reason: missing required fields
2021-02-22 17:45:08 Current crawl speed is: 21 items/min
2021-02-22 17:45:02 Dropping item: %{description: "", id: "327310962", image: [], price: [], title: "", url: "https://www.walmart.com/ip/THINKOBD-100-OBDII-Scanner-code-reader-full-10-mode-functionality-Erase-error-codes-see-live-data-reader-read-O2-Sensor-EVAP-System-Smog-Test-reading/327310962"}. Reason: missing required fields
2021-02-22 17:44:41 Dropping item: %{description: "", id: "663270116", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Ancel-AD410-OBD2-Car-Scanner-Check-Vehicle-Engine-Light-Auto-Code-Reader-Clear-Fault-Codes-OBDII-Automotive-Diagnostic-Tools-Black-Orange/663270116"}. Reason: missing required fields
2021-02-22 17:44:08 Current crawl speed is: 19 items/min
2021-02-22 17:43:51 Dropping item: %{description: "", id: "880859084", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Foxwell-NT630-Elite-OBD2-Scanner-ABS-Airbag-SRS-Reset-SAS-Calibration-Check-Engine-Light-Code-Reader-Crash-Data-Turn-Warning-OBDII-Automotive-Diagnos/880859084"}. Reason: missing required fields
2021-02-22 17:43:19 Dropping item: %{description: "", id: "19512138", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Key-Bands-Neon-4-Pk/19512138"}. Reason: missing required fields
2021-02-22 17:43:14 Dropping item: %{description: "", id: "821767917", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Upgraded-Car-Vacuum-Cleaner-ANKO-High-Power-DC12-Volt-Wet-amp-Dry-Handheld-Auto-Cleaner-16-4FT-5M-Cord-2-Filters-3-different-attachments-One-Carrying/821767917"}. Reason: missing required fields
2021-02-22 17:43:08 Current crawl speed is: 19 items/min
2021-02-22 17:42:36 Dropping item: %{description: "", id: "746811976", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Relay-4-Pin-SPST-Black-Car-Automotive-Truck-Motor-DC-12V-40A-2-Pcs/746811976"}. Reason: missing required fields
2021-02-22 17:42:32 Dropping item: %{description: "", id: "353285296", image: [], price: [], title: "", url: "https://www.walmart.com/ip/6-Way-Fuse-Box-12V-24V-Car-Truck-Boat-Marine-Bus-RV-Van-Blade-Fuse-Box-Holder-Block-Case/353285296"}. Reason: missing required fields
2021-02-22 17:42:12 Dropping item: %{description: "", id: "326666540", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Boss-CPBK2-2-Farad-20-Volt-Digital-Voltage-Car-Audio-Power-Capacitor-LED-Black/326666540"}. Reason: missing required fields
2021-02-22 17:42:08 Current crawl speed is: 11 items/min
2021-02-22 17:41:53 Dropping item: %{description: "", id: "48806711", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Nippon-PB2010XT-Audiopipe-Distribution-Block-Pair-Packed/48806711"}. Reason: missing required fields
2021-02-22 17:41:49 Dropping item: %{description: "", id: "391554231", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Xscorpion-Platinum-12V-Digital-Distribution-Block-0-In-2-4-8-Gauge-Out-AWG-Volt-Meter/391554231"}. Reason: missing required fields
2021-02-22 17:41:42 Dropping item: %{description: "", id: "91083_5941050_1072091?page=10&cat_id=91083_5941050_1072091", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/automotive-electrical/91083_5941050_1072091?page=10&cat_id=91083_5941050_1072091"}. Reason: missing required fields
2021-02-22 17:41:40 Dropping item: %{description: "", id: "91083_5941050_1072091?page=9&cat_id=91083_5941050_1072091&prg=mWeb", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/automotive-electrical/91083_5941050_1072091?page=9&cat_id=91083_5941050_1072091&prg=mWeb"}. Reason: missing required fields
2021-02-22 17:41:39 Dropping item: %{description: "", id: "554762600", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Zippo-65828-Butane-Lighter-Insert-Arc-Lighter-Insert/554762600"}. Reason: missing required fields
2021-02-22 17:41:32 Dropping item: %{description: "", id: "91083_5941050_1072091?page=8&cat_id=91083_5941050_1072091&prg=mWeb", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/automotive-electrical/91083_5941050_1072091?page=8&cat_id=91083_5941050_1072091&prg=mWeb"}. Reason: missing required fields
2021-02-22 17:41:29 Dropping item: %{description: "", id: "91083_5941050_1072091?page=7&cat_id=91083_5941050_1072091", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/automotive-electrical/91083_5941050_1072091?page=7&cat_id=91083_5941050_1072091"}. Reason: missing required fields
2021-02-22 17:41:29 Dropping item: %{description: "", id: "352599153", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Viking-Horns-VPS-150-Air-Pressure-Switch-Rated-120-150-for-Train-Horns-Three-unit-Deal/352599153"}. Reason: missing required fields
2021-02-22 17:41:21 Dropping item: %{description: "", id: "91083_5941050_1072091?page=6&cat_id=91083_5941050_1072091&prg=mWeb", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/automotive-electrical/91083_5941050_1072091?page=6&cat_id=91083_5941050_1072091&prg=mWeb"}. Reason: missing required fields
2021-02-22 17:41:18 Dropping item: %{description: "", id: "91083_5941050_1072091?page=5&cat_id=91083_5941050_1072091&prg=mWeb", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/automotive-electrical/91083_5941050_1072091?page=5&cat_id=91083_5941050_1072091&prg=mWeb"}. Reason: missing required fields
2021-02-22 17:41:09 Dropping item: %{description: "", id: "91083_5941050_1072091?page=4&cat_id=91083_5941050_1072091", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/automotive-electrical/91083_5941050_1072091?page=4&cat_id=91083_5941050_1072091"}. Reason: missing required fields
2021-02-22 17:41:08 Current crawl speed is: 14 items/min
2021-02-22 17:41:07 Dropping item: %{description: "", id: "91083_5941050_1072091?page=3&cat_id=91083_5941050_1072091", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/automotive-electrical/91083_5941050_1072091?page=3&cat_id=91083_5941050_1072091"}. Reason: missing required fields
2021-02-22 17:40:59 Dropping item: %{description: "", id: "91083_5941050_1072091?page=2&cat_id=91083_5941050_1072091&prg=mWeb", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/automotive-electrical/91083_5941050_1072091?page=2&cat_id=91083_5941050_1072091&prg=mWeb"}. Reason: missing required fields
2021-02-22 17:40:58 Dropping item: %{description: "", id: "391056031", image: [], price: [], title: "", url: "https://www.walmart.com/ip/iWork-Tools-Value-Pack/391056031"}. Reason: missing required fields
2021-02-22 17:40:56 Dropping item: %{description: "", id: "91083_5941050_1072091", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/automotive-electrical/91083_5941050_1072091"}. Reason: missing required fields
2021-02-22 17:40:55 Dropping item: %{description: "", id: "15167378", image: [], price: [], title: "", url: "https://www.walmart.com/ip/DieHard-6V-12V-Battery-Charger-Maintainer/15167378"}. Reason: missing required fields
2021-02-22 17:40:48 Dropping item: %{description: "", id: "91083_5941050_5690271?page=2&cat_id=91083_5941050_5690271&prg=mWeb", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/hand-tools/91083_5941050_5690271?page=2&cat_id=91083_5941050_5690271&prg=mWeb"}. Reason: missing required fields
2021-02-22 17:40:47 Dropping item: %{description: "", id: "91083_5941050_5690271", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/hand-tools/91083_5941050_5690271"}. Reason: missing required fields
2021-02-22 17:40:44 Dropping item: %{description: "", id: "91083_5941050_5091670", image: [], price: [], title: "", url: "https://www.walmart.com/browse/auto-tires/auto-tool-storage/91083_5941050_5091670"}. Reason: missing required fields
2021-02-22 17:40:08 Current crawl speed is: 19 items/min
2021-02-22 17:39:55 Dropping item: %{description: "", id: "443391757", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Alpha-Metals-2488617-2-oz-Electrical-Rosin-Flux-Paste-for-Electrical-Soldering/443391757"}. Reason: missing required fields
2021-02-22 17:39:53 Dropping item: %{description: "", id: "202922077", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Kitchen-Torch-Lighter-Food-Torch-Blow-Butane-Adjustable-Flame-With-Safety-Lock-for-Cooking-Camping-Kitchen-BBQ-Creme-Brulee-Lock-Baking-Cr-me/202922077"}. Reason: missing required fields
2021-02-22 17:39:23 Dropping item: %{description: "", id: "21586618", image: [], price: [], title: "", url: "https://www.walmart.com/ip/BERNZOMATIC-TS8000-Bernzomatic-TS8000-Trigger-Start-Torch/21586618"}. Reason: missing required fields
2021-02-22 17:39:08 Current crawl speed is: 20 items/min
2021-02-22 17:39:07 Dropping item: %{description: "", id: "492486821", image: [], price: [], title: "", url: "https://www.walmart.com/ip/BLUEFIRE-Pearl-Metal-Handle-Turbo-Torch-Head-Multi-Purpose-Auto-Blowtorch-fuel-Propane-MAPP-MAP-PRO-Great-Cooking-Gadget-Chef-Welding-Brazing-Nozzle-/492486821"}. Reason: missing required fields
2021-02-22 17:38:14 Dropping item: %{description: "", id: "372935161", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Single-Flint-Torch-Striker-Spark-Lighter-Replacement-Flints-5-pkg/372935161"}. Reason: missing required fields
2021-02-22 17:38:08 Current crawl speed is: 20 items/min
2021-02-22 17:37:55 Dropping item: %{description: "", id: "19306246", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Western-Enterprises-312-20-Barbed-Hose-Nipples-44-Brass/19306246"}. Reason: missing required fields
2021-02-22 17:37:42 Dropping item: %{description: "", id: "237902859", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Multifunctional-Outdoor-Barbecue-Baking-Camping-Gas-Welding-Torch-Gas-Spray-Machine-Maker-Kitchen-BBQ-Tool/237902859"}. Reason: missing required fields
2021-02-22 17:37:13 Dropping item: %{description: "", id: "992521542", image: [], price: [], title: "", url: "https://www.walmart.com/ip/Amico-140-Amp-Stick-ARC-Welder-IGBT-Inverter-DC-Welding-ARC-140/992521542"}. Reason: missing required fields