Built a webscraper

I need a scraper that will scrape my supplier's webshop. It needs to be able to do the following:

- login with username and password

- scrape all products and retrive the following informations:

-- SKU, Productname , Flavors, Is in stock, Price

- save it as a cvs file (preferably on my server in a directory)

Example:

<div class="text">

<tr>

<td class="fproductname">Green Apple</td>

<td class="fstock"><div class="stock"><img src="/images/[url removed, login to view]" alt="In stock" class="tooltip" /> In stock</div></td>

<td class="fprice">€ 21.98</td>

<td class="amount">

<div class="data">

<input type="number" name="amount_42300"

id="fc_amount_42300"

value="0" size="2" maxlength="5" class="textfield center" tabindex="1"

data-price="2198"

data-id="3934" />

</div>

</td>

<td class="boxes">

<div class="data">

<input type="number" name="boxes_3934"

id="fc_boxes_3934"

value="0" size="2" maxlength="3" class="textfield center" disabled

data-boxcontents="12"/>

</div>

</td>

</tr>

<tr>

<td class="fproductname">Pomegranate</td>

<td class="fstock"><div class="stock"><img src="/images/[url removed, login to view]" alt="Out of stock" class="tooltip" /> In stock</div></td>

<td class="fprice">€ 21.98</td>

<td class="amount">

<div class="data">

<input type="number" name="amount_42301"

id="fc_amount_42301"

value="0" size="2" maxlength="5" class="textfield center" tabindex="1"

data-price="2198"

data-id="3935" />

</div>

</td>

<td class="boxes">

<div class="data">

<input type="number" name="boxes_3935"

id="fc_boxes_3935"

value="0" size="2" maxlength="3" class="textfield center" disabled

data-boxcontents="12"/>

</div>

</td>

</tr>

</tbody>

</table>

<div class="actions">

<a href="#"><img src="/images/[url removed, login to view]" alt="Add to cart" class="rollover" /></a>

<div class="compare">

<input type="checkbox" class="compareCheckbox" id="chkCompare_0" value="4230" />

<label id="lblCompare" for="chkCompare_0">Compare this product</label>

</div>

</div>

<div class="clear"></div>

This should turn out in the following:

Productname: 5150

SKU: 4230

Flavors: Green Apple, Pomgrenade

Price: 21.98 €

And this data needs to be at the end in a cvs file like this:

SKU; ;Flavor;;;;Price;Is_In_Stock

4230; ;Green Apple;;;;21.98;100

4230; ;Pomgrenade;;;;21.98;0

Excel Web Scraping

Proje NO: #13518701

Proje hakkında