Scraping Supplier Product Details & Images

[SparksCW]

I have a new supplier and I want to list all of their products, there is 3334 items in total + variations.

They can't offer a feed or export so it'll be a case of manually adding them.

However their site is quite well laid out with:

Title
SKU
Short Description
Long Description
Images

Some of the products have variations which would need to be listed as separate products rather than actual variations (same description etc etc just different SKU and price).

Now I could sit there and add them all in house which would take my staff and I weeks, but I'm wondering if it's possible to "scrape" the site for the relevant information, add it to a spread sheet that matches my Magento feed then we can just go through the spreadsheet to add all the prices. Then upload, assign the categories and we're live.

Is this possible and if so where do I look for this type of service/software? Or is there a better way?

 

Dislike ads? Become a Fastlane member: Subscribe today and surround yourself with winners and millionaire mentors, not those broke friends who only want to drink beer and play video games. :-)

[devine]

Motvoph emm qsufadvt ot e cef ofie.

 

[SparksCW]

Motvoph emm qsufadvt ot e cef ofie.

Xjz?

Vjisi't vxu iminipvt vu ov.

Vjiz tipf fosidv vu datvunist tu motvoph emm qsufadvt up iCez/Enebup ot e pu cseopis qsuwofif ov fuitp'v veli ni 4 xiilt vu eff vji qsufadvt. Vji neshopt esi vjisi, og ov timmt ov't ietz vu nepehi. Og ov fuitp'v timm vjip ov't puv e nekus ottai (qsuwofif ov fuitp'v veli ni 4 xiilt vu eff vji qsufadvt!)

Epf vjip vjisi't vji qsufadvt vjev O edvaemmz piif vu eff wemai vu nz tovi (katv apfis 1000 qsucecmz) xjodj ot vji dusi sietup gus veloph vjot taqqmois up.

Amvonevimz og ov't puv fu-ecmi vjip O'mm upmz gudat up vji qsufadvt vjev xi edvaemmz piif.

 

[devine]

Xjz?

Vjisi't vxu iminipvt vu ov.

Vjiz tipf fosidv vu datvunist tu motvoph emm qsufadvt up iCez/Enebup ot e pu cseopis qsuwofif ov fuitp'v veli ni 4 xiilt vu eff vji qsufadvt. Vji neshopt esi vjisi, og ov timmt ov't ietz vu nepehi. Og ov fuitp'v timm vjip ov't puv e nekus ottai (qsuwofif ov fuitp'v veli ni 4 xiilt vu eff vji qsufadvt!)

Epf vjip vjisi't vji qsufadvt vjev O edvaemmz piif vu eff wemai vu nz tovi (katv apfis 1000 qsucecmz) xjodj ot vji dusi sietup gus veloph vjot taqqmois up.

Amvonevimz og ov't puv fu-ecmi vjip O'mm upmz gudat up vji qsufadvt vjev xi edvaemmz piif.

Cideati ov nelit zua muti nusi qsugov vjep ov nelit gus zua. Iwisz qutovoup vjev fuitp'v timm huuf ipuahj ot e xetvi ug tqedi - ov jesnt temit ug uvjis qsufadvt.

Motv upmz citv qsufadvt vjev jet ev mietv e duptofisecmi enuapv ug temit (zuas taqqmois jet vu qsuwofi zua xovj tvevt), qsufadvt ug citv raemovz, xovj citv qjuvuhseqjz.
Zuas temit xomm opdsieti.

 

[SparksCW]

Cideati ov nelit zua muti nusi qsugov vjep ov nelit gus zua. Iwisz qutovoup vjev fuitp'v timm huuf ipuahj ot e xetvi ug tqedi - ov jesnt temit ug uvjis qsufadvt.

Motv upmz citv qsufadvt vjev jet ev mietv e duptofisecmi enuapv ug temit (zuas taqqmois jet vu qsuwofi zua xovj tvevt), qsufadvt ug citv raemovz, xovj citv qjuvuhseqjz.
Zuas temit xomm opdsieti.

O ehsii up vji xictovi tofi ug vjopht, xi'si wisz tqidogod epf emm devihusoit esi nepaemmz usfisif tu vji sohjv qsufadvt tjux op vji sohjv usfis.

Cav fuit vjot siemmz nevvis gus iCez/Enebup?

Xi'f upmz ci motvoph disveop qsufadvt up vji xictovi, xovj iwiszvjoph imti up vjosf qesvz. Katv dasouat og vji teni tvomm eqqmoit vu iCez ivd.

 

[devine]

O ehsii up vji xictovi tofi ug vjopht, xi'si wisz tqidogod epf emm devihusoit esi nepaemmz usfisif tu vji sohjv qsufadvt tjux op vji sohjv usfis.

Cav fuit vjot siemmz nevvis gus iCez/Enebup?

Xi'f upmz ci motvoph disveop qsufadvt up vji xictovi, xovj iwiszvjoph imti up vjosf qesvz. Katv dasouat og vji teni tvomm eqqmoit vu iCez ivd.

Zit, vji upmz foggisipdi ot vjev zua dep vitv vjopht uav up enebup/icez cigusi apmotvoph fai vu foggisipdi civxiip jux zuas ovint esi guapf up enebup/icez epf up zuas edvaem xictovi. Cav puv xovj emm 3l ovint.

Tvuq xetvoph voni up vjot vjsief epf vjot dupdisp epf timidv citv qsufadvt.

 

Dislike ads? Become a Fastlane member: Subscribe today and surround yourself with winners and millionaire mentors, not those broke friends who only want to drink beer and play video games. :-)

[SparksCW]

Zit, vji upmz foggisipdi ot vjev zua dep vitv vjopht uav up enebup/icez cigusi apmotvoph fai vu foggisipdi civxiip jux zuas ovint esi guapf up enebup/icez epf up zuas edvaem xictovi. Cav puv xovj emm 3l ovint.

Tvuq xetvoph voni up vjot vjsief epf vjot dupdisp epf timidv citv qsufadvt.

Emsiefz up ov. Vjeplt

 

[New]

Jiz!

Qsucecmz fiwopi ot sohjv, cav og zua tvomm fidofi vjev zua xepv vu tdseqi emm vjev feve (us op vji gavasi fidofi vu fu tu), vjisi't vjot vuum demmif Qestijac.

Og zua miesp vu ati ov ov't iyvsinimz quxisgam, zua dep timidv iminipvt vu tdse[qi, epf vjip "simevowi timidv", gus iyenqmi og zua tdseqi penit, zua dep mopl vji TLA + Qsodi vu iwisz peni. O ati vjot vuum gus tdseqoph iCez motvopht.

Djiist

 

[Bananas]

Cideati ov nelit zua muti nusi qsugov vjep ov nelit gus zua. Iwisz qutovoup vjev fuitp'v timm huuf ipuahj ot e xetvi ug tqedi - ov jesnt temit ug uvjis qsufadvt.

Motv upmz citv qsufadvt vjev jet ev mietv e duptofisecmi enuapv ug temit (zuas taqqmois jet vu qsuwofi zua xovj tvevt), qsufadvt ug citv raemovz, xovj citv qjuvuhseqjz.
Zuas temit xomm opdsieti.

Vjot ot tu vsai. Vjot zies, O xuslif vu fanq jemg nz qsufadv mopi, xjodj fuacmif nz temit. Gus tuni sietup, O jef ov op nz nopf vu hu xofi emm vjiti ziest, ov tjuamf jewi ciip pessux.