Viewing 15 posts - 1 through 15 (of 17 total)

Shopperpress Datafeedr change

Hi Mark, I really don't know where to put this topic in, so I just placed it in general discussion, as it looks like all the shopperpress datafeedr posts have been eliminated somehow. Anyways, what I noticed from all the posts I did read, is that people were trying to import their products from their datafeedr database, and kept getting timed out. I started to import my products from datafeedr, and noticed not only did the script time out, but while importing, my website would be down. (That's not good). I went ahead and copied your datafeedr import class, and made some modifications, and created cron job file. I did notice that when having nested categories, if the categories were the same name, they didn't get created. For example, I have a category called clothing. It goes something like this: Clothing->Men->Jeans Clothing->Women->Jeans If I ran your script, and it created Men->Jeans first, then when it got to Women->Jeans, it wouldn't create. In that script I have fixed that, and it creates just fine now. The advantage I have found with this cron job is, that I can navigate the website even if I am importing products from datafeedr. I have also added a feature to detect weather you want to update all of your products, or just add the new ones. That makes the script a bit faster, as it skips the ones that are already imported. I'd like to give this script to you, so you can take a look at it, and see if something can be done to benefit other users of shopperpress. Let me know. Thanks.

Created: July 2, 2013 at 9:57 pm

  • Mark Fail
    Mark Fail
    July 3, 2013 at 12:43 am

    Hi Jorge

    thats very kind of you, you can zip it and attach it here and ill take a look.

    It wont create a category of the same name because the slug will already exist, if you change the slug value to be unique it will create it.

  • Jorge
    July 3, 2013 at 11:06 am

    Hi Mark,

    Thanks for your interest. I have attached the class on this post. I have been testing it out, and made a bit more changes last night. The script is running as I type, and seems to import very well. The only issue I am seeing now is, it may still time out after about 500 or so products, depending on the server, but at least it doesn’t leave your website hanging.

  • Mark Fail
    Mark Fail
    July 3, 2013 at 11:13 am

    thanks Jorge

    The one issue iv always had is that when a script runs for too long it times out, with most people stocking up 10,000+ products via datafeedr this is when the problems arise.

    I’m wondering if there is a better way todo it, when you import items into your site using the plguin provided by datafeedr, does the timeouts still happen?

  • Jorge
    July 3, 2013 at 11:18 am

    Nope, it doesn’t timeout. It only times out when using shopperpress datafeedr import. To me, it timed out even with less than 1k products. I upped the time in php.ini file, and still got timed out. I will take a look into datafeedr’s plugin, and see what is different from your code.

    By the way, did you get the attachment, seems that it’s not letting me attach any files, no matter what extension I give it.

    Any help?


  • Mark Fail
    Mark Fail
    July 3, 2013 at 11:19 am

    you need to .zip them.

  • Jorge
    July 3, 2013 at 11:29 am

    Let’s see if this works.

    You must be logged in to view attached files.
  • Mark Fail
    Mark Fail
    July 3, 2013 at 1:57 pm

    thanks, looks alot cleaner good stuff.

    how many products do you have on your DF account?

  • Jorge
    July 3, 2013 at 2:02 pm

    I had about 5K more or less, before I deleted them, and started fresh once again. I currently have about 1.5k products.

    I have to say, although it is working fine, but I’m not satisfied with the overall result just yet. I will keep working with this issue, and try to perfect it at max.

  • Mark Fail
    Mark Fail
    July 3, 2013 at 2:15 pm

    thanks, would love to (if you dont mind) get some logins to test the import prodcess myself, its been along while since iv worked with DF.

    my email is:">

  • Alexander
    July 17, 2013 at 7:36 am

    Hi Mark, i would like to continu on this topic. I’m recently installed comparisonpress and I’m using datafeedr to import feeds via their pluging into comparisonpress.

    I’m having a lot of products probably over 200K (books) and it seems that importing via the datafeedr pluging works (slow, but it does the trick) but when I then try to import all the products in the database via the import product option of comparisonpress the system times out. I’ve already tried to increase the timeout settings in php.ini to 300 instead of 30 but still the problem occurs.

    Do you have any suggestions on how to fix this? I used pricetapestry a while ago and they had a slow import tool included that allow packaged import to avoid timouts.


  • Mark Fail
    Mark Fail
    July 17, 2013 at 9:49 am

    It’s something im working on but could really do with a large feed file to test it, iv got a few but my dev sites are all local so it imports without error.

    The other issues is that everyons hosting is different, so some with upload 10,000 listings without issues whilst others will struggle with 1,000.

  • Amy
    July 21, 2013 at 5:55 pm

    Would you like to experiment with my feed? I’ve got over 25,000 products I’m trying to import into Shopperpress using Datafeedr and it just won’t do it. It will import around 3800 each time I try and that’s it. Datafeedr is importing fine. It’s just moving it into Shopperpress that causes problems.

  • Mark Fail
    Mark Fail
    July 22, 2013 at 1:04 am

    yes please!

    please email me at">

  • Mark Fail
    Mark Fail
    July 22, 2013 at 8:02 am

    im looking at the datafeedr integration again to see if there is a better way of doing this. It seems alot has changed since i first used their application.

    Is their recommended way of importing content as ‘drip feed’ approach?

    Anyone any feedback on how useful datafeedr is these days as it doesnt seem to provide many details product data besides the image, price and title.

Copyright © 2010-2020 PremiumPress Limited.

secure payments