ya gotta love technology. just finished "training" my crawlers to pick out certain data i need for the Cannabis strains love this free app loads of potential for collecting data
looks like this at the moment
gonna save me loads of time!
its been running for about 30 min now, i have 3380 rows of data and its still got over 10k pages to go through so yeah loving this right now seriously couldn't be bothered to writer a crawler, not that i'm a developer but i could find out how, and even worse i couldn't be bothered to go into each page to find the info i was looking for!
Its seems to be doing around 6k pages/hour if that is useful to any one.
Update -- 6k strains now sorted in to excel an some sort of order. time to add to website hope to be able to add 100 a week, hope to out source the data entry in a bit
looks like this at the moment
gonna save me loads of time!
its been running for about 30 min now, i have 3380 rows of data and its still got over 10k pages to go through so yeah loving this right now seriously couldn't be bothered to writer a crawler, not that i'm a developer but i could find out how, and even worse i couldn't be bothered to go into each page to find the info i was looking for!
Its seems to be doing around 6k pages/hour if that is useful to any one.
Update -- 6k strains now sorted in to excel an some sort of order. time to add to website hope to be able to add 100 a week, hope to out source the data entry in a bit
Last edited: