The Entrepreneur Forum | Startups | Entrepreneurship | Starting a Business | Motivation | Success

EXECUTION Process thread: Subscription website

Remove ads while supporting the Unscripted philosophy...become an INSIDER.

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
Hello,

I feel like I have been a wantrepreneur many times before in my life and this thread is dedicated to it stopping. I have already done a fair amount of work toward the project I am working on and will continue to chronicle it here. I won't explain the full details of the site I am working on but basically there is information on the internet that can be scraped and shown to users for profits. The particular information that I plan on showing my users has never been scraped before. There are competitor websites focusing on different information in the same category that charge more than $100 a month to their subscribers. I figure if I even charge $50 a month if I can get 100 subscribers minimum that is technically enough money for me to quit my job. I could just use this information for my own profit but the real money is in selling shovels not mining for gold. I am going to post on here every day barring days that I have to go on work trips in which case I work >16 hour days where I don't have time to work on this project. Currently, I spend 3 hours at least every day towards the project. I have a fiance, full-time job, and workout so that takes some of my time as well.

What I have done so far:
I already wrote a python script that scrapes this profitable information and stores it in a MySQL database. I have created a blank website that is already connected to this database and displays all of this data on the webpage for users to profit off of.

What I need to work on:
-Improving the script so it runs on a loop.
-Finding the best place to run this script continuously.
-Continue talks with Upwork freelancer about logo design.
-Work on website and find plugins that turn your website into a membership website.
-Study competitor reviews and websites.
 

Don't like ads? Remove them while supporting the forum. Subscribe.

OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
6/4/2020
-Added deletion function into script so it will delete outdated entries from the database
-Added 10-minute sleep loop this may need to be altered in the future
-Added paidmembershipspro add-on to Wordpress and did a quick setup but needs a lot of work for the full membership experience to work seamlessly.
-MySQL connection times out prematurely showing I need to change some settings on the my.cnf file which is turning out to be a massive pain with my host
 
Last edited:

Andy Black

Dad, husband, entrepreneur.
Staff member
EPIC CONTRIBUTOR
FASTLANE INSIDER
Read Millionaire Fastlane
Speedway Pass
May 20, 2014
10,716
43,774
4,306
Ireland
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
6/5/2020
-I decided to use a raspberry pi 4 to run my script full-time for now since it is a cheap option and my script is lightweight. Ordered it and it should come tomorrow.
-Later today going to contact my host on editing the MySQL configuration file which I need to do or else the connection will continue to timeout since it takes my script more than 60 seconds.
-Added columns to the database from the script calculating expected profit.
-Really annoying the website I am scraping is blocked by a work firewall during my lunch hours.
-My web hosting doesn't allow changing of the configuration file which turned out to be a big pain since I had to change how my script was coded to work around it.
-Added another column to the table showing the time difference between when the data was first found and when it was last found which is an important metric for my users
-Started using Asana as a kanban board for me to assign myself more tasks
 
Last edited:

Andy Black

Dad, husband, entrepreneur.
Staff member
EPIC CONTRIBUTOR
FASTLANE INSIDER
Read Millionaire Fastlane
Speedway Pass
May 20, 2014
10,716
43,774
4,306
Ireland
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
How many subs have you got so far @Busch_Jager ?
No subs yet I want to make the website and database/script work reliably and be a good looking finished product before it goes live. I already have a coworker that is really excited and have some friends excited about it. The website still needs to be completely designed. I plan to offer a lucrative affiliate marketing plan once it goes live. There still is a lot of work that needs to be done on the marketing side I just want to make a great product first. A lot of coding that needs done as well.
 
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
6/6/2020
-Had a lot of trouble getting my python script to work on the raspberry pi but finally got it working so now it runs all the time constantly updating the database
 
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
6/7/2020
-Spent a ton of time today trying to get the script to run on Raspberry pi boot with no avail. I think I am going to manually run it on the Raspberry Pi and a cloud solution like Heroku so I have a backup if one fails. The script auto deletes duplicates so this shouldn't be a problem.
-I think I need to look into some type of mind mapping software to break down big ideas. I have so many different things that need to be done that it can seem overwhelming. I am currently using Asana as a kanban board for the tasks.
-Created an account on Heroku just need to figure out how to set it up
-Mind mapped different areas of my product using Ayoa which allowed me to break up this project into smaller sub-tasks.
-Inquired with Stack Overflow gods about a coding library decision.
 
Last edited:
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
I could probably spend a year working on this perfecting it. Is it better to get out a decent product quickly and start to make money while improving along the way? Or release a perfect product at a later date?
 

jmin

Contributor
May 30, 2020
40
68
97
United Kingdom
I could probably spend a year working on this perfecting it. Is it better to get out a decent product quickly and start to make money while improving along the way? Or release a perfect product at a later date?
It's usually best to get the product out and then worry about improving it - build and release your 'minimum viable product'.

You don't want to put hours into something which might not take off. Plus, real feedback will highlight the work you need to focus on.

Good luck.
 

Kickflips

Contributor
Apr 4, 2020
11
51
18
Australia
It's usually best to get the product out and then worry about improving it - build and release your 'minimum viable product'.

You don't want to put hours into something which might not take off. Plus, real feedback will highlight the work you need to focus on.

Good luck.
The transformation team at my office calls it the MLP - minimum loveable product. Cringrey name I know but a good aspiration for v1.

OP, have you considered giving out 10 or so free memberships to people in your niche? The free feedback they give you will be valuable while you perfect your service and if it's as valuable as you say they will hardly complain about a free money making service!
 

Don't like ads? Remove them while supporting the forum. Subscribe.

OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
The transformation team at my office calls it the MLP - minimum loveable product. Cringrey name I know but a good aspiration for v1.

OP, have you considered giving out 10 or so free memberships to people in your niche? The free feedback they give you will be valuable while you perfect your service and if it's as valuable as you say they will hardly complain about a free money making service!
Awesome advice! I have an idea of how I want to do this now to just focus on one area and launch the product.
 
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
6/8/2020
-As I suspected it will be more useful for me to use the Scrapy framework instead of Beautiful Soup. This is going to require some time upfront to learn how to rewrite the code but from what I understand it will tremendously improve the reliability and scalability of the script.
-Nah I changed my mind with the more research that I did If it seriously slows me down I am willing to change everything over to Scrapy in the future
-I am probably going to need to look into proxy services at some point to make sure my IP doesn't get blocked
-Got a seriously awesome logo made from Upwork I wish I could show you guys but I don't want to give up the website name yet if your thinking about logos I would skip Fiverr and go right to Upwork way higher quality
-Started writing the script to scrape another website which is needed to get the minimal viable product
-Since the other website has dynamically loading pages I have to wait for the page to load before I can grab the HTML so I have to use selenium which is kind of a pain
 
Last edited:
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
6/9/2020
-Since I am going to have to use selenium on a delay I think I am going to have to convert the script to scrapy so I can crawl with multiple spiders at the same time. If I don't I will likely have outdated information and long script run times before looping.
-Swapping over all my scripts to scrapy today not finished but easier than I thought and scrapinghub.com has an amazing platform for deploying the spiders at any scale when using scrapy.
 
Last edited:

Honey_Syed

New Contributor
May 12, 2016
4
5
14
27
What market are you in? Would be interested in the affiliate opportunity once you're live, if good enough we can probably do an exclusive deal too. Good Luck.
 
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
What market are you in? Would be interested in the affiliate opportunity once you're live, if good enough we can probably do an exclusive deal too. Good Luck.
Awesome man this will be exclusive to certain states in the U.S.
. . . . . . .for now.
 
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
I really have a lot of confidence that this is going to work out if I put the work in. Thinking about Unscripted there is so much time coding or money if you hired someone to do it that I know there aren't going to be many competitors popping up unless they put in some serious time/money.
 
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
6/10/2020
-Forgot to post my progress in here yesterday but still working to transition my code to the scrapy framework, it's a pain now but it's going to pay off in dividends in the long run. It will make adding new data sources to the pipeline way easier, increasing scalability.
 

Timmy C

I Will Not Stop!
Read Millionaire Fastlane
I've Read UNSCRIPTED
Speedway Pass
Jun 12, 2018
1,218
2,728
663
Melbourne, Australia
Nice nice.

Have you engaged the market first and are now onto creating the product?

By that i mean...spoken to them on zoom, skype, got them to fill out a survey and have enough data to determine it is something they actually want?

Might help drawing up a customer profile if you haven't done that yet it's helped me alot.
 

Boychamp

Bronze Contributor
Read Millionaire Fastlane
I've Read UNSCRIPTED
Jun 13, 2019
79
109
121
Might help drawing up a customer profile if you haven't done that yet it's helped me alot.
This. Do this if you haven't already. I just read a little bit about how you're overwhelmed with the amount of ideas (which I understand). If you know exactly who you're creating this product for (in the beginning) it can also help give you clarity around what to focus your time on. As an example, let's say there's some tertiary feature you're working on that's taking a good chunk of your time, well it may not be so important to the customers you actually want to start out with so, for now, you can put a pin in it and work on a more pressing issue to get your MVP (minimal viable product) out.
 

Don't like ads? Remove them while supporting the forum. Subscribe.

OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
Great suggestions guys! I should certainly come up with a customer profile. I am very confident people will want this product but in my geographical area, it doesn't exist yet. It's essentially an easy way to make money and is 100% not a scam or some bs course. I am spoonfeeding the subscribers the information to make money. Kind of like if I had some service that scraped Craigslist listings compared them to Ebay and sold subscribers in my area the database of all profitable items in their area to flip. But the information I am selling isn't dependant on any source of physical products.
 
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
6/11/2020
-The website I was scraping just updated to a dynamic Javascript website so new scraping methods had to be implemented.
-I rewrote the code to use Splash a headless browser like Selenium that can wait for Java script to load before grabbing the html.
-Gave suggestions to Upwork freelancer or logo revisions.
-Came to a roadblock on my code and posted on stack overflow.
 
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
Even if for some reason this didn't work out I am improving my web scraping skills so much where I just know I could use it to come up with another idea. I already have a couple but I am going to keep pushing on this 100%. Sometimes I wonder if my fiance is slightly bottlenecking me on progress since if I was single I would just stay at my work office till at least 8 or 9 working on my code every night.
 
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
6/12/2020
-Eagerly awaiting for someone to help me on stack overflow there are some other things I can do in the meantime but this is really holding me back from continuing to code.
 
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
F*ck coding.

Sell some of your product today?

Pre sell it.
It seems weird to presell a subscription service unless I offered some type of lifetime subscription or something. This is a possibility but I am really not sure on the timeline for when this will be finished. I like coding because the barrier to entry for my competitors is either a ton of money for someone to code everything or a ton of time with the ability to code. I don't have a ton of money so I guess I have to spend a ton of time and luckily I know how to code. I like software because I can make money sleeping and there is never any worries that come with a physical product.
 
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
6/14/2020
-traveling to North Dakota for work
-Asked a question on stack overflow for my code
 
Last edited:
OP
OP
Busch_Jager

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
44
33
48
Pittsburgh, PA
6/15/2020
-Worked 7AM - 830PM for my job so I didn't have much time.
-I took the answer from stack overflow and fixed my code so now it processes items through the scrapy pipeline.
-Went through the final logo revisions with freelancer
 

Create an account or login to comment

You must be a member in order to leave a comment

Create account

Create an account on our community. It's easy!

Log in

Already have an account? Log in here.

Sponsored Offers

  • Sticky
MARKETPLACE Fox's Web Design Guide: Earn $100K this year (Yes, 2020!) and Go Fastlane
Hi guys, I repost here my old review with a small update : Feb 2020 : Hi guys, Just wanted...
  • Sticky
FEATURED! Introducing... WEALTH EXPO$ED, A Short Story By MJ DeMarco
Ah, I should've checked here to find out that it was free! Although, Amazon only charged $2 for...
  • Sticky
MARKETPLACE Lex DeVille's - Advanced Freelance Udemy Courses!
Pick the one you need most. Some just buy them all. :D Loving your email sequence.
  • Sticky
MARKETPLACE You Are One Call Away From Living Your Dream Life - LightHouse’s Accountability Program ⚡
Dropping a quick note in here to say... if you are on TFL, you are part of an elite group of...
  • Sticky
MARKETPLACE Kill Bigger Incubator
I joined @Kak's business incubator in the first week of May. During our daily chats we uncovered...


Visit A Forum Sponsor
sponsor

New Topics

Fastlane Insiders

View the forum AD FREE.
Private, unindexed content
Detailed process/execution threads
Monthly conference calls with doers
Ideas needing execution, more!

Join Fastlane Insiders.

Top Bottom
AdBlock Detected - Please Disable

Yes, ads can be annoying. But please...

...to support the Unscripted/Fastlane mission (and to respect the immense amount of time needed to manage this forum) please DISABLE your ad-block. Thank you.

I've Disabled AdBlock